Organizing and accessing contact information in Outlook.com
I also am having the same problem - i'd like to delete old girlfriend addresses that have a habit of popping up by the suggestions just when you don't want them too (i.e. wife looking over shoulder).
I really would appreciate an option to remove them - especially considering none of them are listed in my contacts.