That's not very helpful to those of us who really hate those stupid "apps" and want to stick with tried-and-true programs that work, that don't take over the entire screen, and that have a proper "close" mechanism. Windows 8.1 really has a long way to go before it's as useful as WIndows 7.
The best answer I can find to the original question is to forget about the right-click option, at least until it's fixed, and do the attachment from inside your mail program. In Thunderbird, for example, it's easy to find the "attach file" button.