So, uninstall appears to work at first, but New Outlook just comes back, at least it does for me. So, I think the next best option is to hobble it. Go into Apps->Default Apps, scroll down to both of the Outlooks. Go into each of these and set everything in both to Outlook, not Outlook(New). At least this way, when you click on a link that has anything to do with mail or calendar, or a program tries to open a mail-related link, it will use Outlook Classic.
There is one option, MS-OUTLOOK, that will only allow you to select Outlook (New) or another Store App. I believe I have found the registry entry to change this, but I haven't encountered anything that calls for it yet so I don't know if I broke anything.



Hope this helps someone!