Your second option doesn't work for some people, me included, because there is nothing listed under Startup Options in the General section of Outlook Options menu.
That's part of the problem - something down there in the coding of Outlook is preventing some options to display while showing that blasted 'Reopen Items' popup when there isn't any items to be opened.
Plus, I'm having that same idiotic problem just opening Outlook for the first time of the day - most times Outlook remains minimized on the taskbar, while other times it opens into a window, and then every fifth or sixth time, it opens into a window, opens the last email I read the previous night before shutting down, and gives me the 'Reopen Items?' popup.
In other words, Outlook is NOT stable.