Using New Outlook on Windows for academic communication and scheduling
Shift + right click. This opens additional menu items. and was performed on Windows 10 Enterprise.
This option only happens once when it initially installs, but if you decide to add it back to the taskbar, you can right-click and the option to remove from taskbar will be available.