I just tried doing that with my Android phone. Mind you, it's Android 8.0 on a Samsung Note 8 (Sprint) and you can't long press or go into the app and just uninstall the app from there.
Hello,
Sorry to hear you are having this issue. Have you gone to the Google Play Store on your device and searched for the application Microsoft Launcher and click uninstall from there?