Using Classic Outlook on Windows for personal email, calendar, and contact management
I'm having this same issue, it seems like the problem is for existing installs that got the new button pushed to them. After disabling the button in the security admin center new installs of classic outlook don't have the button. Seems like outlook doesn't pickup on the setting being disabled. The next office update may very well fix it but I need to fix it sooner rather than later.