Using Classic Outlook on Windows for personal email, calendar, and contact management
I have this problem constantly and the only thing that sorta helps is to set a recurring calendar reminder to reset my secret address (and also delete and resubscribe within Outlook) every 2 weeks or so.
Another thing that sometimes maybe helps is running the Outlook desktop app with the command line argument "-cleansharing" every so often. You can do that by pressing Windows key + R, then type "outlook /cleansharing".