I keep getting authenticator requests even after changing my password multiple times. I am not trying to sign in anywhere.

Hello Pel!
Changing your password isn't enough — go to https://account.microsoft.com/security and enable passwordless sign-in to remove your password entirely, which prevents attackers from ever reaching the MFA prompt stage and stops the unwanted notifications.

https://learn.microsoft.com/en-us/entra/identity/authentication/howto-authentication-passwordless-phone