This work around fixed it for me - https://answers.microsoft.com/en-us/windows/forum/all/how-do-i-keep-onenote-from-adding-itself-to/800dafa9-a9d1-478d-ac1b-aa8e138e4d91
Microsoft needs to fix this issue. I'm assuming the same problem occurs if you're using Outlook or any other local version of a Windows 365 app?