This started happening to me on the windows PC I use at work. It does not have the XBOX App installed, but does have two other xbox related apps listed: Xbox Console Companion, and Xbox Game Bar. I have tried removing app permissions from both of them, for all that I could find in the "Advanced Settings". Will have to wait and see if that solves it for me.
Notable that if I open the Xbox Console Companion app, it suggests I download the new Xbox App for Windows 10, so I suspect it's probably the closest thing of the two I see.