Managing sound and video settings during Teams meetings and calls for optimal communication
so the fix I found was to disable the button sync.
via '...' next to your profile pic -> settings -> Devices -> Sync device buttons downside: you cannot control the volume via the headset.