Windows 11 Input Device volume automatically lowering every time

On Windows 11 every time I connect my headset to the PC (usually I use speakers, but put on a hs if I have a call) Windows automatically turns it down to 50-ish level which makes me really quiet. So I open Settings>System>Sound and adjust the general input volume to 100 + I adjust the specific mic volume to 100 in device details.

I kept seeing that volume drop right in the middle of a call, so I went to the advanced device setting and forbid exclusive control. Now Windows can't change the device volume but it still lowers the System>Sound input section volume all the time. How do I prevent this from happening? This is really annoying.

As a footnote, I wanted to say that this stuff is really getting out of hand. We have an old-style advanced settings window where we can adjust the mic level. Now we have new style Sound settings where we can adjust device input volume and on top of that, we have an overall system input volume (the one I have problems with). Add to that every piece of software has its own input settings often with an auto-adjust option. So it's as thick as 4 levels of volume controls and 3 of those can auto-adjust. 2 levels do it without the user's consent. This is just ridiculous.

Upd:
To clarify

• End software is not the issue, I made sure of that
• Exclusive control is disabled
• Disabled audio enhancements
  -"Do nothing" under "When Windows detects communications activity" is selected
• Settings > System > Sound > My headset microphone is set to 100 manually but drops on activity
• Settings > System > Sound > Input section overall Volume slider keeps dropping during conversations

So it doesn't solve the problem, auto-adjusting still occurs. If that might help, I'm using Arctis 7 wireless headphones, so I constantly turn them on and off, not if it can affect settings somehow.

For context, here is what it looks like when I'm talking - see video