3 monitor setup.
Monitor 1 - Nvidia 2080 Displayport
Monitor 2 - Nvidia 2080 Hdmi
Monitor 3 - Motherboard Hdmi
After coming back from sleep, all icons were always moved to monitor 3 and Automatically hide the taskbar was disabled.
When I turned the setting back on, the icons were moved back to Monitor 1.
My Nvidia 2080 only has one Hdmi port, but 3 Displayport ports.
Buying a DP > Hdmi adapter and connecting my Monitor 3 to the Nvidia2080 and the problem is gone.
Guess: Monitor 3 woke up faster from sleep when connected straight into the motherboard, so everything got drawn on it first.
But why the setting was changed is still a mystery. One that I don't care much about anymore since I got it solved by connecting all monitors to the same card.