Update: THERE IS A FIX!
If you download and install Winstep Nexus (it's a MacOS style dock for Windows), the buzzing disappears completely! Not a single sound. Super weird that something like this fixes it, but I guess computers work in mysterious ways.
I don't really want the dock itself, so I just set it to auto-hide on the right edge of the screen.
Credit goes to the guy on this Reddit thread: https://www.reddit.com/r/Surface/comments/e9xrip/surface_laptop_3_buzzing_noise/
That is probably just preventing your CPU from going totally idle. Look on page 13 of this thread, there is a registry entry to disable CPU idle states. It removed the buzzing and fix external monitor issues for me, but I still returned my Surface because it is ridiculous to pay so much for something that doesn't work properly.
It's not really a fix, just a workaround, like installing software. Your battery will drain faster.