Replacing the device won't change anything.
This is a CPU/Chipset issue and likely related to the dynamic power state/clock speed variations.
Anythnig running in the background will generated this "singing crickets" noise even if you stare at your screen. A lot of people won't hear it because their environment is too noisy but a quiet room easily reveals it. The SP4 with the m3, being totally silent, may appear more affected by this curiosity.
Unless Microsoft changes the way the SP4 is built, it won't change. Either you get over it or get a refund and buy something else.