I've spent the last 8 hours or so banging my head on this one and finally just now found this thread. Nice to know at least that I'm not alone.
I've confirmed this issue on 2 different machines with 3 different NVME drive models. Confirmed in PCI-E 4.0 and 3.0 slots. Confirmed it only affects a disk when Windows is installed on that disk. Only random writes are affected, sequential is normal.
But furthermore, something I haven't seen mentioned yet, is that it affects not necessarily just the disk where Windows is installed, but any partition containing a Windows installation.
Create multiple partitions on the same disk and only the one where Windows is installed will have the problem. It doesn't have to be the Windows installation currently loaded either. I have installed Windows on 2 different disks in the same system. Regardless of which installation I boot into, both Windows partitions have the issue, none of the other partitions on the same disks have a problem.
Screenshot is tests from 2 different partitions on the same 980 Pro (first one has the Windows installation):
