SOLUTION!!
Had this same problem. Finally realized that it DIDN'T happen when the Surface Book was connected to the dock while open. If I close the Book and connect to the dock, the USB devices and display intermittently disconnect and reconnect. If I leave it open, the problems go away completely. Hope this helps anyone else struggling with this problem...