Same issue with my HP Envy 14 laptop.
Is your display adapter getting power from the TV? I wonder if its worth trying a AC-USB power supply. Maybe the USB power just isn't enough for power demands when video streams??
I have tried this with the same results. My surface, wifi router, and adapter are within 3' of each other. The adapter disconnects about every 10 minutes.