That is indeed an interesting observation. In that case, can I ask you to try both of the remote desktop programs inside Windows 8.1? Perhaps the problem lies only with one of them. I'm assuming that if you used the original Windows 7 remote desktop program (which is included in Windows 8.1 but hidden), it might work better for you.
- To try it, run the command MSTSC and use that as your remote desktop and observe how it functions. That command is from back in 1994 before "remote desktop" got it's new name. Back then it was called "Microsoft Terminal Services Client"
- Then try again, but using the modern "remote desktop" app from the app store here and see how it functions.
I'm curious to know the results and if one of them works better than the other.