My Surface Earbuds will not connect to more than one device

I have since been able to got to the Surface Audio app and just select connect from the device I want to switch to. But this still takes about a minute to do most of the time, which is still about 58 seconds to long.

It won't do it at all. Even in the Surface Audio app the only option is to connect to one device and I can't even switch from there. I have to go to Bluetooth settings and disconnect it from the first, and then they will connect to the next. With my Surface Headphones it is not like that at all, and I can regularly have them playing audio from two sources at the same time. 

Were the Earbuds designed to work like this or is there something wrong? 

Surface earbuds can pair with upto 7 devices. However they can connect to only one device at a time. Manual intervention is required to connect to a device after the first is connected. This is a severe limitation as it makes using the earbuds on your Surface (or other laptop) and phone simultaneously virtually useless since you must manually connect to the non-connected device.

Yeah, and answering from the your phone app works fine on my Surface but when I use it with work computer the app won't use the earbuds.

Scenario:  I'm working on my laptop, listening to tunes through a laptop app using my Surface Earbuds.

1.  my phone rings

2.  I pick up my phone, unlock it, and start up the Surface Audio app

3.  I wait a few seconds as it is telling me to take my earbuds out of the charger (they're already in my ears)

4.  Now it gives me the ability to connect, so I press 'connect'

5.  I wait a few seconds for it to disconnect from my laptop, then connect to my phone

6.  Now I'm ready to answer my phone using my earbuds, and the caller has either hung up or gone to voice mail.

Did anyone at MS test this scenario?  Did they really thing that the majority of their users would only want to be connected to a single device at a time?

I agree. The main reason I bought them was for that all day convenience advertised and this is really inconvenient. Hardware is great but but this software issue is big problem.