I had a similar issue. BLUF: I upgraded the Sound Card drivers to fix it.
I spent a lot of time thinking this was a Bluetooth issue, but in the end, it turned out to be a Sound driver issue. Windows update didn’t catch it. I went straight to the Dell website (my laptop brand) and manually downloaded/installed new drivers for my sound card. I also downloaded new Bluetooth drivers, but that didn’t resolve it.