I finally fixed this issue by replacing my bluetooth usb dongle.
I had TP Link UB500 (Bluetooth 5.0). Keyboard and mouse worked fine, but my headsets (Sony, Apple, Samsung, Sennheiser, and
Poly Voyager 5200) had the stuttering issue. (Dropped audios for a fraction of a second) Listening to music or watching the video was less bothersome, but it caused a bit of an issue in the Teams meeting. I validated that the audio bluetooth device were not having any faultiness since I've connected them to my laptop (Lenovo X1 Carbon with built-in bluetooth) without any issues. After suffering for about 6 months, I finally spent 27 bucks, and I changed to Techkey Long Range Bluetooth adapter (5.3).
After the installation and pairing the audio devices:
- No more stuttering (dropped audio issue)
- The audio quality dropped if I stepped away for about 6 feet away from my desktop, now I can go get a cup of water, which is about 20~30 feet away, and there isn't any issue.