Strangely enough, the problem seems to have fixed itself now. I can see street names again. Maybe there was an update? Anyone else find this?
Well I'll be, it does indeed work. I don't know what fixed it, though there was the 2024-01 Cumulative Update (i.e. the regular monthly patch) that I found installed and waiting for a reboot this morning. I didn't find out about it being fixed until after rebooting, but that is one possibility I suppose. This doesn't match up with when this started working for some people (i.e. before patch Tuesday), so I doubt this was it.
Another possibility is an Edge update: 120.0.2210.121 was released on 01/05, and I suspect this is it, as the issue is still in Firefox as of 121.0.1 (latest available on 1/10/2024). This doesn't explain how it would also work in Chrome, unless Microsoft actually submitted the fix to Chromium to get the fix to roll out to all Chromium-browsers including Google Chrome.
I suppose there is also a chance Google made a change to Maps that fixed it in Chrome and Edge.