I have manage to fix it on my side.
Here is the story.
First, I have an Asus ROG Strix Z390-H motherboard.
I have tried re-installing Windows 1903 from USB ISO (not just the refresh option).
At first it looked that it work but when I changed the computer name, the problem came back.
Note: at that point I only had minimum driver install ie: chipset, network card etc..
Then I re-installed again and with no driver (installed by me) and the problem was still there.
Again re-installed but this time, decided to DISABLED in my bios something called Armory crate (it was in the "tools" section). This option would make a pop-up right after installing windows suggesting to download Armory Crate. I always deny it.
Even when I deny it, a service named :Asusupdatecheck (or something similar) is install on the system.
I suspect this is the culprit.
Sadly , even after removing it, it will return (probably because of the bios option always checking for it).
So on my end that service is *possibly* making irremediable damage (or hard to fix)
But this time (last time I re-installed) that service didn't install and the Armory crate didn't pop. (as expected by disabling that bios option).
And this time I have also no problem with the computer listed in network even after changing the name.
So, just sharing my experience.... If you have an Asus board that does the same, you may try what I did.
Some other software from other board manufacturer could maybe do the same.
Good luck.