Wow, thanks HScotte. It fixed my issues. To be honest, it sounds a bit scary at first.
To fix it, I use these steps:
- Open Device Manager
- Right-click on one of the problematic device, click Uninstall
- Did not check the "delete driver" checkbox
- Click "Scan for hardware changes" on top
- The device comeback but still got an exclamation mark over it
- Reboot
Then on reboot, I see the "Please wait while we install a system update".

Wait a minute or two. It boot back into Windows with the device fixed.
I did that one-by-one and after 3 reboots, everything is back to normal.
Thanks again for the tip!
p.s. when the driver install or reinstall, it set a scheduled job on next reboot to install its firmware, so we are simply forcing it to retry the firmware update