As per "brummel(2)", you can definitely try to rollback to a restore point prior to doing the KB5034441 update, and any others done along with it and then delay-- 7-day max I think --these updates forcibly applying themselves. Who knows, perhaps if the updates present themselves again KB5034441 will not be on the list (it would mean Microsoft has received enough complaints about this particular update and they are doing something about it...).
Otherwise, trying a system restore from a bootable USB with the latest release that you can get through the Creation Tool is the next step I'd try.
As a final step I'd be doing a restore from a backup of the system that is as close as possible to the date the update was applied. I take weekly backups of my system. So, in my case I'd "loose" whatever I'd done on the Sunday and the Monday--which wouldn't be anything much, if anything.
That's my advice for all that it is worth to anyone.