I ran the startup repair tool from the boot USB I have and it system restored to before I installed the first batch of updates...
@OliverTabuger, can you describe the process and the outcome? If a startup repair restores the system to a consistent state and allows KB2919355 to be installed, this might be a productive way forward. Even better would be to get Microsoft to merge KB2919355 into the downloadable installer.
Unfortunately, the retail Windows 8 product key (upgrade) that I have does not allow me to download Win 8.1 from http://windows.microsoft.com/en-us/windows-8/upgrade-product-key-only. Even if I had Win 8.1 install media, it was not clear from the last call with Microsoft Support whether I would run into conflicts between the upgrade software and the upgraded OEM Windows 8 install, or whether the retail product key would overwrite the OEM key.