Hi!
I had the same problem, Windows10UpgraderApp.exe always kept coming back, if I terminated it's process it started again after 10 minutes or so. Then the updates failed to install, and all this repeated forever. The working solution comes in a batch file!
Create a new file anywhere, name it anti_update_cycle.cmd
Paste this script into your file:
:st
taskkill -f -im Windows10UpgraderApp.exe
timeout 1
del c:\Windows10Upgrade\Windows10UpgraderApp.exe
timeout 5
goto st
You have to run this command line script to get rid of the annoying Win10 upgrader. It closes the updater application and deletes it's executable. It will keep coming back but will be closed in seconds, before appearing on screen. You should put this script file into your Startup folder and set it's shortcut to always start it minimized. (use google for these steps)
Goodbye!