You should be able to restart explorer through task manager instead of ending the process (Still kills it like end task but starts it back up afterwards).
Also, if you do instead close explorer, you can open task manager again (ctrl + shift + esc), click File > Run new task and then type explorer in the run box that pops up.
Both of these methods will bring back explorer (including the taskbar) without you having to restart the whole machine.