Windows installer doesn't work?

So I'm having a bit of a weird issue. I've installed windows 10 on a few computers before and have never run into this until now. I recently bought an ssd to boot my OS from, but running the install media usb doesn't seem to work right. I only used windows 10's install media tool. I should also mention I only have a keyboard, mouse, monitor and the install usb plugged in.

I created the usb (twice now), then shut my pc off, removed the existing hdd, then plugged in the ssd and the usb with the install tool on it. I boot into setup, make sure the drive is all unallocated space, and then hit new. I let it create the necessary partitions and then click next. I've also tried just clicking next with a totally blank ssd.

The setup tool runs normally, prompts a restart which is when I remove the install usb, if I don't remove the usb then it loops back to the installer again. When I remove the usb and then restart though, my pc prompts me to insert boot media into the drive and press any key. It doesnt seem to actually install the necessary files to download and install windows 10. No matter what I do, after the install media tool finishes and causes a restart I cannot continue with the installation. 

Any help would be greatly appreciated. I know it isn't a problem with another component because plugging in the original hard drive works fine. I've also plugged both drives in and scanned for errors on the ssd to no avail. I checked and there are files being installed on the ssd. It seems to work normally otherwise so I dont think it's a bad drive either.