I had the same issue and to fix it I went into the settings of the One Drive app and disabled (untick) the Files On Demand service then hit OK. Then after a restart of the PC all thumbnails within my One Drive folders had returned.
No I idea why this works but it did for me and hopefully will do for you also.