Given what everyone else says about disabling thumbs.db etc, I think I figured out what the issue is, for folders anyway, and at least one other thing that could set it off if I'm right.
Windows 7 (and I presume 8 as well) has a nifty feature whereby it shows a preview of folder contents on the icon when set to any of the following view options: Extra Large, Large, or medium icons, tiles, or content. It also shows the 'large icons' version
in the details pane at the bottom of the window when you click on a folder. For images, videos, or audio files with album art, it shows a thumbnail of said for the content preview. There's also some method by which it'll represent subfolders with an image.
For files with preview thumbnails, (IE: Images, videos, or audio files with album art), on the same view settings where folders show a preview of contents, the file will be represented with a thumbnail preview instead of a file icon. The 'preview pane' will
also show an expanded version of the preview thumbnail when the file is clicked on.
It is my belief that what is generally happening for most people, is that in order for these preview options to work, explorer has to briefly load the file in question to retrieve/generate the thumbnail, thus putting said file 'in use'. It's not real spectacular
about unlocking it after it's loaded it, but seems to have some kind of cache so it doesn't have to re-load it if you come back later. (Maybe getting it out of the thumbs.db file? No idea.) Because what I've noticed is that closing the window, or changing
it to a different view and then going back to the current one (even so much as hitting back and then forward again) will usually unlock it.
I have also found, however, that changing the view type to one of the 'small icons' types (Small Icons, Details, or List) as well as disabling the details AND preview panes seems to prevent it getting locked in the first place, presumably because that disables
all the different 'content previews'.