yes; I added a 2nd picture & use that one now but I don't know how to delete the 1st (old) picture.
See if you can change that picture this way...
Sign out of your account and sign in to the administrator account.
Start > Settings > Accounts > Your info > Create your picture > either create a picture or browse for one. Once you select another picture it should replace the current account picture.
Don