Actually, you might be able to do it without deleting your email account on your computer. The hardest part is actually getting to the key itself.
All you really need to do is open the email account’s settings within the Mail app & change the password to the created one. :)