I was totally incorrect about this -- it turns out you CAN change the email you registered with your PGP key. Here is what another member, Nightcrawler, told me: