GPG4Win can be buggy and a lot of people have problems with it. A lot of us who spend time in the Security forum highly recommend GPG4USB. There's a tutorial on how to use it linked in my signature.