You can use the PGP program that Tails provides, but GPG4USB should work too, because Tails is 32 bit. The only restriction is that GPG4USB doesn't work on 64 bit Linux unless you install a lot of stuff. But it should work out of the box with Tails, just save it in the persistent volume.