They must have provided you with a bad PGP message, possibly encrypted to the wrong person. Resend them your PGP key and ask them to encrypt you a new message.