You encrypt messages with the public key of the person you send them to. I could encrypt a message for you to decrypt with your private key by using your public key, but I will not be able to decrypt a message encrypted with your public key without your private key.