If you encrypt a message with your public key, then only your private key can decrypt it. You would have to encrypt the message with MY public key in order for me to read it.