This should not be possible if you are being safe. You shouldn't be using your real return address, and people don't just "guess" at a phone number successfully unless they have clues pointing them to it. It is slightly concerning because somehow you provided info enough either here or privately to the buyer that allowed his mother to track you down. Again, this really shouldn't be happening if you're taking your security seriously.