There's one major problem here: in order for this to actually work, they have to know who's causing it. Otherwise they don't know what actions they're supposed to stop, but if they know that, they're free to up the ante back... and so you end up in a vicious cycle until both of your lives are ruined, the problem goes away on its own, or you convince them that you're so dangerous they're better off getting away from you at all costs. The problem there is that they're just as likely to go to the police out of fear as they are to leave you alone out of fear. It has to be made very undesirable for them to do anything but flee, and that's a tricky thing to do.
By harming them, you're risking your own well being. By leaving them alone completely, you're sacrificing your own well being. Really the best solution is to find another way. Work it out with them. Bribe them. Seduce them. Anything that accomplishes your goal will work.
It's amazing what one can accomplish when one sets aside pride and focuses on a goal. You seem to have forgotten to do that; if the goal is to be rid of them, you'd be best served by giving up your sense of pride. If the goal is to be satisfied, well... I doubt you can be satisfied anonymously.
