The Tor Project estimates 500,000 daily Tor users. Based on TBB downloads, I estimate 3-5 million monthly users. Many people use Tor for many reasons, certainly enough to give any random Tor user plausible deniability. I see no reason to be paranoid about using Tor unless you are a big time vendor, in which case LE could launch a correlation attack based on your online activity. If you are a big time vendor, you should be using bridges or VPNs, otherwise, I think it's overkill.