You can definitely put Tor Browser Bundle on a USB and run it from there ... or even maybe encrypt the USB first and put TBB into a hidden volume (using TrueCrypt). Or, you can use Tails .... but you'd be better off using it as a LiveCD/DVD setup simply because getting it to boot from a USB with Tails on it has proven pretty damn difficult.