Set the VM's up on encrypted media like an SD card, if need be you can destroy that very quickly leaving nothing on your computer apart from virtualbox, you might be able to host that on a USB, SD card too.