You can do it. In fact, the default mode of command line gpg is to create binary encrypted data, which lets you encrypt any kind of file, including binary files (Word documents, sound and video files). I don't think you can do it in a GUI, since they assume you want ASCII armored text, but there might be an option for that in some GUIs.