If you want a reasonably secure OS you should run everything in a VM. However you can do GPU pass-through (if you have two GPUs): one, two.