I really want to build a VR-based GUI for a Very Serious Program I'm writing in my free time. It's not a game.

So whether there are or aren't, there's clearly potential. It doesn't seem right to dismiss it just because it hasn't taken off yet - it's extremely early days.