VR Mode on the Nvidia Jetson

It’s my pleasure to announce that VR mode works on the Nvidia Jetson AGX Xavier.

For those interested in the technical reasons this comes so late, I’ll explain briefly. I have been focused on getting Direct Mode, where headset rendering bypasses the desktop window manager, on the Jetson working. This document explains why this is difficult to do on the Jetson’s chip. However, a recent test on the Jetson led me to realize that Extended Mode, where the headset is treated as a regular desktop monitor and rendering is done using a fullscreen window, was an option with the Monado VR runtime engine. I don’t consider the work on Direct Mode for the Jetson time wasted, but perhaps time spent too early for a simple proof of concept.

Remaining Tasks

Not everything is perfect on the Jetson, however. There a few new user interface bugs that exclusively appear on the Jetson. These will need fixing.

The tethered hand tracking works just fine on the Jetson. I still need to make sure the augmented reality video passthrough works too. I foresee no software obstacles to getting that working, but that doesn’t mean there aren’t any.

Finally, I’d like to put together a prototype hardware kit to really show the viability of Kros as a portable platform. This includes running everything off a single battery and perhaps purchasing a Windows mini-PC to serve as the hand tracking server.


Thanks for reading, and if you haven’t already, subscribe to the blog.

2 thoughts on “VR Mode on the Nvidia Jetson

    1. I actually ended up using a Beelink computer, but a single-board computer would have made a lot of sense in retrospect.

      If you’re planning to use such a computer for Leap Motion yourself, be aware that Leap Motion lists “Intel® Core™ i3 processor 5th Gen (must support AVX instructions)” as a minimum requirement. While some of the ones you mentioned meet that requirement, many computers I found during my original search did not.

      Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: