USC

Category: 3D

Apple iPhone + Hasbro my3D = Inexpensive Virtual Reality

Last time, I wrote about our poster at the IEEE Virtual Conference on an inexpensive head mounted display that used two iPhones and a set of LEEP optics. We haven’t stopped working on commodity virtual reality. We have a new poster that was accepted to the VR Conference which talks about using Hasbro’s 3D stereoscopic add-on for the iPhone and iPod Touch and the Unity game engine to create immersive games for training.

We worked with Professor Perry Hoberman from the USC School of Cinematic Arts who created two demonstration apps. Both of these apps use head orientation, measured by the iPod Touch accelerometers and gyros, and Bluetooth keyboard presses for navigation and interaction. The first is a memory game which first drives you through a desert village. On your second trip through the village, you navigate yourself, marking any objects or structures that you think have changed. This game is an immersive version of  Kim’s Game, which trains skills in observation and situational awareness.

The second app presents users with a 360 degree 3D stereoscopic photo panorama. I like this app a lot. A pair of cameras with fisheye lenses are used to take four pairs of photographs. A bit of processing is applied to compensate for some of the fisheye lens distortions. Users can turn their heads or rotate in place to see any part of the 3D panorama.

Draft Abstract
Draft Poster

Smartphone-Based HMD at IEEE VR 2011

I’m traveling to the IEEE Virtual Reality Conference in Singapore this weekend. I’m presenting a poster describing our prototype head mounted display which uses two smartphones as displays and 3D rendering engines.

The cool thing about this prototype is that it is completely wireless. The phones do all the rendering. We use a Phasespace Impulse motion capture system for head tracking, but all that head tracking data is transmitted to the phones over WiFi.

We have a number of other posters and talks at IEEE VR from our lab. We have a presentation on redirected walking, our software toolkit FAAST which lets you control any application using the Microsoft Kinect, and a poster that shows how the Kinect can put real people into virtual reality scenes.

Draft Abstract
Draft Poster

More on those projects in future posts.