Indoor environments for VR

Virtual Reality is maturing both in its hardware and as a medium to channel content to consumers. As such there is a plethora of virtual ancient temples and timeworn tombs available for the masses. This procedure is more commonly referred to as Cultural Heritage Preservation. However, as much as I’d like to go off into a mosquito-riddled jungle to find a lost civilization or fly over arid deserts to find buried temples, I am just as happy toiling in local endeavors (not really though ;-p).

Recently I was fortunate enough to be part of several such ventures. The most recent one as of this writing was the Oculus Quest Content Preview. For this I was tasked with constructing photogrammetry scans of several family rooms. I wouldn’t ordinarily recommend using this technique by itself as it doesn’t work well with plain surfaces like walls and ceilings. Preferably such data is incorporated in at least a few LIDAR scans as those tend to work very well indoors. A second challenge was that I could only work with the available room light, meaning it required the use of a tripod and long exposure times. Bracketed exposures would most certainly have improved the final result but that would have taken much, much longer.

Another very exciting project was that of the Kerry James Marshall’s Mastry Exhibition at MOCA here in Los Angeles. This was a once-in-a-lifetime assembly of privately owned African American paintings. To preserve this unique experience it was decided to scan the entire exhibit including the space itself. While one team was capturing LIDAR data it was my role to take photographs of the paintings to be combined with the LIDAR later. More importantly, once all the geometry was generated in RealityCapture I had to retopologize the entire exhibit for the VR experience. You can see the result (before color data was applied) in the images.

A very similar project was that of a Marriott hotel lobby, to be turned into a VR demo. It was quite the challenge to remodel everything within a week, as it included a Starbucks Coffee Shop and much of the parking lot and fountains outside. You can see the result of my work in one of the videos. As with the previous project it wasn’t my task to generate any color so black and white will have to do.