An Interactive Multi-User Holographic Environment

An interactive, multi-user holographic environment that allows naked-eye participants to share a large 3D scene with fully continuous, observer-independent parallax.

Enhanced Life
This holographic display is a unique combination of optimized optical design, commodity hardware technology, and parallel graphic technology packaged in a system that can be directly driven by a stream of graphic commands.

The prototype's overall 50 megapixels originate from the resolution of 64 XGA (1024x768) commodity projectors. The projectors are densely arranged behind the holographic screen, and all of them project their specific images onto the holographic screen to assemble the 3D scene. The display reconstructs the light field of 3D scenes instead of views. This distributed image organization makes it different from other known multiview solutions. The optical modules are not associated with specific view directions. A module image is not a 2D view of the final image. Instead, the light beams emitted by the projection modules (the module images that are generated by the projectors) are determined by geometry. Each view of the 3D image is always contributed by many modules, so no sharp boundary appears between views, and the display offers continuous and smooth change at different image areas. It provides a truly 3D experience.

The system includes a markerless, vision-based hand tracking system, so participants can intuitively use one- and two-handed gestures to determine pose, scaling, and selection of subparts of the rendered scene, and exploit powerful natural 3D interaction metaphors from everyday life (such as grabbing objects to move them).

Goal
To show a working example of a large-scale display that allows natural and naked-eye, multiple-user interaction with virtual three-dimensional objects.

Innovation
This is the first practical demonstration of a hardware and software system capable of showing accurate interactive three-dimensional images with full, observer-independent, continuous parallax within a large workspace.

Vision
This project is clearly a significant step forward in display technology, and it paves the way to novel approaches to complex cooperative tasks, such as designing intricate manufactured objects or understanding complex simulation results. This technology will also have interesting applications in many other domains, including entertainment, art, and cultural heritage (for example, museum exhibits). Future 3D display technologies that exceed current 2D technologies by 100x-1,000x are no longer a futuristic dream.

This project is partially supported by th European Union FP6/IST at COHERENT.

Contact
Tibor Balogh
Holografika
t.balogh (at) holografika.com

Contributors
Eric Bouvier
C/S France

Enrico Gobbetti
Center for Advanced Studies, Research and Development in Sardinia

Reinhard Klein
Universität Bonn