The 4th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia
Conference 12-15 December • Exhibition 13-15 December • Hong Kong Convention & Exhibition Centre
| In this project, the goal was to integrate Microsoft Kinect with Augmented Reality in order to create an experience where virtual content interacts with real objects in a realistic manner.
As a case study, a racing game was created which allows users to drive a virtual car around a real desk. The Kinect extracts three dimensional information about the environment in real time, while the user watches the action in augmented reality.
With an integrated physics engine, the virtual car interacts with real objects in a realistic way, allowing the user to drive up ramps, jump over valleys, and crash into walls.
Additionally, three dimensional information is used to create true occlusion between real and virtual objects, and cast realistic shadows of the virtual content onto real objects.
We believe that environmental awareness is important for realistic and engaging augmented reality experiences. As the Kinect is an inexpensive and widely available sensor, it is the perfect device for achieving environmental awareness. We expect that in future more developers will utilize the Kinect with their augmented reality applications to enhance the user experience.
Thammathip Piumsomboon, Human Interface Technology Laboratory New Zealand