Augmenting Reality with 3D Sound Sources

The sound component is still missing in current AR applications, which combine live video and computer graphics to produce real-time visual effects. AR could be a solution for many problems in sound delivery.

Augmented Sound Reality allows the user to place and move different sound sources in the real world. With AR technology, the user is equipped with see-through displays and a simple pen input device to place 3D sound sources in the real world. The different sound sources are represented by 3D objects on the head-mounted display. 3D sound can be directly integrated and tested in this AR environment. The user can directly manipulate the 3D sound sources and observe the results immediately. Another advantage of ASR is low cost. This system requires only a PC, a Web cam, and i-glasses.

3D virtual sound sources for virtual and augmented realities.

Current AR applications do not allow direct manipulation of sound sources. ASR is the first prototype that combines sound and graphics in an AR environment and offers a wide spectrum for further applications. Especially in the authoring process for AR applications, it becomes difficult to place the sound sources using traditional 2D/3D authoring tools. Now, authors can place 3D sound sources in real 3D space, and they have a more intuitive experience of how the audio really sounds. In another application of this technology, the user can place virtual furniture in a room. This application will be combined with ASR, so that the user doesn't see the newly established room, but can hear how the radio or DVD player sounds.

Michael Haller
Fachhochschule Hagenberg (Medientechnik und -Design)
A-4232 Hagenberg, AUSTRIA

Daniel Dobler
Philipp Stampfl
Fachhochschule Hagenberg (Medientechnik und -Design)

Illustrated summaries of SIGGRAPH 2002 Emerging Technologies projects are available in the SIGGRAPH 2002 Conference Abstracts and Applications

Back To Main Page
conference exhibition Call for Participation Presenters Media Registration Search SIGGRAPH 2002 Homepage