SIGGRAPH 2004 - The 31st international conference on computer graphics and interactive techniques
Conferenece Exhibition Call For Participation Presenters Media Registration spacer

Interacting With Projections Using
iLamp Projectors

Projectors are becoming very compact, and this is driving an evolution in their functionality. This project demonstrates a handheld projector that enables straightforward, one-handed interaction with projected content. It envisages current handheld devices such as cellphones and PDAs augmented with projectors that supplement or even replace built-in screens with larger projected displays. Interacting with a projection offers a new medium for WIMP functionality. The project goes further still in showing how handheld projection supports a quite new type of interaction for multiple users, who can share a pooled display in which individual projections are intelligently combined.

Life Enhancement
Information display is such a prevalent part of everyday life that new ways to present data can have significant impact. The possibilities for making innovative displays with projectors are fairly unexplored, largely because a projector has traditionally been a heavy, power-hungry box. That is not the case anymore. Cutting-edge devices like tiny projector-keyboards are already showing the possibilities as projectors shrink in size. This work demonstrates how a projector can be a handheld device, and how our everyday surroundings can be transformed into both a display surface and a medium for interaction with the projected data.

The goal of the project is to change perceptions aboutprojectors. The prototype device makes it possible to visualize personal, handheld projectors for use in the near future. Add a method for interaction with the projected data, and this becomes an innovative addition to the existing array of handhelds. Projection does have limitations because of interference with ambient light and the unsuitability of some display surfaces. Furthermore, this prototype enables only mouse-style interaction, not text-entry. But interactive projection still opens up a range of possibilities in a little-explored area of the human-computer interface.

Stabilized Projection
An immediate requirement for a handheld projector is to stabilize the projection on the display surface, therefore removing the effect of hand-motion. This handheld device includes a camera that determines the position of the projector relative to the surface, enabling continual modification of the projected data, so that it appears static on the surface even though the projector itself is moving. The position recovery is supported by an inertial sensor and laser pens on the device.

Interactive Projection
The core innovation is a technique for tracking an independently moving cursor across a stabilized projection with single-handed motion. A touch-pad or thumb wheels on the projector could move the cursor across the projection, but this would increase device size, and it would be a clumsy interaction that might require two hands. This project shows how to track a cursor across the stabilized projection by a natural one-handed pointing motion of the projector.

The handheld projector includes a projector, a camera, an inertial sensor (gyro/accelerometer board), and four laser pens. The device also has click buttons for user interactions. All components are commodity items, but a projector augmented with this range of components is currently an unusual and novel device.

Wednesday, 11 August
8:30 - 10:15 am
Room 404AB

Paul Beardsley
Mitsubishi Electric Research Laboratories (MERL)

Shane Booth
Clifton Forlines
Ramesh Raskar
Jeroen Van Baar
Chris Wren
Mitsubishi Electric Research Laboratories (MERL)

emerging technologies jury and committee
 > share the SIGGRAPH 2004 web site
Conference 8-12 August, Exhibition 10-12 August.  In Los Angeles, CA