The 38th International Conference And Exhibition on Computer Graphics and Interactive Techniques

Recompose: Direct and Gestural Interaction With an Actuated Surface

West Building, Ballroom B

Recompose builds on the Relief table developed by Leithinger. The table consists of an array of 120 individually addressable pins, whose height can be actuated and read back simultaneously to provide both input and output. Recompose extends this concept by placing a depth camera above the tabletop surface to detect basic user gestures.

The combination of direct manipulation, I/O coincidence, an instantaneous feedback loop, and gestural input is a largely unexplored research area. Recompose explores this area through a system that leverages the strengths of these interaction techniques. It uses a grammar of gestures to explore basic functions for interacting with an actuated surface. Initial explorations show that the most fundamental set of gestures includes: selection of a subset of the surface, translation of the selection, rotation of the selection, and scaling of the selection.

Recompose moves digital modeling into the physical space by adding intuitive hands-on design. This approach may contribute significantly to fields where rapid iteration and visualization are fundamental to the process of learning and creation, including (but not limited to) architectural design, three-dimensional product design, and medical imaging.

David Lakatos
MIT Media Lab

Matthew Blackshaw
MIT Media Lab

Anthony DeVincenzi
MIT Media Lab

Daniel Leithinger
MIT Media Lab

Ishii Hiroshi
MIT Media Lab