The 4th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia
Conference 12-15 December • Exhibition 13-15 December • Hong Kong Convention & Exhibition Centre

Emerging Technologies

Grab-Carry-Release: Manipulating Physical Objects in a Real Scene through a Smart Phone

This work presents a novel mobile AR method, capable of allowing users to manipulate physical objects in a real scene through their smart phones. The proposed method is prototyped by integrating a smart phone with a state-of-the-art depth camera. Additionally, the interaction design space is explored by implementing three possible scenarios, i.e. general individual use scenario, collocated mobile AR collaboration scenario and remote sharing scenario. Although the computational capability of current smart phones and the size of the depth camera means the proposed interaction is not readily available for normal users, the proposed method is still highly promising for continuously advancing mobile phone technologies. Importantly, the proposed interactive method expands the scope of conventional AR applications in bringing benefits of AR to daily work tasks that require a spatial context.

Kai-Yin Cheng, National Taiwan University
Yu-Hsiang Lin, National Taiwan University
Yu-Hsin Lin, National Taiwan University
Bing-Yu Chen, National Taiwan University
Takeo Igarashi, The University of Tokyo and Japan Science and Technology Agency