The 4th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia
Conference 12-15 December • Exhibition 13-15 December • Hong Kong Convention & Exhibition Centre
| In this project, users are able to generate their own Augmented Reality experience. The system enables them to create three dimensional environments and models by simply decorating pages from a coloring book, and then viewing them in Augmented Reality.
A novel computer vision algorithm was developed to remove the color information from pages, to allow the page to be identified despite user modifications from the original image. Once the page has been recognized, a natural feature base registration algorithm is used to calculate the pose of the page. With the pose calculated, any modifications of the page by the user are identified and extracted.
The user modifications are used in two ways: first, to create a "pop-up" style scene, where sections of the image literally lift off the page, and second, to automatically texture three dimensional models with the user’s color choice. The result is a pop-up book, where all the content has been enhanced by the user in a completely natural and intuitive way.
For this project the techniques described were applied to an educational coloring book designed to teach children about New Zealand wildlife. In the future we plan to use the same principles to allow artists with limited computer aided design skills create their own three dimensional content, and explore automatic model generation techniques which enable the creation of complete three dimensional content without the need for any programming or advanced 3D modelling skills.
Andreas Dünser, Human Interface Technology Laboratory New Zealand