Siggraph 2005 logo
Conference Exhibition Call For Participation Presenters Media Registration

emerging technologies

MotionSPHERE



This image-processing technology stabilizes the trembling in images captured with a rotating camera in real time, and because of its "sphere" characteristics, it can track objects no matter how fast or where they are moving.

Art and Science


MotionSPHERE is a real-time, multi-camera image-processing technology that can record and display scenes that were impossible to capture before: spinning balls, swinging bats, trembling vehicles, etc.

Goal


Currently, stabilization and object tracking work fine separately, but they don't work together. The goal of this project is to combine them in real time, interactively.

Innovation


MotionSPHERE's main innovation is a very fast, robust algorithm that processes multi-camera images in real time. To stabilize the entire image, optical flow is obtained at more than a hundred locations, and the rotation parameters are estimated based on the minimum-square-error method. Object tracking is achieved by combining background extraction and color extraction. The static part of the sphere image is filtered out with background extraction to dramatically decrease processing requirements and realize real-time interaction.

Vision


In the future, digital cameras will be smaller, smarter, and more ubiquitous. For example, cameras will be embedded in basketballs, and spectators will see the game from the ball's viewpoint. Because the ball and the camera are spinning, MotionSPHERE's technologies will be necessary so spectators can see a steady image from inside the spinning ball.

Eventually, cameras will be embedded in many other previously impossible places. The result will be a new kind of visualization, entertainment, and artistic imagery.

Contact


Hiroki Mori
ViewPLUS Inc.
mori (at) viewplus.co.jp

Contributors


Dairoku Sekiguchi
University of Tokyo

Masahiko Inami
Fumitoshi Matsuno
Ryu Miyauchi
Hideaki Nii
Maki Sugimoto
University of Electro-Communications

Shigesumi Kuwashima
ViewPLUS Inc.
acm.org siggraph.org