Full-Scale Saccade-Based Display: Public/Private Image Presentation Based on Gaze-Contingent Visual Illusion

A dramatically improved saccade-based display that can present life-size, full-color photographic images and 2D displays based on eye-movement tracking without a screen, even in mid-air, with only a single line of LEDs.

Enhanced Life

In an augmented-reality visual display, this method can superimpose various types of information onto real environments, which enables interesting applications in art, entertainment, and low-cost image display for commercial advertising. For example, a light column could display information in midair between two buildings. The system can also be used to produce visual effects in live performances, so audiences can perceive different 2D images based on eye movements.

Goals

To construct a novel system in which eye movement influences image display.

Innovations

Widely used micro-processors can not support the high-speed sequence control required for detecting the temporal dynamics of saccadic eye movement (its duration is only 50 ms). This system uses an optimized FPGA (field-programmable gate array) circuit and a large LED array (2.0 meters in height) to present life-size, full-color images.

Two-dimensional images can be perceived only when the timing of the saccade coincides with the flash timing of the light source. This system overcomes this drawback by inducing viewers' eye movement for presentation of public information and by measuring viewers' eye movement for private presentation. For public presentation, the eye movements are induced in the reflection with visual, auditory, or tactile stimulus, and the system presents 2D images to many viewers simultaneously. For private presentation, the saccade is measured with an electro-ocular graph-based sensor in real time, and the saccade-based display is activated at the same time the saccade begins. When saccade detection accuracy is high, the observer clearly perceives 2D information.

Using this measurement method, the system selectively presents different images to each viewer using only one light array, and the system can handle highly confidential information. Because it synchronizes the display with induced or tracked saccades, it represents a vast improvement in saccade-based display technology.

Vision

Pursuing new display techniques based on knowledge of human visual perception can open up new possibilities for designing visual display devices.

Contact

Hideyuki Ando
NTT Communication Science Laboratories
hide (at) avg.brl.ntt.co.jp

Contributors

Junji Watanabe
PRESTO Japan Science and Technology Agency
NTT Communication Science Laboratories

Tomohiro Amemiya
NTT Communication Science Laboratories

Taro Maeda
Osaka University