The 38th International Conference And Exhibition on Computer Graphics and Interactive Techniques

A Medical Mirror for Non-Contact Health Monitoring

West Building, Ballroom B

Digital medical devices promise to transform the future of medicine with their ability to produce exquisitely detailed individual physiological data. As ordinary people gain access to and control over their own physiological data, they can play a more active role in diagnosis and management of their health. This revolution must take place in our everyday lives, not just in the doctor’s office or research lab. This project starts in the home environment by transforming everyday objects into health-sensing technology.

The Medical Mirror is a novel interactive interface that tracks and displays a user’s heart rate in real time without the need for external sensors. Currently, collection of physiological information requires users to strap on bulky sensors, chest straps, or sticky electrodes. The Medical Mirror allows contact-free measurements of physiological information using a basic imaging device. When a user looks into the mirror, an image sensor detects and tracks the location of his or her face over time. By combining techniques in computer vision and advanced signal processing, the user’s heart rate is then computed from the optical signal reflected off the face. The user’s heart rate is displayed on the mirror, allowing visualization of both the user’s physical appearance and physiological state.

This project illustrates an innovative approach to pervasive health monitoring based on state-of-the-art technology. The Medical Mirror fits seamlessly into the ambient home environment, blending the data collection process into the course of daily routines. It is intended to provide a convenient way for people to track their daily health when they use the mirror for shaving, brushing teeth, etc.

Ming-Zher Poh
Harvard-MIT Division of Health Sciences and Technology

Daniel McDuff
MIT Media Lab

Rosalind Picard
MIT Media Lab