Courses
 
  Course Numbers
1       2       3      
4       5       6      
7       8       9      
10     11     12
13     14     15
16     17     18
19     20     21
22     23     24
25     26     27
28     29     30
31     32     33
34     35     36
37     38     39
40     41     42
43     44     45
 
     
5. Design of Interactive Multimodal Media Systems
Sunday, Half Day, 1:45 - 5:30 pm
Room 16 A-B
Level: Intermediate

How traditional HCI methodologies augmented with theories and experimental findings from cognitive science address challenges posed by multimodal interaction using vision, haptics, and sound in conventional and immersive computer graphics and visualization environments.

Prerequisites
This course is intended for attendees involved in design of interactive media and applications for emerging computer-display technologies. Attendees should be familiar with the basics of computer graphics and interactive media, but do not need any particular technical background.

Topics
The theory and practice of multimodal interaction design in a multidisciplinary setting. The cognitive science of sensory processing (vision, hearing, haptics) in scene understanding and interaction, including attention, change blindness, haptics, ventriloquism, and space constancy. Enhanced iterative design for integration of visual display design, haptic devices, and sonified and integrated visual/auditory environments including virtual environments, visualization systems, and community and performance spaces.

Organizer
Brian Fisher
The University of British Columbia

Lecturers
Sidney Fels
Brian Fisher
Karon Maclean
Tamara Munzner
Ronald Rensink
The University of British Columbia

Schedule

1:45 Welcome and Course Overview
Fisher
2:00 Attentional & Nonattentional Processes in Vision
Rensink
2:50 Application to Information Visualization I
Visual Encoding
Space and Dimensionality
Muzner
3:15 Break
3:55 Intersensory Interactions
Integrating Cogsci Theory With Design
Information Integration Models
Dynamics of Multimodal Processing
Multimodal Events and Attentional Limitations
Sensory Fusion: Vision, Hearing, Haptics
Fisher
4:40 Application to Virtual Environments & Exotic Interfaces
Communicating Human Experience
Information Processing: Neuromuscular, Movable, Verbal
Muscle, Other Displays: Biopotentials
Virtual Environments Intimacy and Embodiment: Automatic Behavior
Fels



   presentations

   experiences    services
   > COURSES    > ACADEMIC EXHIBITS    > BIRDS OF A FEATHER  
   > EDUCATORS    > ART GALLERY    > GET INVOLVED  
      PROGRAM    > COMPUTER    > GRAPHICSNET  
   > EXHIBITOR TECH
      ANIMATION FESTIVAL    > INTERNATIONAL  
      TALKS    > EMERGING       RESOURCES  
   > INTRO TO
      TECHNOLOGIES    > PATHFINDERS  
      COMPUTER GRAPHICS    > sigKIDS      
   > KEYNOTE ADDRESS /
   > GUERILLA STUDIO      
      AWARDS          
   > PAPERS          
   > SKETCHES &          
      APPLICATIONS          
   > SPECIAL SESSIONS          
   > WEB GRAPHICS