Towards Computational Models of Multitasking Performance with Multimodal Auditory and Visual Displays

Anthony Hornof

University of Oregon

14th January 2008, 10:00–11:30
Dean's Conference Room, 5th Floor, Engineering Building

ABSTRACT

This talk will present work in progress at the Cognitive Modeling and Eye Tracking Lab in the University of Oregon Department of Computer and Information Science. The goal of the project is to advance an understanding of (a) human performance when a person is engaged in multitasking behavior that requires interaction with complex multimodal auditory and visual displays and (b) how to simulate and ultimately predict human performance in such situations by means of computational cognitive modeling, ultimately to inform the design of complex multimodal computer interfaces. Progress-to-date includes that we have determined how to transform visual information on a radar-like display into 3D spatialized audio such that a person can determine the relative location of blips on the screen based on the location of the sound. The two primary next steps, both in progress, are to (a) build cognitive models to explore how this auditory display could be used to help a person monitor that radar screen while engaged with another primary visual task and (b) collect human data, including eye movements, to validate and improve these predictive models.

BIOGRAPHY
Dr. Anthony J. Hornof is an Associate Professor in the Department of Computer and Information Science at the University of Oregon. He joined the faculty in 1999 and was promoted with tenure in 2005. Dr. Hornof earned his Ph.D. in 1999 and his Master's degree in 1996, both from the University of Michigan, and both in Computer Science and Engineering. He received a B.A. in Computer Science from Columbia University in 1988. After college, he remained in New York City for five years (1988-1993) where he worked as an information technology specialist for Deloitte and Touche, and also part-time as a deejay at nightclubs such as Save the Robots and M.K. He also pursued mixed-media painting during these years, and his work was featured in group shows in New York City. In 1993, he redirected his creative and intellectual energies towards a career in academia, where he now integrates his interests in computing, human factors, and creative expression. Dr. Hornof is published in the leading human-computer interaction conference and journals, and has been awarded over $1.75 million in single-investigator research grants, including multiple awards from the National Science Foundation and the Office of Naval Research.

HOST
Wu-chi Feng