Making Software Tutorial Video Responsive
Cuong Nguyen and Feng Liu
Computer Science Department, Portland State University
Abstract

Tutorial videos are widely available to help people use software. These videos, however, are viewed by users as captured and offer little direct interaction between users and software. This paper presents a video navigation method that allows users to interact with software tutorial video as if they were using the software. To make the tutorial video responsive, our method records the user interaction events like mouse click and drag during capturing the video. Our method then analyzes, selects, and visualizes these user interaction events at the event locations. When a user directly interacts with an event visualization, our method automatically navigates to the proper video frame to provide the visual feedback as if the software were responding to the user input. Thus, our method provides the experience of interacting with the software through directly manipulating the tutorial video. Our study shows our method can better help users follow tutorial videos to complete tasks than the baseline timeline interface.

Paper
Cuong Nguyen and Feng Liu. Making Software Tutorial Video Responsive
ACM CHI 2015. PDF  (Best Paper Honorable Mention Award)

Related project


Cuong Nguyen and Feng Liu. Gaze-based Notetaking for Learning from Lecture Videos
ACM CHI 2016. PDF

Cuong Nguyen, Wu-chi Feng, and Feng Liu. Hotspot: Making Computer Vision More Effective for Human Video Surveillance
Information Visualization, 2016. PDF  

Cuong Nguyen, Yuzhen Niu, and Feng Liu. Direct Manipulation Video Navigation on Touch Screens
ACM MobileHCI 2014. PDF  

Cuong Nguyen, Yuzhen Niu, and Feng Liu. Direct Manipulation Video Navigation in 3D
ACM CHI 2013. PDF  (Best Paper Honorable Mention Award)

Cuong Nguyen, Yuzhen Niu, and Feng Liu. Video Summagator: An Interface for Video Summarization and Navigation
ACM CHI 2012. PDF  
Demo Video 
Search engine friendly content
Acknowledgment
This demo uses cat images from Pixabay user wilkernet and DevianArt user Oliver Pietern under a Creative Commons license. This video was narrated by Allison Mulcrone. This work was supported by NSF IIS-1321119, CNS-1205746 and CNS-1218589.