Rabbit Run: Gaze and Voice Based Game Interaction

Abstract

Modern eye tracking technology allows an observer?s gaze to be determined in realtime by measuring their eye movements. Recent studies have examined the viability of using gaze data as a means of controlling computer games. This paper investigates the combination of gaze and voice recognition as a means of hands-free interaction in 3D virtual environments. A novel game evaluation framework is implemented controllable by input from gaze and voice as well as mouse and keyboard. This framework is evaluated both using quantitative measures and subjective responses from participant user trials. This is the first evaluation study performed comparing gaze and voice against mouse and keyboard input. The main result indicates that, although game performance was significantly worse, participants reported a higher level of immersion when playing using gaze and voice.