Classifying Head Movements to Separate Head-Gaze and Head Gestures as Distinct Modes of Input

Baosheng James Hou, Joshua Newn, Ludwig Sidenmark, Anam Ahmad Khan, Per Bækgaard, and Hans Gellersen

CHI '23: CHI Conference on Human Factors in Computing Systems

Head movement is widely used as a uniform type of input for human-computer interaction. However, there are fundamental differences between head movements coupled with gaze in support of our visual system, and head movements performed as gestural expression. Both Head-Gaze and Head Gestures are of utility for interaction but differ in their affordances. To facilitate the treatment of Head-Gaze and Head Gestures as separate types of input, we developed HeadBoost as a novel classifier, achieving high accuracy in classifying gaze-driven versus gestural head movement (F1-Score: 0.89). We demonstrate the utility of the classifier with three applications: gestural input while avoiding unintentional input by Head-Gaze; target selection with Head-Gaze while avoiding Midas Touch by head gestures; and switching of cursor control between Head-Gaze for fast positioning and Head Gesture for refinement. The classification of Head-Gaze and Head Gesture allows for seamless head-based interaction while avoiding false activation.

Baosheng James Hou, Joshua Newn, Ludwig Sidenmark, Anam Ahmad Khan, Per Bækgaard, and Hans Gellersen. 2023. Classifying Head Movements to Separate Head-Gaze and Head Gestures as Distinct Modes of Input. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 23–28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 14 pages.

 

BibTex

@inproceedings{10.1145/3544548.3581201, 
	author= {Baosheng James Hou and Joshua Newn and Ludwig Sidenmark and Anam Ahmad Khan and Per Bækgaard and Hans Gellersen}, 
	title= {Classifying Head Movements to Separate Head-Gaze and Head Gestures as Distinct Modes of Input},  
	year = {2023}, 
	publisher = {Association for Computing Machinery}, 
	address = {New York, NY, USA}, 
	booktitle = {Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems}, 
	location = {Hamburg, Germany}, 
	series = {CHI '23}, 
	numpages = {14},
	doi = {10.1145/3544548.3581201}, 
	url = {https://doi.org/0.1145/3544548.3581201}, 
	address = {New York, NY, USA}
}