Remote Control by Body Movement in Synchrony with Orbiting Widgets: an Evaluation of TraceMatch
Christopher Clarke, Alessio Bellino, Augusto Esteves, and Hans Gellersen
PACM Interactive, Mobile, Wearable and Ubiquitous Technologies
In this work we consider how users can use body movement for remote control with minimal effort and maximum flexibility. TraceMatch is a novel technique where the interface displays available controls as circular widgets with orbiting targets, and where users can trigger a control by mimicking the displayed motion. The technique uses computer vision to detect circular motion as a uniform type of input, but is highly appropriable as users can produce matching motion with any part of their body. We present three studies that investigate input performance with different parts of the body, user preferences, and spontaneous choice of movements for input in realistic application scenarios. The results show that users can provide effective input with their head, hands and while holding objects, that multiple controls can be effectively distinguished by the difference in presented phase and direction of movement, and that users choose and switch modes of input seamlessly.
Christopher Clarke, Alessio Bellino, Augusto Esteves, and Hans Gellersen. 2017. Remote Control by Body Movement in Synchrony with Orbiting Widgets: an Evaluation of TraceMatch. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 45 (September 2017), 22 pages.
BibTex
@inproceedings{10.1145/3314111.3319822,
author = {Mardanbegi, Diako and Clarke, Christopher and Gellersen, Hans},
title = {Monocular Gaze Depth Estimation Using the Vestibulo-Ocular Reflex},
year = {2019},
isbn = {9781450367097},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3314111.3319822},
doi = {10.1145/3314111.3319822},
booktitle = {Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications},
articleno = {20},
numpages = {9},
keywords = {eye movement, gaze depth estimation, eye tracking, fixation depth, 3D gaze estimation, VOR},
location = {Denver, Colorado},
series = {ETRA '19}
}
@article{10.1145/3130910,
author = {Clarke, Christopher and Bellino, Alessio and Esteves, Augusto and Gellersen, Hans},
title = {Remote Control by Body Movement in Synchrony with Orbiting Widgets: An Evaluation of TraceMatch},
year = {2017},
issue_date = {September 2017},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
volume = {1},
number = {3},
url = {https://doi.org/10.1145/3130910},
doi = {10.1145/3130910},
journal = {Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.},
month = {sep},
articleno = {45},
numpages = {22},
keywords = {Remote control, Computer vision, Vision-based interfaces, Motion matching, Input techniques, Gesture input, Movement correlation, User evaluation, User input, Motion correlation, Path mimicry}
}