Using Audio Cues to Support Motion Gesture Interaction on Mobile DevicesSarah Morrison-Smith, Megan Hofmann, Yang Li, and Jaime Ruiz.
Motion gestures are an underutilized input modality for mobile interaction despite numerous potential advantages. Negulescu et al. found that the lack of feedback on attempted motion gestures made it difficult for participants to diagnose and correct errors, resulting in poor recognition performance and user frustration. In this article, we describe and evaluate a training and feedback technique, Glissando, which uses audio characteristics to provide feedback on the system’s interpretation of user input. This technique enables feedback by verbally confirming correct gestures and notifying users of errors in addition to providing continuous feedback by manipulating the pitch of distinct musical notes mapped to each of three dimensional axes in order to provide both spatial and temporal information.
Authors
Sarah Morrison-Smith
Jaime Ruiz
As well as: Megan Hofmann and Yang Li
Citation
Sarah Morrison-Smith, Megan Hofmann, Yang Li, and Jaime Ruiz. 2016. Using Audio Cues to Support Motion Gesture Interaction on Mobile Devices. ACM Trans. Appl. Percept. 13, 3, Article 16 (May 2016), 19 pages. DOI=http://dx.doi.org/10.1145/2897516
Bibtex
@article{Morrison-Smith:2016:UAC:2912576.2897516,
author = {Morrison-Smith, Sarah and Hofmann, Megan and Li, Yang and Ruiz, Jaime},
title = {Using Audio Cues to Support Motion Gesture Interaction on Mobile Devices},
journal = {ACM Trans. Appl. Percept.},
issue_date = {May 2016},
volume = {13},
number = {3},
month = may,
year = {2016},
issn = {1544-3558},
pages = {16:1--16:19},
articleno = {16},
numpages = {19},
url = {http://doi.acm.org/10.1145/2897516},
doi = {10.1145/2897516},
acmid = {2897516},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {Motion gestures, audio feedback, mobile interaction},
}