Human-Centered Recognition of Children's Touchscreen Gestures
Alex Shaw, Jaime Ruiz, and Lisa Anthony. 2017. In Proceedings of the 19th ACM International Conference on Multimodal Interaction (ICMI 2017). ACM, New York, NY, USA, 32-40. DOI: https://doi.org/10.1145/3136755.3136810
Designing Natural User Interfaces for Children
In collaboration with Dr. Lisa Anthony's INIT Lab, this work explores the challenges children have interacting with Natural User Interfaces (NUIs), i.e., interfaces that use touch, speech, and gesture. Children are increasingly being presented with technology, such as tablets and smartphones, in classrooms, museums, and at home. However, children are still developing their cognitive and physical capabilities, and prior work has shown that children’s interaction behaviors and expectations are different from those of adults. For example, our prior work has shown that gesture recognition algorithms do not perform as well for children, mainly due to their motor skills development affecting their writing ability. Our goal is to build better technology and interactions for children by understanding how children interactions differ from adults.
In our work, we have examined children’s touch and gesture interactions on smartphones, tablets, and tabletops. On the tabletop, children responded more accurately to changing target locations and were more accurate touching targets around the screen. We also found that the gesture recognition rates were consistent across devices, which implies that gesture data does not have to be collected on the device that recognition will take place. Throughout our work, we provide design guidelines for children’s touchscreen interactions to inform the design of touchscreen applications for children. While our work has mainly focused on improving recognition and accuracy, we also examined children’s expectations of intelligent user interfaces that use modalities such as speech and writing. We developed a conceptual model of the children’s expectations which can be used along with our prior work on improving accuracy to further develop technology that is tailored towards children. We continue to build upon our work to further examine children’s expectations and abilities in respect to Natural User Interfaces.
Tablets, tabletops, and smartphones: cross-platform comparisons of children’s touchscreen interactions
Julia Woodward, Alex Shaw, Aishat Aloba, Ayushi Jain, Jaime Ruiz, and Lisa Anthony. 2017. In Proceedings of the 19th ACM International Conference on Multimodal Interaction (ICMI 2017). ACM, New York, NY, USA, 5-14. DOI: https://doi.org/10.1145/3136755.3136762
Using Co-Design to Examine How Children Conceptualize Intelligent Interfaces
Julia Woodward, Zari McFadden, Nicole Shiver, Amir Ben-hayon, Jason C. Yip, and Lisa Anthony. 2018. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Paper 575, 14 pages. DOI: https://doi.org/10.1145/3173574.3174149
Investigating Separation of Territories and Activity Roles in Children’s Collaboration around Tabletops
Julia Woodward, Shaghayegh Esmaeili, Ayushi Jain, John Bell, Jaime Ruiz, and Lisa Anthony. 2018. In Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW, Article 185 (November 2018). ACM, New York, NY. 21 pages. https://doi.org/10.1145/3274454