User-Aware Shared Perception for Embodied AgentsDavid McNeely-White, Francisco Ortega, Ross Beveridge, Bruce Draper, Rahul Bangar, Dhruva Patil, James Pustejovsky, Nikhil Krishnaswamy, Kyeongmin Rim, Jaime Ruiz, Isaac Wang
We present Diana, an embodied agent who is aware of her own virtual space and the physical space around her. Using video and depth sensors, Diana attends to the user’s gestures, body language, gaze and (soon) facial expressions as well as their words. Diana also gestures and emotes in addition to speaking, and exists in a 3D virtual world that the user can see. This produces symmetric and shared perception, in the sense that Diana can see the user, the user can see Diana, and both can see the virtual world. The result is an embodied agent that begins to develop the conceit that the user is interacting with a peer rather than a program.
Authors
Jaime Ruiz
Isaac Wang
As well as: David McNeely-White, Francisco Ortega, Ross Beveridge, Bruce Draper, Rahul Bangar, Dhruva Patil, James Pustejovsky, Nikhil Krishnaswamy, and Kyeongmin Rim
Citation
David White, Ross Beveridge, Bruce Draper, Francisco Ortega, Rahul Bangar, Dhruva Patil, James Pustejovsky, Nikhil Krishnaswamy, Kyeongmin Rim, Jaime Ruiz, and Isaac Wang. 2019. User-Aware Shared Perception for Embodied Agents. In 2019 IEEE International Conference on Humanized Computing and Communication (HCC), Laguna Hills, CA, USA, 2019, pp. 46-51.
Bibtex
@INPROCEEDINGS{8940869,
author={D. {McNeely-White} and F. {Ortega} and R. {Beveridge} and B. {Draper} and R. {Bangar} and D. {Patil} and J. {Pustejovsky} and N. {Krishnaswamy} and K. {Rim} and J. {Ruiz} and I. {Wang}},
booktitle={2019 IEEE International Conference on Humanized Computing and Communication (HCC)},
title={User-Aware Shared Perception for Embodied Agents},
year={2019},
volume={},
number={},
pages={46-51},
keywords={embodied agents;embodied conversational agents;avatars;human agent interaction;shared perception;embodied avatars;multi modal interfaces},
doi={10.1109/HCC46620.2019.00015},
ISSN={null},
month={Sep.},}