Stop Copying Me: Evaluating nonverbal mimicry in embodied motivational agentsWang A, Rodrigo Calvo, Heting Wang, and Jaime Ruiz
Motivational agents are virtual agents that seek to motivate users by providing feedback and guidance. Prior work has shown how certain factors of an agent, such as the type of feedback given or the agent’s appearance, can influence user motivation when completing tasks. However, it is not known how nonverbal mirroring affects an agent’s ability to motivate users. Specifically, would an agent that mirrors be more motivating than an agent that does not? Would an agent trained on real human behaviors be better? We conducted a within-subjects study asking 30 participants to play a “find-the-hidden-object” game while interacting with a motivational agent that would provide hints and feedback on the user’s performance. We created three agents: a Control agent that did not respond to the user’s movements, a simple Mimic agent that mirrored the user’s movements on a delay, and a Complex agent that used a machine-learned behavior model. We asked participants to complete a questionnaire asking them to rate their levels of motivation and perceptions of the agent and its feedback. Our results showed that the Mimic agent was more motivating than the Control agent and more helpful than the Complex agent. We also found that when participants became aware of the mimicking behavior, it can feel weird or creepy; therefore, it is important to consider the detection of mimicry when designing virtual agents.
Isaac Wang
Rodrigo Calvo
Heting Wang
Jaime RuizCitation
Isaac Wang, Rodrigo Calvo, Heting Wang, and Jaime Ruiz. 2023. Stop Copying Me: Evaluating nonverbal mimicry in embodied motivational agents. In Proceedings of the 23rd ACM International Conference on Intelligent Virtual Agents (IVA ’23). Association for Computing Machinery, New York, NY, USA, Article 49, 1–4. https://doi.org/10.1145/3570945.3607322
Bibtex
@inproceedings{10.1145/3570945.3607322,
author = {Wang, Isaac and Calvo, Rodrigo and Wang, Heting and Ruiz, Jaime},
title = {Stop Copying Me: Evaluating nonverbal mimicry in embodied motivational agents},
year = {2023},
isbn = {9781450399944},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3570945.3607322},
doi = {10.1145/3570945.3607322},
abstract = {Motivational agents are virtual agents that seek to motivate users by providing feedback and guidance. Prior work has shown how certain factors of an agent, such as the type of feedback given or the agent's appearance, can influence user motivation when completing tasks. However, it is not known how nonverbal mirroring affects an agent's ability to motivate users. Specifically, would an agent that mirrors be more motivating than an agent that does not? Would an agent trained on real human behaviors be better? We conducted a within-subjects study asking 30 participants to play a "find-the-hidden-object" game while interacting with a motivational agent that would provide hints and feedback on the user's performance. We created three agents: a Control agent that did not respond to the user's movements, a simple Mimic agent that mirrored the user's movements on a delay, and a Complex agent that used a machine-learned behavior model. We asked participants to complete a questionnaire asking them to rate their levels of motivation and perceptions of the agent and its feedback. Our results showed that the Mimic agent was more motivating than the Control agent and more helpful than the Complex agent. We also found that when participants became aware of the mimicking behavior, it can feel weird or creepy; therefore, it is important to consider the detection of mimicry when designing virtual agents.},
booktitle = {Proceedings of the 23rd ACM International Conference on Intelligent Virtual Agents},
articleno = {49},
numpages = {4},
keywords = {behavioral mirroring, motivational agents, nonverbal, virtual agents},
location = {, W\"{u}rzburg , Germany , },
series = {IVA '23}
}