Visible to the public User-Aware Shared Perception for Embodied Agents

TitleUser-Aware Shared Perception for Embodied Agents
Publication TypeConference Paper
Year of Publication2019
AuthorsMcNeely-White, David G., Ortega, Francisco R., Beveridge, J. Ross, Draper, Bruce A., Bangar, Rahul, Patil, Dhruva, Pustejovsky, James, Krishnaswamy, Nikhil, Rim, Kyeongmin, Ruiz, Jaime, Wang, Isaac
Conference Name2019 IEEE International Conference on Humanized Computing and Communication (HCC)
Date Publishedsep
ISBN Number978-1-7281-4125-1
Keywords3D virtual world, Avatars, conversational agents, DIANA, embodied agents, embodied avatars, Embodied Conversational Agents, facial expressions, human agent interaction, Human Behavior, Metrics, multi modal interfaces, physical space, pubcrawl, Scalability, shared perception, software agents, user interfaces, user-aware shared perception, virtual reality, virtual space

We present Diana, an embodied agent who is aware of her own virtual space and the physical space around her. Using video and depth sensors, Diana attends to the user's gestures, body language, gaze and (soon) facial expressions as well as their words. Diana also gestures and emotes in addition to speaking, and exists in a 3D virtual world that the user can see. This produces symmetric and shared perception, in the sense that Diana can see the user, the user can see Diana, and both can see the virtual world. The result is an embodied agent that begins to develop the conceit that the user is interacting with a peer rather than a program.

Citation Keymcneely-white_user-aware_2019