English
Related papers

Related papers: IRL Dittos: Embodied Multimodal AI Agent Interacti…

200 papers

Large Language Models (LLMs) have demonstrated remarkable capabilities in conversational tasks. Embodying an LLM as a virtual human allows users to engage in face-to-face social interactions in Virtual Reality. However, the influence of…

Human-Computer Interaction · Computer Science 2025-08-06 Leon O. H. Kroczek , Alexander May , Selina Hettenkofer , Andreas Ruider , Bernd Ludwig , Andreas Mühlberger

The integration of the physical capabilities of an industrial collaborative robot with a social virtual character may represent a viable solution to enhance the workers' perception of the system as an embodied social entity and increase…

We design and develop a new shared Augmented Reality (AR) workspace for Human-Robot Interaction (HRI), which establishes a bi-directional communication between human agents and robots. In a prototype system, the shared AR workspace enables…

Robotics · Computer Science 2020-12-10 Shuwen Qiu , Hangxin Liu , Zeyu Zhang , Yixin Zhu , Song-Chun Zhu

Home assistant chat-bots, self-driving cars, drones or automated negotiations are some of the several examples of autonomous (artificial) agents that have pervaded our society. These agents enable the automation of multiple tasks, saving…

Human-Computer Interaction · Computer Science 2021-03-16 Elias Fernández Domingos , Inês Terrucha , Rémi Suchon , Jelena Grujić , Juan C. Burguillo , Francisco C. Santos , Tom Lenaerts

A long-standing goal of the research community is to develop highly interactive LLM-based dialogue agents. Recent research focuses on optimizing policies based on fixed offline logs (Static Context RL) or using a prompt-based simulator…

Artificial Intelligence · Computer Science 2026-05-27 Xiaohua Wang , Jiakang Yuan , Zisu Huang , Muzhao Tian , Changze Lv , Kaitao Song , Tao Chen , Xiaoqing Zheng

With the rapid evolution of wireless mobile devices, there emerges an increased need to design effective collaboration mechanisms between intelligent agents, so as to gradually approach the final collective objective through continuously…

Artificial Intelligence · Computer Science 2021-02-02 Xing Xu , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

The increase in available computing power and the Deep Learning revolution have allowed the exploration of new topics and frontiers in Artificial Intelligence research. A new field called Embodied Artificial Intelligence, which places at…

Robotics · Computer Science 2025-05-05 Roberto Bigazzi

With the recent development of natural language generation models - termed as large language models (LLMs) - a potential use case has opened up to improve the way that humans interact with robot assistants. These LLMs should be able to…

Multiagent Systems · Computer Science 2024-11-27 Mitchell Rosser , Marc. G Carmichael

In this paper, we present a methodology for the development of embodied conversational agents for social virtual worlds. The agents provide multimodal communication with their users in which speech interaction is included. Our proposal…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-29 D. Griol , A. Sanchis , J. M. Molina , Z. Callejas

The integration of embodied agents into human environments demands embodied social intelligence: reasoning over both social norms and physical constraints. However, existing evaluations fail to address this integration, as they are limited…

Artificial Intelligence · Computer Science 2025-12-24 Zhe Sun , Xueyuan Yang , Yujie Lu , Zhenliang Zhang

Enabling users to create their own simulations offers a powerful way to study team dynamics and performance. We introduce VirTLab, a system that allows researchers and practitioners to design interactive, customizable simulations of team…

Embodied artificial intelligence emphasizes the role of an agent's body in generating human-like behaviors. The recent efforts on EmbodiedAI pay a lot of attention to building up machine learning models to possess perceiving, planning, and…

Artificial Intelligence · Computer Science 2024-10-15 Chen Gao , Baining Zhao , Weichen Zhang , Jinzhu Mao , Jun Zhang , Zhiheng Zheng , Fanhang Man , Jianjie Fang , Zile Zhou , Jinqiang Cui , Xinlei Chen , Yong Li

As AI chatbots shift from tools to companions, critical questions arise: who controls the conversation in human-AI chatrooms? This paper explores perceived human and AI agency in sustained conversation. We report a month-long longitudinal…

Human-Computer Interaction · Computer Science 2026-04-15 Bhada Yun , Evgenia Taranova , April Yi Wang

Young people's mental well-being is a global concern, with peer support playing a key role in daily emotional regulation. Conversational agents are increasingly viewed as promising tools for delivering accessible, personalised peer support,…

Human-Computer Interaction · Computer Science 2025-12-01 Ruoyu Wen , Xiaoli Wu , Kunal Gupta , Simon Hoermann , Mark Billinghurst , Alaeddin Nassani , Dwain Allan , Thammathip Piumsomboon

Artificial intelligence (AI) has revolutionized human cognitive abilities and facilitated the development of new AI entities capable of interacting with humans in both physical and virtual environments. Despite the existence of virtual…

Human-Computer Interaction · Computer Science 2024-01-30 Zhenliang Zhang , Zeyu Zhang , Ziyuan Jiao , Yao Su , Hangxin Liu , Wei Wang , Song-Chun Zhu

AI companion chatbots, such as those offered by Replika and CharacterAI, increasingly function as always-available companions that provide empathy, validation, and support. While these systems appear to meet basic needs for connection,…

Social and Information Networks · Computer Science 2025-12-24 Minh Duc Chu , Patrick Gerard , Kshitij Pawar , Charles Bickham , Kristina Lerman

The reasoning capabilities of embodied agents introduce a critical, under-explored inferential privacy challenge, where the risk of an agent generate sensitive conclusions from ambient data. This capability creates a fundamental tension…

Human-Computer Interaction · Computer Science 2025-09-24 Shuning Zhang , Hong Jia , Simin Li , Ting Dang , Yongquan `Owen' Hu , Xin Yi , Hewu Li

Individuals frequently form deep attachments to physical objects (e.g., plush toys) that usually cannot sense or respond to their emotions. While AI companions offer responsiveness and personalization, they exist independently of these…

People's identities change during life transitions, e.g., studying abroad. They bring everyday objects that embody memories and reflect their identities during such moves. To assist in these transitions, we ask how people's human identities…

Human-Computer Interaction · Computer Science 2026-01-28 Yuhui Xu , Minha Lee , Stephan Wensveen , Mahla Alizadeh , Mathias Funk

Seamlessly interacting with humans or robots is hard because these agents are non-stationary. They update their policy in response to the ego agent's behavior, and the ego agent must anticipate these changes to co-adapt. Inspired by humans,…

Robotics · Computer Science 2020-11-16 Annie Xie , Dylan P. Losey , Ryan Tolsma , Chelsea Finn , Dorsa Sadigh