English
Related papers

Related papers: SAPIEN: Affective Virtual Agents Powered by Large …

200 papers

Serious illness communication (SIC) in end-of-life care faces challenges such as emotional stress, cultural barriers, and balancing hope with honesty. Despite its importance, one of the few available ways for clinicians to practice SIC is…

Human-Computer Interaction · Computer Science 2025-05-06 Kurtis Haut , Masum Hasan , Thomas Carroll , Ronald Epstein , Taylan Sen , Ehsan Hoque

Large Language Models have demonstrated remarkable capabilities in open-domain dialogues. However, current methods exhibit suboptimal performance in service dialogues, as they rely on noisy, low-quality human conversation data. This…

Computation and Language · Computer Science 2026-05-06 Yuqin Dai , Ning Gao , Wei Zhang , Jie Wang , Zichen Luo , Jinpeng Wang , Yujie Wang , Ruiyuan Wu , Chaozheng Wang

Large Language Models (LLMs) are transforming artificial intelligence, enabling autonomous agents to perform diverse tasks across various domains. These agents, proficient in human-like text comprehension and generation, have the potential…

Artificial Intelligence · Computer Science 2024-04-10 Saikat Barua

This paper presents our recent research on integrating artificial emotional intelligence in a social robot (Ryan) and studies the robot's effectiveness in engaging older adults. Ryan is a socially assistive robot designed to provide…

Human-Computer Interaction · Computer Science 2022-01-28 Hojjat Abdollahi , Mohammad H. Mahoor , Rohola Zandie , Jarid Siewierski , Sara H. Qualls

This work presents an audio-visual interactive chatbot (AVIN-Chat) system that allows users to have face-to-face conversations with 3D avatars in real-time. Compared to the previous chatbot services, which provide text-only or speech-only…

Human-Computer Interaction · Computer Science 2024-09-04 Chanhyuk Park , Jungbin Cho , Junwan Kim , Seongmin Lee , Jungsu Kim , Sanghoon Lee

The increasing capability of Large Language Models to act as human-like social agents raises two important questions in the area of opinion dynamics. First, whether these agents can generate effective arguments that could be injected into…

Computers and Society · Computer Science 2023-12-27 Simon Martin Breum , Daniel Vædele Egdal , Victor Gram Mortensen , Anders Giovanni Møller , Luca Maria Aiello

Conversational agents powered by large language models (LLM) have increasingly been utilized in the realm of mental well-being support. However, the implications and outcomes associated with their usage in such a critical field remain…

Human-Computer Interaction · Computer Science 2023-08-01 Zilin Ma , Yiyang Mei , Zhaoyuan Su

Despite advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), their integration into language-grounded, human-like embodied agents remains incomplete, hindering complex real-life task performance in physical…

Computation and Language · Computer Science 2024-08-20 Zhili Cheng , Zhitong Wang , Jinyi Hu , Shengding Hu , An Liu , Yuge Tu , Pengkai Li , Lei Shi , Zhiyuan Liu , Maosong Sun

We present some results concerning the dialogue behavior and inferred sentiment of a group of older adults interacting with a computer-based avatar. Our avatar is unique in its ability to hold natural dialogues on a wide range of everyday…

Human-Computer Interaction · Computer Science 2019-07-16 S. Zahra Razavi , Lenhart K. Schubert , Kimberly A. Van Orden , Mohammad Rafayet Ali

Negotiation is a complex social interaction that encapsulates emotional encounters in human decision-making. Virtual agents that can negotiate with humans are useful in pedagogy and conversational AI. To advance the development of such…

Human-Computer Interaction · Computer Science 2021-07-29 Kushal Chawla , Rene Clever , Jaysa Ramirez , Gale Lucas , Jonathan Gratch

Simulation is an invaluable tool for developing and evaluating controllers for self-driving cars. Current simulation frameworks are driven by highly-specialist domain specific languages, and so a natural language interface would greatly…

Artificial Intelligence · Computer Science 2023-10-27 Antonio Valerio Miceli-Barone , Alex Lascarides , Craig Innes

Recently, large language models have facilitated the emergence of highly intelligent conversational AI capable of engaging in human-like dialogues. However, a notable distinction lies in the fact that these AI models predominantly generate…

Human-Computer Interaction · Computer Science 2025-10-13 Jijie Zhou , Yuhan Hu

When engaging in conversations, dialogue agents in a virtual simulation environment may exhibit their own emotional states that are unrelated to the immediate conversational context, a phenomenon known as self-emotion. This study explores…

Multiagent Systems · Computer Science 2024-08-06 Qiang Zhang , Jason Naradowsky , Yusuke Miyao

Conversational artificial intelligence can already independently engage in brief conversations with clients with psychological problems and provide evidence-based psychological interventions. The main objective of this study is to improve…

Human-Computer Interaction · Computer Science 2024-03-21 H. Zhang , Z. Qiao , H. Wang , B. Duan , J. Yin

Language agents show potential in being capable of utilizing natural language for varied and intricate tasks in diverse environments, particularly when built upon large language models (LLMs). Current language agent frameworks aim to…

The rapid advancement of Large Language Models (LLMs) has marked a significant breakthrough in Artificial Intelligence (AI), ushering in a new era of Human-centered Artificial Intelligence (HAI). HAI aims to better serve human welfare and…

Robotics · Computer Science 2025-10-29 Wenbin Ding , Jun Chen , Mingjia Chen , Fei Xie , Qi Mao , Philip Dames

We introduce the concept of "empathic grounding" in conversational agents as an extension of Clark's conceptualization of grounding in conversation in which the grounding criterion includes listener empathy for the speaker's affective…

Human-Computer Interaction · Computer Science 2024-07-03 Mehdi Arjmand , Farnaz Nouraei , Ian Steenstra , Timothy Bickmore

Autistic individuals often experience difficulties in conveying and interpreting emotional tone and non-literal nuances. Many also mask their communication style to avoid being misconstrued by others, spending considerable time and mental…

Human-Computer Interaction · Computer Science 2024-07-26 Rukhshan Haroon , Fahad Dogar

Large language models have become increasingly common, used by millions of people worldwide in both professional and personal contexts. As these models continue to advance, they are frequently serving as virtual assistants and companions.…

Computation and Language · Computer Science 2025-08-13 Victoria Williams , Benjamin Rosman

With the rapid development of mobile intelligent assistant technologies, multi-modal AI assistants have become essential interfaces for daily user interactions. However, current evaluation methods face challenges including high manual…

Artificial Intelligence · Computer Science 2025-10-22 Meiping Wang , Jian Zhong , Rongduo Han , Liming Kang , Zhengkun Shi , Xiao Liang , Xing Lin , Nan Gao , Haining Zhang