English
Related papers

Related papers: Empathic Grounding: Explorations using Multimodal …

200 papers

Human intelligence's adaptability is remarkable, allowing us to adjust to new tasks and multi-modal environments swiftly. This skill is evident from a young age as we acquire new abilities and solve problems by imitating others or following…

Artificial Intelligence · Computer Science 2023-05-19 Shrestha Mohanty , Negar Arabzadeh , Julia Kiseleva , Artem Zholus , Milagro Teruel , Ahmed Awadallah , Yuxuan Sun , Kavya Srinet , Arthur Szlam

Conversational grounding is a collaborative mechanism for establishing mutual knowledge among participants engaged in a dialogue. This experimental study analyzes information-seeking conversations to investigate the capabilities of large…

Computation and Language · Computer Science 2024-06-05 Kristiina Jokinen , Phillip Schneider , Taiga Mori

Integrating multimodal foundation models has significantly enhanced autonomous agents' language comprehension, perception, and planning capabilities. However, while existing works adopt a \emph{task-centric} approach with minimal human…

Robotics · Computer Science 2024-08-21 Tim Schreiter , Rishi Hazra , Jens Rüppel , Andrey Rudenko

Previous research on empathetic dialogue systems has mostly focused on generating responses given certain emotions. However, being empathetic not only requires the ability of generating emotional responses, but more importantly, requires…

Computation and Language · Computer Science 2019-08-22 Zhaojiang Lin , Andrea Madotto , Jamin Shin , Peng Xu , Pascale Fung

Conversational agents have made significant progress since ELIZA, expanding their role across various domains, including healthcare, education, and customer service. As these agents become increasingly integrated into daily human…

Human-Computer Interaction · Computer Science 2025-07-04 Paulo Ricardo Knob , Leonardo Scholler , Juliano Rigatti , Soraia Raupp Musse

We introduce a task and dataset for referring expression generation and comprehension in multi-agent embodied environments. In this task, two agents in a shared scene must take into account one another's visual perspective, which may be…

Computation and Language · Computer Science 2024-10-08 Zineng Tang , Lingjun Mao , Alane Suhr

Most prior works on communication in multi-agent reinforcement learning have focused on emergent communication, which often results in inefficient and non-interpretable systems. Inspired by the role of language in natural intelligence, we…

Multiagent Systems · Computer Science 2025-08-08 Maxime Toquebiau , Jae-Yun Jun , Faïz Benamar , Nicolas Bredeche

Emotional language generation is one of the keys to human-like artificial intelligence. Humans use different type of emotions depending on the situation of the conversation. Emotions also play an important role in mediating the engagement…

Computation and Language · Computer Science 2019-11-27 Sashank Santhanam , Samira Shaikh

Conversational agents are increasingly used as support tools along mental therapeutic pathways with significant societal impacts. In particular, empathy is a key non-functional requirement in therapeutic contexts, yet current chatbot…

Computation and Language · Computer Science 2026-01-14 Francesco Dettori , Matteo Forasassi , Lorenzo Veronese , Livia Lestingi , Vincenzo Scotti , Matteo Giovanni Rossi

Technologies for enhancing well-being, healthcare vigilance and monitoring are on the rise. However, despite patient interest, such technologies suffer from low adoption. One hypothesis for this limited adoption is loss of human interaction…

Computation and Language · Computer Science 2021-11-30 Xinxin Yan , Ndapa Nakashole

People rely heavily on context to enrich meaning beyond what is literally said, enabling concise but effective communication. To interact successfully and naturally with people, user-facing artificial intelligence systems will require…

Computation and Language · Computer Science 2023-11-23 Daniel Fried , Nicholas Tomlin , Jennifer Hu , Roma Patel , Aida Nematzadeh

One challenge for dialogue agents is recognizing feelings in the conversation partner and replying accordingly, a key communicative skill. While it is straightforward for humans to recognize and acknowledge others' feelings in a…

Computation and Language · Computer Science 2019-08-30 Hannah Rashkin , Eric Michael Smith , Margaret Li , Y-Lan Boureau

Empathy is a complex cognitive ability based on the reasoning of others' affective states. In order to better understand others and express stronger empathy in dialogues, we argue that two issues must be tackled at the same time: (i)…

Computation and Language · Computer Science 2021-09-22 Hyunwoo Kim , Byeongchang Kim , Gunhee Kim

As artificial intelligence (AI) systems become increasingly embedded in everyday life, the ability of interactive agents to express empathy has become critical for effective human-AI interaction, particularly in emotionally sensitive…

Human-Computer Interaction · Computer Science 2025-12-24 Sung Park , Daeho Yoon , Jungmin Lee

It may be difficult for some individuals to open up and share their thoughts and feelings in front of a mental health expert. For those who are more at ease with a virtual agent, conversational agents can serve as an intermediate step in…

Computation and Language · Computer Science 2021-11-17 Harsh Sakhrani , Saloni Parekh , Shubham Mahajan

Negotiation is a complex social interaction that encapsulates emotional encounters in human decision-making. Virtual agents that can negotiate with humans are useful in pedagogy and conversational AI. To advance the development of such…

Human-Computer Interaction · Computer Science 2021-07-29 Kushal Chawla , Rene Clever , Jaysa Ramirez , Gale Lucas , Jonathan Gratch

Effective feature representations play a critical role in enhancing the performance of text generation models that rely on deep neural networks. However, current approaches suffer from several drawbacks, such as the inability to capture the…

Computation and Language · Computer Science 2024-02-27 Omama Hamad , Ali Hamdi , Khaled Shaban

Empathy is critical to successful mental health support. Empathy measurement has predominantly occurred in synchronous, face-to-face settings, and may not translate to asynchronous, text-based contexts. Because millions of people use…

Computation and Language · Computer Science 2020-09-18 Ashish Sharma , Adam S. Miner , David C. Atkins , Tim Althoff

The integration of dialogue interfaces in mobile devices has become ubiquitous, providing a wide array of services. As technology progresses, humanoid robots designed with human-like features to interact effectively with people are gaining…

Human-Computer Interaction · Computer Science 2025-01-14 Mohamed Ala Yahyaoui , Mouaad Oujabour , Leila Ben Letaifa , Amine Bohi

Modern day conversational agents are trained to emulate the manner in which humans communicate. To emotionally bond with the user, these virtual agents need to be aware of the affective state of the user. Transformers are the recent state…

Sound · Computer Science 2022-04-26 Raman Goel , Seba Susan , Sachin Vashisht , Armaan Dhanda