English
Related papers

Related papers: Multi-dimensional Evaluation of Empathetic Dialog …

200 papers

Evaluating Large Language Models (LLMs) for mental health support is challenging due to the emotionally and cognitively complex nature of therapeutic dialogue. Existing benchmarks are limited in scale, reliability, often relying on…

While both agent interaction and personalisation are vibrant topics in research on large language models (LLMs), there has been limited focus on the effect of language interaction on the behaviour of persona-conditioned LLM agents. Such an…

Computation and Language · Computer Science 2024-02-06 Ivar Frisch , Mario Giulianelli

Depression poses significant challenges to patients and healthcare organizations, necessitating efficient assessment methods. Existing paradigms typically focus on a patient-doctor way that overlooks multi-role interactions, such as family…

Human-Computer Interaction · Computer Science 2026-03-10 Zhiyuan Zhou , Jilong Liu , Sanwang Wang , Shijie Hao , Yanrong Guo , Richang Hong

Recent statistical approaches have improved the robustness and scalability of spoken dialogue systems. However, despite recent progress in domain adaptation, their reliance on in-domain data still limits their cross-domain scalability. In…

Computation and Language · Computer Science 2018-04-03 Simon Keizer , Verena Rieser

Educational dialogue is critical for decoding student learning processes, yet manual annotation remains time-consuming. This study evaluates the efficacy of GPT-5.2 and Gemini-3 using three prompting strategies (few-shot, single-agent, and…

Human-Computer Interaction · Computer Science 2026-04-07 Jie Cao , Zhanxin Hao , Jifan Yu

Large language models (LLMs) and their variants have shown extraordinary efficacy across numerous downstream natural language processing (NLP) tasks, which has presented a new vision for the development of NLP. Despite their remarkable…

Computation and Language · Computer Science 2024-01-18 Yazhou Zhang , Mengyao Wang , Youxi Wu , Prayag Tiwari , Qiuchi Li , Benyou Wang , Jing Qin

In-context learning is a popular inference strategy where large language models solve a task using only a few labeled demonstrations without needing any parameter updates. Although there have been extensive studies on English in-context…

Computation and Language · Computer Science 2024-06-10 Miaoran Zhang , Vagrant Gautam , Mingyang Wang , Jesujoba O. Alabi , Xiaoyu Shen , Dietrich Klakow , Marius Mosbach

Controlling the behavior of large language models (LLMs) at inference time is essential for aligning outputs with human abilities and safety requirements. \emph{Activation steering} provides a lightweight alternative to prompt engineering…

Artificial Intelligence · Computer Science 2026-01-30 Diaoulé Diallo , Katharina Dworatzyk , Sophie Jentzsch , Peer Schütt , Sabine Theis , Tobias Hecking

Large language models (LLMs) have shown impressive capabilities across tasks such as mathematics, coding, and reasoning, yet their learning ability, which is crucial for adapting to dynamic environments and acquiring new knowledge, remains…

Computation and Language · Computer Science 2025-12-29 Zhengyu Hu , Jianxun Lian , Zheyuan Xiao , Seraphina Zhang , Tianfu Wang , Nicholas Jing Yuan , Xing Xie , Hui Xiong

Effective collaboration between embodied agents requires more than acting in a shared environment; it demands communication grounded in each agent's evolving understanding of the world. When agents can only partially observe their…

Multiagent Systems · Computer Science 2026-05-19 Vardhan Dongre , Dilek Hakkani-Tür

Emotional support is a core capability in human-AI interaction, with applications including psychological counseling, role play, and companionship. However, existing evaluations of large language models (LLMs) often rely on short, static…

Computation and Language · Computer Science 2025-11-13 Zhouxing Tan , Ruochong Xiong , Yulong Wan , Jinlong Ma , Hanlin Xue , Qichun Deng , Haifeng Jing , Zhengtong Zhang , Depei Liu , Shiyuan Luo , Junfei Liu

This paper introduces EmplifAI, a Japanese empathetic dialogue dataset designed to support patients coping with chronic medical conditions. They often experience a wide range of positive and negative emotions (e.g., hope and despair) that…

Computation and Language · Computer Science 2026-01-16 Wan Jou She , Lis Kanashiro Pereira , Fei Cheng , Sakiko Yahata , Panote Siriaraya , Eiji Aramaki

Emotional Support Conversation (ESC) is a typical dialogue that can effectively assist the user in mitigating emotional pressures. However, owing to the inherent subjectivity involved in analyzing emotions, current non-artificial…

Computation and Language · Computer Science 2024-08-05 Huaiwen Zhang , Yu Chen , Ming Wang , Shi Feng

In cognitive science and linguistic theory, dialogue is not seen as a chain of independent utterances but rather as a joint activity sustained by coherence, consistency, and shared understanding. However, many systems for open-domain and…

Computation and Language · Computer Science 2026-03-24 Tianyi Zhang , David Traum

Large Language Models (LLMs) are increasingly deployed in human-centric applications, yet they often fail to provide substantive emotional support. While Reinforcement Learning (RL) has been utilized to enhance empathy of LLMs, existing…

Computation and Language · Computer Science 2026-01-19 Chengbing Wang , Wuqiang Zheng , Yang Zhang , Fengbin Zhu , Junyi Cheng , Yi Xie , Wenjie Wang , Fuli Feng

Advancements in dialogue systems powered by large language models (LLMs) have outpaced the development of reliable evaluation metrics, particularly for diverse and creative responses. We present a benchmark for evaluating the robustness of…

Computation and Language · Computer Science 2025-01-14 Justin Vasselli , Adam Nohejl , Taro Watanabe

Human acceptance of social robots is greatly effected by empathy and perceived understanding. This necessitates accurate and flexible responses to various input data from the user. While systems such as this can become increasingly complex…

Robotics · Computer Science 2024-12-31 Jordan Sinclair , Christopher Reardon

As large language models (LLMs) increasingly interact with each other, most notably in multi-agent setups, we may expect (and hope) that `trust' relationships develop between them, mirroring trust relationships between human colleagues,…

Multiagent Systems · Computer Science 2025-08-25 Maarten Buyl , Yousra Fettach , Guillaume Bied , Tijl De Bie

(Tack et al., 2023) organized the shared task hosted by the 18th Workshop on Innovative Use of NLP for Building Educational Applications on generation of teacher language in educational dialogues. Following the structure of the shared task,…

Computation and Language · Computer Science 2023-11-14 Yann Hicke , Abhishek Masand , Wentao Guo , Tushaar Gangavarapu

In today's digitally driven world, dialogue systems play a pivotal role in enhancing user interactions, from customer service to virtual assistants. In these dialogues, it is important to identify user's goals automatically to resolve their…

Computation and Language · Computer Science 2024-11-19 Juan A. Rodriguez , Nicholas Botzer , David Vazquez , Christopher Pal , Marco Pedersoli , Issam Laradji