中文
相关论文

相关论文: Socio-Emotional Response Generation: A Human Evalu…

200 篇论文

High-quality conversational datasets are essential for developing AI models that can communicate with users. One way to foster deeper interactions between a chatbot and its user is through personas, aspects of the user's character that…

计算与语言 · 计算机科学 2023-12-18 Pegah Jandaghi , XiangHai Sheng , Xinyi Bai , Jay Pujara , Hakim Sidahmed

Emotion recognition in conversation (ERC), the task of discerning human emotions for each utterance within a conversation, has garnered significant attention in human-computer interaction systems. Previous ERC studies focus on…

计算与语言 · 计算机科学 2025-03-04 Yumeng Fu , Junjie Wu , Zhongjie Wang , Meishan Zhang , Lili Shan , Yulin Wu , Bingquan Li

Large language models (LLMs) are increasingly applied to open-ended, interpretive annotation tasks, such as thematic analysis by researchers or generating feedback on student work by teachers. These tasks involve free-text annotations…

计算与语言 · 计算机科学 2025-09-04 Hyunji Nam , Lucia Langlois , James Malamut , Mei Tan , Dorottya Demszky

Automated text annotation is a compelling use case for generative large language models (LLMs) in social media research. Recent work suggests that LLMs can achieve strong performance on annotation tasks; however, these studies evaluate LLMs…

计算与语言 · 计算机科学 2024-09-24 Nicholas Pangakis , Samuel Wolken

Existing works on long-term open-domain dialogues focus on evaluating model responses within contexts spanning no more than five chat sessions. Despite advancements in long-context large language models (LLMs) and retrieval augmented…

计算与语言 · 计算机科学 2024-02-28 Adyasha Maharana , Dong-Ho Lee , Sergey Tulyakov , Mohit Bansal , Francesco Barbieri , Yuwei Fang

Psychological support hotlines provide critical support for individuals experiencing mental health emergencies, yet current assessments largely rely on human operators whose judgments may vary with professional experience and are…

计算与语言 · 计算机科学 2026-05-12 Terumi Chiba , Yang Luo , Ziyun Cui , Yongsheng Tong , Chao Zhang

Transformer models have significantly advanced the field of emotion recognition. However, there are still open challenges when exploring open-ended queries for Large Language Models (LLMs). Although current models offer good results,…

Public Narratives (PNs) are key tools for leadership development and civic mobilization, yet their systematic analysis remains challenging due to their subjective interpretation and the high cost of expert annotation. In this work, we…

计算与语言 · 计算机科学 2025-11-18 Elinor Poole-Dayan , Daniel T Kessler , Hannah Chiou , Margaret Hughes , Emily S Lin , Marshall Ganz , Deb Roy

Large Language Models (LLMs) are increasingly expected to navigate the nuances of human emotion. While research confirms that LLMs can simulate emotional intelligence, their internal emotional mechanisms remain largely unexplored. This…

人工智能 · 计算机科学 2025-10-14 Jingxiang Zhang , Lujia Zhong

Evaluating Large Language Models' (LLMs) anthropomorphic capabilities has become increasingly important in contemporary discourse. Utilizing the emotion appraisal theory from psychology, we propose to evaluate the empathy ability of LLMs,…

计算与语言 · 计算机科学 2024-10-08 Jen-tse Huang , Man Ho Lam , Eric John Li , Shujie Ren , Wenxuan Wang , Wenxiang Jiao , Zhaopeng Tu , Michael R. Lyu

As mental health issues continue to rise globally, there is an increasing demand for accessible and scalable therapeutic solutions. Many individuals currently seek support from Large Language Models (LLMs), even though these models have not…

计算与语言 · 计算机科学 2026-03-05 Navdeep Singh Bedi , Ana-Maria Bucur , Noriko Kando , Fabio Crestani

This paper investigates the capability of LLMs in storytelling, focusing on narrative development and plot progression. We introduce a novel computational framework to analyze narratives through three discourse-level aspects: i) story arcs,…

计算与语言 · 计算机科学 2024-10-08 Yufei Tian , Tenghao Huang , Miri Liu , Derek Jiang , Alexander Spangher , Muhao Chen , Jonathan May , Nanyun Peng

In the field of emotion recognition, the development of high-performance models remains a challenge due to the scarcity of high-quality, diverse emotional datasets. Emotional expressions are inherently subjective, shaped by individual…

计算与语言 · 计算机科学 2025-09-16 Keito Inoshita , Rushia Harada

Recent advances in Large Language Models (LLMs) have highlighted the need for robust, comprehensive, and challenging benchmarks. Yet, research on evaluating their Emotional Intelligence (EI) is considerably limited. Existing benchmarks have…

Simulation is an invaluable tool for developing and evaluating controllers for self-driving cars. Current simulation frameworks are driven by highly-specialist domain specific languages, and so a natural language interface would greatly…

人工智能 · 计算机科学 2023-10-27 Antonio Valerio Miceli-Barone , Alex Lascarides , Craig Innes

Although human evaluation remains the gold standard for open-domain dialogue evaluation, the growing popularity of automated evaluation using Large Language Models (LLMs) has also extended to dialogue. However, most frameworks leverage…

计算与语言 · 计算机科学 2024-10-07 John Mendonça , Isabel Trancoso , Alon Lavie

The explainability of recommender systems has attracted significant attention in academia and industry. Many efforts have been made for explainable recommendations, yet evaluating the quality of the explanations remains a challenging and…

信息检索 · 计算机科学 2024-06-07 Xiaoyu Zhang , Yishan Li , Jiayin Wang , Bowen Sun , Weizhi Ma , Peijie Sun , Min Zhang

Large Language Models (LLMs) have made significant progress in open-ended dialogue, yet their inability to retain and retrieve relevant information from long-term interactions limits their effectiveness in applications requiring sustained…

The recent rise of reasoning-tuned Large Language Models (LLMs)--which generate chains of thought (CoTs) before giving the final answer--has attracted significant attention and offers new opportunities for gaining insights into human label…

计算与语言 · 计算机科学 2025-09-25 Beiduo Chen , Yang Janet Liu , Anna Korhonen , Barbara Plank

Large Language Models (LLMs), such as ChatGPT, exhibit advanced capabilities in generating text, images, and videos. However, their effective use remains constrained by challenges in prompt formulation, personalization, and opaque…

人机交互 · 计算机科学 2025-03-04 Si Thu , A. Baki Kocaballi