中文
相关论文

相关论文: Evaluating Role-Consistency in LLMs for Counselor …

200 篇论文

Large Language Models (LLMs) are increasingly used to simulate how specific users respond to a given context, enabling more user-centric applications that rely on user feedback. However, existing user simulators mostly imitate surface-level…

Although engagement in self-directed wellness exercises typically declines over time, integrating social support such as coaching can sustain it. However, traditional forms of support are often inaccessible due to the high costs and complex…

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

计算与语言 · 计算机科学 2026-01-21 Md Talha Mohsin

Large Language Models (LLMs) exhibit remarkable fluency and competence across various natural language tasks. However, recent research has highlighted their sensitivity to variations in input prompts. To deploy LLMs in a safe and reliable…

计算与语言 · 计算机科学 2025-04-30 Harsh Raj , Vipul Gupta , Domenic Rosati , Subhabrata Majumdar

Large Language Models (LLMs) acting as artificial agents offer the potential for scalable behavioral research, yet their validity depends on whether LLMs can maintain stable personas across extended conversations. We address this point…

人机交互 · 计算机科学 2026-05-21 Jana Gonnermann-Müller , Jennifer Haase , Nicolas Leins , Thomas Kosch , Sebastian Pokutta

Background: Large Language Models (LLMs) are transforming artificial intelligence applications in healthcare due to their ability to understand, generate, and summarize complex medical text. They offer valuable support to clinicians,…

计算与语言 · 计算机科学 2026-04-14 Subin Santhosh , Farwa Abbas , Hussain Ahmad , Claudia Szabo

With extensive pre-trained knowledge and high-level general capabilities, large language models (LLMs) emerge as a promising avenue to augment reinforcement learning (RL) in aspects such as multi-task learning, sample efficiency, and…

机器学习 · 计算机科学 2024-11-21 Yuji Cao , Huan Zhao , Yuheng Cheng , Ting Shu , Yue Chen , Guolong Liu , Gaoqi Liang , Junhua Zhao , Jinyue Yan , Yun Li

This paper introduces the Word Synchronization Challenge, a novel benchmark to evaluate large language models (LLMs) in Human-Computer Interaction (HCI). This benchmark uses a dynamic game-like framework to test LLMs ability to mimic human…

人机交互 · 计算机科学 2026-01-15 Tanguy Cazalets , Joni Dambre

Role-playing is important for Large Language Models (LLMs) to follow diverse instructions while maintaining role identity and the role's pre-defined ability limits. Existing role-playing datasets mostly contribute to controlling role style…

计算与语言 · 计算机科学 2025-02-18 Junru Lu , Jiazheng Li , Guodong Shen , Lin Gui , Siyu An , Yulan He , Di Yin , Xing Sun

Employing large language models (LLMs) to enable embodied agents has become popular, yet it presents several limitations in practice. In this work, rather than using LLMs directly as agents, we explore their use as tools for embodied agent…

人工智能 · 计算机科学 2024-11-28 Yujeong Lee , Sangwoo Shin , Wei-Jin Park , Honguk Woo

Learning therapeutic counseling involves significant role-play experience with mock patients, with current manual training methods providing only intermittent granular feedback. We seek to accelerate and optimize counselor training by…

人机交互 · 计算机科学 2025-02-27 Ian Steenstra , Farnaz Nouraei , Timothy W. Bickmore

The increasing use of large language models (LLMs) in mental healthcare raises safety concerns in high-stakes therapeutic interactions. A key challenge is distinguishing therapeutic empathy from maladaptive validation, where supportive…

计算与语言 · 计算机科学 2026-04-07 Qingyang Xu , Yaling Shen , Stephanie Fong , Zimu Wang , Yiwen Jiang , Xiangyu Zhao , Jiahe Liu , Zhongxing Xu , Vincent Lee , Zongyuan Ge

Task-oriented conversational systems are essential for efficiently addressing diverse user needs, yet their development requires substantial amounts of high-quality conversational data that is challenging and costly to obtain. While large…

信息检索 · 计算机科学 2025-11-06 Zhefan Wang , Ning Geng , Zhiqiang Guo , Weizhi Ma , Min Zhang

Large Language Models (LLMs) are increasingly deployed in socially complex, interaction-driven tasks, yet their ability to mirror human behavior in emotionally and strategically complex contexts remains underexplored. This study assesses…

计算与语言 · 计算机科学 2025-09-23 Deuksin Kwon , Kaleen Shrestha , Bin Han , Elena Hayoung Lee , Gale Lucas

Using Large Language Models (LLMs) to simulate user opinions has received growing attention. Yet LLMs, especially trained with reinforcement learning from human feedback (RLHF), are known to exhibit biases toward dominant viewpoints,…

计算与语言 · 计算机科学 2025-12-09 Ziyun Yu , Yiru Zhou , Chen Zhao , Hongyi Wen

Simulating high quality user behavior data has always been a fundamental problem in human-centered applications, where the major difficulty originates from the intricate mechanism of human decision process. Recently, substantial evidences…

Large language models (LLMs) exhibit remarkable performance improvement through in-context learning (ICL) by leveraging task-specific examples in the input. However, the mechanisms behind this improvement remain elusive. In this work, we…

计算与语言 · 计算机科学 2024-02-23 Safoora Yousefi , Leo Betthauser , Hosein Hasanbeig , Raphaël Millière , Ida Momennejad

Recommender systems are widely used in online services, with embedding-based models being particularly popular due to their expressiveness in representing complex signals. However, these models often function as a black box, making them…

信息检索 · 计算机科学 2024-06-25 Yuxuan Lei , Jianxun Lian , Jing Yao , Xu Huang , Defu Lian , Xing Xie

In second language learning, scenario-based conversation practice is important for language learners to achieve fluency in speaking, but students often lack sufficient opportunities to practice their conversational skills with qualified…

计算与语言 · 计算机科学 2024-04-01 Shuyao Xu , Long Qin , Tianyang Chen , Zhenzhou Zha , Bingxue Qiu , Weizhi Wang

Achieving consensus in group decision-making often involves overcoming significant challenges, particularly in reconciling diverse perspectives and mitigating biases that hinder agreement. Traditional methods relying on human facilitators…

人机交互 · 计算机科学 2025-03-21 Loukas Triantafyllopoulos , Dimitris Kalles