English
Related papers

Related papers: Evaluating Role-Consistency in LLMs for Counselor …

200 papers

The conformity effect describes the tendency of individuals to align their responses with the majority. Studying this bias in large language models (LLMs) is crucial, as LLMs are increasingly used in various information-seeking and…

Computation and Language · Computer Science 2025-05-27 Xiaochen Zhu , Caiqi Zhang , Tom Stafford , Nigel Collier , Andreas Vlachos

Continual learning (CL) has emerged as a pivotal paradigm to enable large language models (LLMs) to dynamically adapt to evolving knowledge and sequential tasks while mitigating catastrophic forgetting-a critical limitation of the static…

Computation and Language · Computer Science 2026-03-16 Hongyang Chen , Zhongwu Sun , Hongfei Ye , Kunchi Li , Xuemin Lin

As the importance of comprehensive evaluation in workshop courses increases, there is a growing demand for efficient and fair assessment methods that reduce the workload for faculty members. This paper presents an evaluation conducted with…

Computers and Society · Computer Science 2024-05-30 Toru Ishida , Tongxi Liu , Hailong Wang , William K. Cheung

Decision conferences are structured, collaborative meetings that bring together experts from various fields to address complex issues and reach a consensus on recommendations for future actions or policies. These conferences often rely on…

Computation and Language · Computer Science 2025-07-14 Selina Heller , Mohamed Ibrahim , David Antony Selby , Sebastian Vollmer

Existing large language models (LLMs) evaluation methods typically focus on testing the performance on some closed-environment and domain-specific benchmarks with human annotations. In this paper, we explore a novel unsupervised evaluation…

Computation and Language · Computer Science 2025-02-24 Kun-Peng Ning , Shuo Yang , Yu-Yang Liu , Jia-Yu Yao , Zhen-Hui Liu , Yong-Hong Tian , Yibing Song , Li Yuan

Large language models (LLMs) are promising tools for supporting security management tasks, such as incident response planning. However, their unreliability and tendency to hallucinate remain significant challenges. In this paper, we address…

Artificial Intelligence · Computer Science 2026-02-06 Kim Hammar , Tansu Alpcan , Emil Lupu

Video language continual learning involves continuously adapting to information from video and text inputs, enhancing a model's ability to handle new tasks while retaining prior knowledge. This field is a relatively under-explored area, and…

Artificial Intelligence · Computer Science 2024-12-17 Tianqi Tang , Shohreh Deldari , Hao Xue , Celso De Melo , Flora D. Salim

Outpatient referral (OR) is a core clinical workflow that assigns patients to hospital departments under incomplete and evolving information, yet it is commonly simplified as a static classification problem despite being inherently…

Computation and Language · Computer Science 2026-05-21 Xiaoxiao Liu , Qingying Xiao , Bingquan Zhang , Junying Chen , Xiangyi Feng , Ziniu Li , Xiang Wan , Jian Chang , Guangjun Yu , Yan Hu , Benyou Wang

Mental health care poses an increasingly serious challenge to modern societies. In this context, there has been a surge in research that utilizes information technologies to address mental health problems, including those aiming to develop…

Computation and Language · Computer Science 2024-02-21 Michimasa Inaba , Mariko Ukiyo , Keiko Takamizo

Large Language Models (LLMs) have revolutionized Natural Language Processing but exhibit limitations, particularly in autonomously addressing novel challenges such as reasoning and problem-solving. Traditional techniques like…

Multiagent Systems · Computer Science 2024-01-03 Sumedh Rasal

People often encounter role conflicts -- social dilemmas where the expectations of multiple roles clash and cannot be simultaneously fulfilled. As large language models (LLMs) increasingly navigate these social dynamics, a critical research…

Computation and Language · Computer Science 2026-04-20 Jisu Shin , Hoyun Song , Juhyun Oh , Changgeon Ko , Eunsu Kim , Chani Jung , Alice Oh

Conversational question-answering (CQA) systems aim to create interactive search systems that effectively retrieve information by interacting with users. To replicate human-to-human conversations, existing work uses human annotators to play…

Computation and Language · Computer Science 2023-12-06 Zahra Abbasiantaeb , Yifei Yuan , Evangelos Kanoulas , Mohammad Aliannejadi

Effective communication training is essential to preparing nurses for high-quality patient care. While standardized patient (SP) simulations provide valuable experiential learning, they are often costly and inflexible. Virtual patient (VP)…

Computation and Language · Computer Science 2025-06-03 Keyeun Lee , Seolhee Lee , Esther Hehsun Kim , Yena Ko , Jinsu Eun , Dahee Kim , Hyewon Cho , Haiyi Zhu , Robert E. Kraut , Eunyoung Suh , Eun-mee Kim , Hajin Lim

Large Language Models (LLMs) have increasingly demonstrated the ability to facilitate the development of multi-agent systems that allow the interpretation of thoughts and actions generated by each individual. Promising advancements have…

Multiagent Systems · Computer Science 2024-09-24 Asher Sprigler , Alexander Drobek , Keagan Weinstock , Wendpanga Tapsoba , Gavin Childress , Andy Dao , Lucas Gral

Large language models (LLMs) often need to balance their internal parametric knowledge with external information, such as user beliefs and content from retrieved documents, in real-world scenarios like RAG or chat-based systems. A model's…

Computation and Language · Computer Science 2026-04-27 Shuowei Li , Haoxin Li , Wenda Chu , Yi Fang

The advancement of Large Language Models (LLMs) has led to significant improvements in various service domains, including search, recommendation, and chatbot applications. However, applying state-of-the-art (SOTA) research to industrial…

Computation and Language · Computer Science 2025-05-30 Chiwan Park , Wonjun Jang , Daeryong Kim , Aelim Ahn , Kichang Yang , Woosung Hwang , Jihyeon Roh , Hyerin Park , Hyosun Wang , Min Seok Kim , Jihoon Kang

Large Language Models (LLMs) have emerged as powerful tools for automating complex reasoning and decision-making tasks. In telecommunications, they hold the potential to transform network optimization, automate troubleshooting, enhance…

Objectives: While Large Language Models (LLMs) have been widely used to assist clinicians and support patients, no existing work has explored dialogue systems for standard diagnostic interviews and assessments. This study aims to bridge the…

Computation and Language · Computer Science 2025-05-01 Sichang Tu , Abigail Powers , Stephen Doogan , Jinho D. Choi

There is an growing interest in using Large Language Models (LLMs) in multi-agent systems to tackle interactive real-world tasks that require effective collaboration and assessing complex situations. Yet, we still have a limited…

Computation and Language · Computer Science 2024-06-11 Sahar Abdelnabi , Amr Gomaa , Sarath Sivaprasad , Lea Schönherr , Mario Fritz

As libraries explore large language models (LLMs) for use in virtual reference services, a key question arises: Can LLMs serve all users equitably, regardless of demographics or social status? While they offer great potential for scalable…

Computation and Language · Computer Science 2025-11-24 Haining Wang , Jason Clark , Yueru Yan , Star Bradley , Ruiyang Chen , Yiqiong Zhang , Hengyi Fu , Zuoyu Tian