English
Related papers

Related papers: TherapyGym: Evaluating and Aligning Clinical Fidel…

200 papers

We investigate the role of large language models (LLMs) in supporting mental health by analyzing Reddit posts and comments about mental health conversations with ChatGPT. Our findings reveal that users value ChatGPT as a safe,…

Human-Computer Interaction · Computer Science 2025-10-28 Kyuha Jung , Gyuho Lee , Yuanhui Huang , Yunan Chen

Recent advancements in large language models (LLMs) promise to expand mental health interventions by emulating therapeutic techniques, potentially easing barriers to care. Yet there is a lack of real-world empirical evidence evaluating the…

Human-Computer Interaction · Computer Science 2025-01-28 Yinzhou Wang , Yimeng Wang , Ye Xiao , Liabette Escamilla , Bianca Augustine , Kelly Crace , Gang Zhou , Yixuan Zhang

Large language models are being deployed as mental health support agents at scale, yet only 16% of LLM-based chatbot interventions have undergone rigorous clinical efficacy testing, and simulations reveal psychological deterioration in over…

Computation and Language · Computer Science 2026-04-28 Suhas BN , Andrew M. Sherrill , Rosa I. Arriaga , Chris W. Wiese , Saeed Abdullah

There is an increasing interest in developing LLMs for medical diagnosis to improve diagnosis efficiency. Despite their alluring technological potential, there is no unified and comprehensive evaluation criterion, leading to the inability…

Computation and Language · Computer Science 2023-08-16 Xiaoming Shi , Jie Xu , Jinru Ding , Jiali Pang , Sichen Liu , Shuqing Luo , Xingwei Peng , Lu Lu , Haihong Yang , Mingtao Hu , Tong Ruan , Shaoting Zhang

The increasing trust in large language models (LLMs), especially in the form of chatbots, is often undermined by the lack of their extrinsic evaluation. This holds particularly true in nutrition, where randomised controlled trials (RCTs)…

Human-Computer Interaction · Computer Science 2025-11-27 Karen Jia-Hui Li , Simone Balloccu , Ondrej Dusek , Ehud Reiter

Despite the growing use of large language models (LLMs) in clinical dialogue systems, existing evaluations focus on task completion or fluency, offering little insight into the behavioral and risk management requirements essential for…

Many people suffer from mental health problems but not everyone seeks professional help or has access to mental health care. AI chatbots have increasingly become a go-to for individuals who either have mental disorders or simply want…

Other Quantitative Biology · Quantitative Biology 2025-11-03 Aditya Naik , Jovi Thomas , Teja Sree Mandava , Himavanth Reddy Vemula

The remarkable capabilities of Large Language Models (LLMs) make them increasingly compelling for adoption in real-world healthcare applications. However, the risks associated with using LLMs in medical applications have not been…

Empowering chatbots in the field of mental health is receiving increasing amount of attention, while there still lacks exploration in developing and evaluating chatbots in psychiatric outpatient scenarios. In this work, we focus on…

Computation and Language · Computer Science 2023-05-24 Siyuan Chen , Mengyue Wu , Kenny Q. Zhu , Kunyao Lan , Zhiling Zhang , Lyuchun Cui

As mental health chatbots proliferate to address the global treatment gap, a critical question emerges: How do we design for relational safety the quality of interaction patterns that unfold across conversations rather than the correctness…

Human-Computer Interaction · Computer Science 2026-02-27 Joydeep Chandra , Satyam Kumar Navneet , Yong Zhang

Large language model-powered chatbots have transformed how people seek information, especially in high-stakes contexts like mental health. Despite their support capabilities, safe detection and response to crises such as suicidal ideation…

Computation and Language · Computer Science 2026-04-09 Adrian Arnaiz-Rodriguez , Miguel Baidal , Erik Derner , Jenn Layton Annable , Mark Ball , Mark Ince , Elvira Perez Vallejos , Nuria Oliver

Training mental health clinicians to conduct standardized clinical assessments is challenging due to a lack of scalable, realistic practice opportunities, which can impact data quality in clinical trials. To address this gap, we introduce a…

Human-Computer Interaction · Computer Science 2025-12-30 Veronica Bossio Botero , Vijay Yadav , Jacob Ouyang , Anzar Abbas , Michelle Worthington

Background: Large Language Models (LLMs) are transforming artificial intelligence applications in healthcare due to their ability to understand, generate, and summarize complex medical text. They offer valuable support to clinicians,…

Computation and Language · Computer Science 2026-04-14 Subin Santhosh , Farwa Abbas , Hussain Ahmad , Claudia Szabo

Large Language Models (LLMs) have demonstrated remarkable performance across various information-seeking and reasoning tasks. These computational systems drive state-of-the-art dialogue systems, such as ChatGPT and Bard. They also carry…

Computation and Language · Computer Science 2023-10-13 Siyuan Brandon Loh , Aravind Sesagiri Raamkumar

The emergence of generative AI chatbots such as ChatGPT has prompted growing public and academic interest in their role as informal mental health support tools. While early rule-based systems have been around for several years, large…

Computation and Language · Computer Science 2025-04-18 Anna-Carolina Haensch

The integration of Large Language Models (LLMs) into healthcare settings has gained significant attention, particularly for question-answering tasks. Given the high-stakes nature of healthcare, it is essential to ensure that LLM-generated…

As large language models (LLMs) increasingly mediate emotionally sensitive conversations, especially in mental health contexts, their ability to recognize and respond to high-risk situations becomes a matter of public safety. This study…

This paper presents ChatCounselor, a large language model (LLM) solution designed to provide mental health support. Unlike generic chatbots, ChatCounselor is distinguished by its foundation in real conversations between consulting clients…

Computation and Language · Computer Science 2023-09-28 June M. Liu , Donghao Li , He Cao , Tianhe Ren , Zeyi Liao , Jiamin Wu

Understanding how large language models (LLMs) process emotionally sensitive content is critical for building safe and reliable systems, particularly in mental health contexts. We investigate the scaling behavior of LLMs on two key tasks:…

Computation and Language · Computer Science 2025-09-08 Edoardo Pinzuti , Oliver Tüscher , André Ferreira Castro