English
Related papers

Related papers: Modeling Challenging Patient Interactions: LLMs fo…

200 papers

Large language models (LLMs) are increasingly being used in a zero-shot fashion to assess mental health conditions, yet we have limited knowledge on what factors affect their accuracy. In this study, we utilize a clinical dataset of natural…

Large language models (LLMs) are entering clinician workflows, yet evaluations rarely measure how clinician reasoning shapes model behavior during clinical interactions. We combined 61 New England Journal of Medicine Case Records with 92…

The proliferation of Large Language Models (LLMs) in high-stakes applications such as medical (self-)diagnosis and preliminary triage raises significant ethical and practical concerns about the effectiveness, appropriateness, and possible…

Computers and Society · Computer Science 2025-06-18 Bonam Mingole , Aditya Majumdar , Firdaus Ahmed Choudhury , Jennifer L. Kraschnewski , Shyam S. Sundar , Amulya Yadav

Evaluating Large Language Models (LLMs) for mental health support is challenging due to the emotionally and cognitively complex nature of therapeutic dialogue. Existing benchmarks are limited in scale, reliability, often relying on…

Large language models (LLMs) and their variants have shown extraordinary efficacy across numerous downstream natural language processing (NLP) tasks, which has presented a new vision for the development of NLP. Despite their remarkable…

Computation and Language · Computer Science 2024-01-18 Yazhou Zhang , Mengyao Wang , Youxi Wu , Prayag Tiwari , Qiuchi Li , Benyou Wang , Jing Qin

Semi-structured interviews (SSIs) are a commonly employed data-collection method in healthcare research, offering in-depth qualitative insights into subject experiences. Despite their value, the manual analysis of SSIs is notoriously…

Computation and Language · Computer Science 2024-02-06 Satpreet Harcharan Singh , Kevin Jiang , Kanchan Bhasin , Ashutosh Sabharwal , Nidal Moukaddam , Ankit B Patel

Clinical communication skills are critical in medical education, and practicing and assessing clinical communication skills on a scale is challenging. Although LLM-powered clinical scenario simulations have shown promise in enhancing…

Artificial Intelligence · Computer Science 2025-06-16 Weibing Zheng , Laurah Turner , Jess Kropczynski , Murat Ozer , Tri Nguyen , Shane Halse

Large Language Models (LLMs) are increasingly used for mental health support, yet little is known about how people with mental health challenges engage with them, how they evaluate their usefulness, and what design opportunities they…

Human-Computer Interaction · Computer Science 2026-02-12 Aditya Kumar Purohit , Hendrik Heuer

Recent advancements in large language models (LLMs) have shown their potential across both general and domain-specific tasks. However, there is a growing concern regarding their lack of sensitivity, factual incorrectness in responses,…

Computation and Language · Computer Science 2025-12-01 Vivek Kumar , Pushpraj Singh Rajawat , Eirini Ntoutsi

The field of healthcare has increasingly turned its focus towards Large Language Models (LLMs) due to their remarkable performance. However, their performance in actual clinical applications has been underexplored. Traditional evaluations…

Large Language Models (LLMs) are increasingly deployed in socially complex, interaction-driven tasks, yet their ability to mirror human behavior in emotionally and strategically complex contexts remains underexplored. This study assesses…

Computation and Language · Computer Science 2025-09-23 Deuksin Kwon , Kaleen Shrestha , Bin Han , Elena Hayoung Lee , Gale Lucas

Large Language Models (LLMs) are increasingly deployed in high-stakes domains such as clinical decision support and medical documentation. However, the robustness of these models against subtle linguistic variations, specifically…

Computation and Language · Computer Science 2026-05-19 Jen-tse Huang , Didi Zhou , Faith Kamau , Amy Oh , Anne R. Links , Mark Dredze , Mary Catherine Beach , Somnath Saha

The emergence of large language models (LLMs) like ChatGPT has increased interest in their use as therapists to address mental health challenges and the widespread lack of access to care. However, experts have emphasized the critical need…

Computation and Language · Computer Science 2024-12-02 Yu Ying Chiu , Ashish Sharma , Inna Wanyin Lin , Tim Althoff

Medical consultations are intrinsically speech-centric. However, most prior works focus on long-text-based interactions, which are cumbersome and patient-unfriendly. Recent advances in speech language models (SpeechLMs) have enabled more…

Computation and Language · Computer Science 2026-04-21 Sirry Chen , Jieyi Wang , Wei Chen , Zhongyu Wei

The latest large language models (LLMs) such as ChatGPT, exhibit strong capabilities in automated mental health analysis. However, existing relevant studies bear several limitations, including inadequate evaluations, lack of prompting…

Computation and Language · Computer Science 2024-10-03 Kailai Yang , Shaoxiong Ji , Tianlin Zhang , Qianqian Xie , Ziyan Kuang , Sophia Ananiadou

Background: Simulated patient systems are important in medical education and research, providing safe, integrative training environments and supporting clinical decision making. Advances in artificial intelligence (AI), especially large…

Digital health analytics face critical challenges nowadays. The sophisticated analysis of patient-generated health content, which contains complex emotional and medical contexts, requires scarce domain expertise, while traditional ML…

Large language models (LLMs) show promise in clinical decision support yet risk acquiescing to patient pressure for inappropriate care. We introduce SycoEval-EM, a multi-agent simulation framework evaluating LLM robustness through…

Artificial Intelligence · Computer Science 2026-03-05 Dongshen Peng , Yi Wang , Austin Schoeffler , Carl Preiksaitis , Christian Rose

The shortage of doctors is creating a critical squeeze in access to medical expertise. While conversational Artificial Intelligence (AI) holds promise in addressing this problem, its safe deployment in patient-facing roles remains largely…

Artificial Intelligence · Computer Science 2025-04-11 Antoine Lizée , Pierre-Auguste Beaucoté , James Whitbeck , Marion Doumeingts , Anaël Beaugnon , Isabelle Feldhaus

Large Language Models (LLMs) demonstrate increasing conversational fluency, yet instilling them with nuanced, human-like emotional expression remains a significant challenge. Current alignment techniques often address surface-level output…

Computation and Language · Computer Science 2025-11-25 Niranjan Chebrolu , Gerard Christopher Yeo , Kokil Jaidka