English
Related papers

Related papers: Benchmarking Motivational Interviewing Competence …

200 papers

To solve complex tasks, large language models (LLMs) often require multiple rounds of interactions with the user, sometimes assisted by external tools. However, current evaluation protocols often emphasize benchmark performance with…

Computation and Language · Computer Science 2024-03-13 Xingyao Wang , Zihan Wang , Jiateng Liu , Yangyi Chen , Lifan Yuan , Hao Peng , Heng Ji

Large language models (LLMs) excel on many NLP benchmarks, but their behavior on real-world, semi-structured prediction remains underexplored. We present LlaMADRS, a benchmark for structured clinical assessment from dialogue built on the…

Human-Computer Interaction · Computer Science 2026-04-23 Gaoussou Youssouf Kebe , Jeffrey M. Girard , Einat Liebenthal , Justin Baker , Fernando De la Torre , Louis-Philippe Morency

The field of large language models (LLMs) has made significant progress, and their knowledge storage capacity is approaching that of human beings. Furthermore, advanced techniques, such as prompt learning and reinforcement learning, are…

Computation and Language · Computer Science 2023-08-01 Keyu Pan , Yawen Zeng

This study investigates the efficacy of Large Language Models (LLMs) in interactive language therapy for high-functioning autistic adolescents. With the rapid advancement of artificial intelligence, particularly in natural language…

Human-Computer Interaction · Computer Science 2023-11-17 Yujin Cho , Mingeon Kim , Seojin Kim , Oyun Kwon , Ryan Donghan Kwon , Yoonha Lee , Dohyun Lim

The emergence of large language models (LLMs) like ChatGPT has increased interest in their use as therapists to address mental health challenges and the widespread lack of access to care. However, experts have emphasized the critical need…

Computation and Language · Computer Science 2024-12-02 Yu Ying Chiu , Ashish Sharma , Inna Wanyin Lin , Tim Althoff

The conversational capabilities of Large Language Models (LLMs) suggest that they may be able to perform as automated talk therapists. It is crucial to know if these systems would be effective and adhere to known standards. We present a…

Objective Structured Clinical Examinations (OSCEs) are widely used to assess medical students' communication skills, but scoring interview-based assessments is time-consuming and potentially subject to human bias. This study explored the…

Computation and Language · Computer Science 2025-05-16 Jadon Geathers , Yann Hicke , Colleen Chan , Niroop Rajashekar , Justin Sewell , Susannah Cornes , Rene F. Kizilcec , Dennis Shung

Understanding the conversation abilities of Large Language Models (LLMs) can help lead to its more cautious and appropriate deployment. This is especially important for safety-critical domains like mental health, where someone's life may…

Computation and Language · Computer Science 2024-03-18 Alexander Marrapese , Basem Suleiman , Imdad Ullah , Juno Kim

Background: Advances in artificial intelligence, particularly large language models (LLMs), have the potential to enhance technical expertise in magnetic resonance imaging (MRI), regardless of operator skill or geographic location. Methods:…

Medical Physics · Physics 2024-11-20 Alan B McMillan

Large Language Models (LLMs) have demonstrated impressive capabilities in role-playing scenarios, particularly in simulating domain-specific experts using tailored prompts. This ability enables LLMs to adopt the persona of individuals with…

Artificial Intelligence · Computer Science 2025-01-14 Xinyao Ma , Rui Zhu , Zihao Wang , Jingwei Xiong , Qingyu Chen , Haixu Tang , L. Jean Camp , Lucila Ohno-Machado

Large language models (LLMs) have shown promising capabilities in healthcare analysis but face several challenges like hallucinations, parroting, and bias manifestation. These challenges are exacerbated in complex, sensitive, and…

Computation and Language · Computer Science 2024-12-18 Vivek Kumar , Eirini Ntoutsi , Pushpraj Singh Rajawat , Giacomo Medda , Diego Reforgiato Recupero

Large language models (LLMs) exhibit expert-level performance in tasks across a wide range of different domains. Ethical issues raised by LLMs and the need to align future versions makes it important to know how state of the art models…

Artificial Intelligence · Computer Science 2024-05-24 Guilherme F. C. F. Almeida , José Luiz Nunes , Neele Engelmann , Alex Wiegmann , Marcelo de Araújo

Large Language Models (LLMs) have demonstrated an alarming ability to impersonate humans in conversation, raising concerns about their potential misuse in scams and deception. Humans have a right to know if they are conversing to an LLM. We…

Computation and Language · Computer Science 2024-12-23 Gilad Gressel , Rahul Pankajakshan , Yisroel Mirsky

Large Language Models (LLMs) are demonstrating remarkable human like capabilities across diverse domains, including psychological assessment. This study evaluates whether LLMs, specifically GPT-4o and GPT-4o mini, can infer Big Five…

Computation and Language · Computer Science 2025-01-14 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

In recent years, Large Language Models (LLMs) have become increasingly more powerful in their ability to complete complex tasks. One such task in which LLMs are often employed is scoring, i.e., assigning a numerical value from a certain…

Computation and Language · Computer Science 2024-12-31 Henry J. Xie , Jinghan Zhang , Xinhao Zhang , Kunpeng Liu

Large Language Models (LLMs) have demonstrated human-like capabilities in language comprehension and generation, becoming active participants in social and cognitive domains. This study investigates whether LLMs exhibit personality-like…

Computation and Language · Computer Science 2025-05-22 Wang Jiaqi , Wang bo , Guo fa , Cheng cheng , Yang li

There is a significant gap between patient needs and available mental health support today. In this paper, we aim to thoroughly examine the potential of using Large Language Models (LLMs) to assist professional psychotherapy. To this end,…

Computation and Language · Computer Science 2025-01-28 Mian Zhang , Xianjun Yang , Xinlu Zhang , Travis Labrum , Jamie C. Chiu , Shaun M. Eack , Fei Fang , William Yang Wang , Zhiyu Zoey Chen

The advent of large language models (LLMs) has revolutionized natural language processing, enabling the generation of coherent and contextually relevant human-like text. As LLMs increasingly powerconversational agents used by the general…

Mental health disorders are increasingly prevalent worldwide, creating an urgent need for innovative tools to support early diagnosis and intervention. This study explores the potential of Large Language Models (LLMs) in multimodal mental…

Computation and Language · Computer Science 2025-08-14 Abdelrahman A. Ali , Aya E. Fouda , Radwa J. Hanafy , Mohammed E. Fouda

Large Language Models (LLMs) have demonstrated surprising performance across various natural language processing tasks. Recently, medical LLMs enhanced with domain-specific knowledge have exhibited excellent capabilities in medical…

Computation and Language · Computer Science 2024-09-24 Jinqiang Wang , Huansheng Ning , Yi Peng , Qikai Wei , Daniel Tesfai , Wenwei Mao , Tao Zhu , Runhe Huang