English
Related papers

Related papers: Mitigating Semantic Drift: Evaluating LLMs' Effica…

200 papers

Recent advancements in large language models (LLMs) have shown promise in generating psychotherapeutic dialogues, particularly in the context of motivational interviewing (MI). However, the inherent lack of transparency in LLM outputs…

Computation and Language · Computer Science 2024-12-18 Xin Sun , Xiao Tang , Abdallah El Ali , Zhuying Li , Pengjie Ren , Jan de Wit , Jiahuan Pei , Jos A. Bosch

Motivational interviewing (MI) promotes behavioural change in substance use disorders. Its fidelity is measured using the Motivational Interviewing Treatment Integrity (MITI) framework. While large language models (LLMs) can potentially…

Computation and Language · Computer Science 2026-03-05 Aishwariya Jha , Prakrithi Shivaprakash , Lekhansh Shukla , Animesh Mukherjee , Prabhat Chand , Pratima Murthy

In recent years, Large Language Models (LLMs) have become increasingly more powerful in their ability to complete complex tasks. One such task in which LLMs are often employed is scoring, i.e., assigning a numerical value from a certain…

Computation and Language · Computer Science 2024-12-31 Henry J. Xie , Jinghan Zhang , Xinhao Zhang , Kunpeng Liu

Large language models (LLMs) have shown promising capabilities in healthcare analysis but face several challenges like hallucinations, parroting, and bias manifestation. These challenges are exacerbated in complex, sensitive, and…

Computation and Language · Computer Science 2024-12-18 Vivek Kumar , Eirini Ntoutsi , Pushpraj Singh Rajawat , Giacomo Medda , Diego Reforgiato Recupero

Therapeutic dialogue is not a sequence of isolated responses: client goals, motivation, resistance, and therapeutic alliance evolve over time. Yet current LLM-based mental health dialogue systems often lack explicit mechanisms for tracking…

This study investigates the efficacy of Large Language Models (LLMs) in interactive language therapy for high-functioning autistic adolescents. With the rapid advancement of artificial intelligence, particularly in natural language…

Human-Computer Interaction · Computer Science 2023-11-17 Yujin Cho , Mingeon Kim , Seojin Kim , Oyun Kwon , Ryan Donghan Kwon , Yoonha Lee , Dohyun Lim

What if large language models could not only infer human mindsets but also expose every blind spot in team dialogue such as discrepancies in the team members' joint understanding? We present a novel, two-step framework that leverages large…

Computation and Language · Computer Science 2025-09-03 Katharine Kowalyshyn , Matthias Scheutz

Dialogue summarization is a challenging task with significant practical value in customer service, meeting analysis, and conversational AI. Although large language models (LLMs) have achieved substantial progress in summarization tasks, the…

Computation and Language · Computer Science 2025-07-04 Keyan Jin , Yapeng Wang , Leonel Santos , Tao Fang , Xu Yang , Sio Kei Im , Hugo Gonçalo Oliveira

Large language models (LLMs) have been widely applied in various fields due to their excellent capability for memorizing knowledge and chain of thought (CoT). When these language models are applied in the field of psychological counseling,…

Computation and Language · Computer Science 2023-11-02 Yirong Chen , Xiaofen Xing , Jingkai Lin , Huimin Zheng , Zhenyu Wang , Qi Liu , Xiangmin Xu

Background: Advancements in large language models (LLMs) have opened new possibilities in psychiatric interviews, an underexplored area where LLMs could be valuable. This study focuses on enhancing psychiatric interviews by analyzing…

Artificial Intelligence · Computer Science 2025-02-11 Jae-hee So , Joonhwan Chang , Eunji Kim , Junho Na , JiYeon Choi , Jy-yong Sohn , Byung-Hoon Kim , Sang Hui Chu

Large Language Models (LLMs) have demonstrated impressive capabilities in role-playing scenarios, particularly in simulating domain-specific experts using tailored prompts. This ability enables LLMs to adopt the persona of individuals with…

Artificial Intelligence · Computer Science 2025-01-14 Xinyao Ma , Rui Zhu , Zihao Wang , Jingwei Xiong , Qingyu Chen , Haixu Tang , L. Jean Camp , Lucila Ohno-Machado

Large language models (LLMs) can generate fluent dialogue, but prior works lack situational grounding, dynamic strategy control, and evaluation aligned with clinical standards in motivational interviewing (MI). We introduce StoryMI, a…

Computation and Language · Computer Science 2026-05-28 Qingyu Meng , Min Chen , Dingming Liu , Yifan Mo , Yue Su , Xin Sun , Koen Hindriks , Jiahuan Pei

Background: Motivational interviewing (MI) is an effective counseling approach for promoting health behavior change, but its impact is constrained by the need for highly trained human counselors. Objective: This study aimed to explore a…

Computation and Language · Computer Science 2025-12-18 Run-ze Hu , Yang Yang , Yi-hang Yang , Jing-qi Kong , Jia-hui Luo , Wen-yu Yang , Jing Chen , Jing-yao Liu , Hui-qun Zeng , Lei Zhang , Zheng Liu

Mental health disorders impose a substantial global socioeconomic burden. While large language models (LLMs) offer 24/7, non-judgmental interactions to address this gap, pretrained models lack contextual coherence and emotional alignment…

Computation and Language · Computer Science 2026-02-17 Eric Hua Qing Zhang , Julia Ive

The reasoning capability of large language models (LLMs), defined as their ability to analyze, infer, and make decisions based on input information, is essential for building intelligent task-oriented dialogue systems. However, existing…

Computation and Language · Computer Science 2026-03-02 Yu Zhu , Kai Yang

In task-oriented conversational AI evaluation, unsupervised methods poorly correlate with human judgments, and supervised approaches lack generalization. Recent advances in large language models (LLMs) show robust zeroshot and few-shot…

Computation and Language · Computer Science 2024-06-26 Jinghan Jia , Abi Komma , Timothy Leffel , Xujun Peng , Ajay Nagesh , Tamer Soliman , Aram Galstyan , Anoop Kumar

Automatic open-domain dialogue evaluation has attracted increasing attention, yet remains challenging due to the complexity of assessing response appropriateness. Traditional evaluation metrics, typically trained with true positive and…

Computation and Language · Computer Science 2025-09-17 Bohao Yang , Kun Zhao , Dong Liu , Chen Tang , Liang Zhan , Chenghua Lin

Objectives: While Large Language Models (LLMs) have been widely used to assist clinicians and support patients, no existing work has explored dialogue systems for standard diagnostic interviews and assessments. This study aims to bridge the…

Computation and Language · Computer Science 2025-05-01 Sichang Tu , Abigail Powers , Stephen Doogan , Jinho D. Choi

Do LLMs talk like us? This question intrigues a multitude of scholar and it is relevant in many fields, from education to academia. This work presents an interpretable statistical feature for distinguishing human written and LLMs generated…

Computation and Language · Computer Science 2026-03-23 Riccardo Scantamburlo , Mauro Mezzanzana , Giacomo Buonanno , Francesco Bertolotti

The field of healthcare has increasingly turned its focus towards Large Language Models (LLMs) due to their remarkable performance. However, their performance in actual clinical applications has been underexplored. Traditional evaluations…

‹ Prev 1 2 3 10 Next ›