English
Related papers

Related papers: Automatic Interactive Evaluation for Large Languag…

200 papers

Large Language Models (LLMs) are transforming mental health care by enhancing accessibility, personalization, and efficiency in therapeutic interventions. These AI-driven tools empower mental health professionals with real-time support,…

Computers and Society · Computer Science 2025-01-22 Hari Mohan Pandey

Training medical personnel using standardized patients (SPs) remains a complex challenge, requiring extensive domain expertise and role-specific practice. Previous research on Large Language Model (LLM)-based SPs mostly focuses on improving…

Computation and Language · Computer Science 2025-06-10 Zhuoyun Du , Lujie Zheng , Renjun Hu , Yuyang Xu , Xiawei Li , Ying Sun , Wei Chen , Jian Wu , Haolei Cai , Haohao Ying

We present a comprehensive evaluation framework for assessing Large Language Models' (LLMs) capabilities in suicide prevention, focusing on two critical aspects: the Identification of Implicit Suicidal ideation (IIS) and the Provision of…

Computation and Language · Computer Science 2026-01-14 Tong Li , Shu Yang , Junchao Wu , Jiyao Wei , Lijie Hu , Mengdi Li , Derek F. Wong , Joshua R. Oltmanns , Di Wang

Simulated Students offer a valuable methodological framework for evaluating pedagogical approaches and modelling diverse learner profiles, tasks which are otherwise challenging to undertake systematically in real-world settings. Recent…

Computers and Society · Computer Science 2025-11-11 Luis Marquez-Carpintero , Alberto Lopez-Sellers , Miguel Cazorla

Large language models (LLMs) show promise for improving the efficiency of qualitative analysis in large, multi-site health-services research. Yet methodological guidance for LLM integration into qualitative analysis and evidence of their…

Computation and Language · Computer Science 2026-01-22 Sasha Ronaghi , Emma-Louise Aveling , Maria Levis , Rachel Lauren Ross , Emily Alsentzer , Sara Singer

Artificial intelligence (AI) has gained significant attention in healthcare consultation due to its potential to improve clinical workflow and enhance medical communication. However, owing to the complex nature of medical information, large…

Computation and Language · Computer Science 2024-03-05 Xiaolan Chen , Ziwei Zhao , Weiyi Zhang , Pusheng Xu , Le Gao , Mingpu Xu , Yue Wu , Yinwen Li , Danli Shi , Mingguang He

The healthcare industry is currently experiencing an unprecedented wave of cybersecurity attacks, impacting millions of individuals. With the discovery of thousands of vulnerabilities each month, there is a pressing need to drive the…

Computation and Language · Computer Science 2024-07-23 Rikhiya Ghosh , Oladimeji Farri , Hans-Martin von Stockhausen , Martin Schmitt , George Marica Vasile

With generative artificial intelligence (AI), particularly large language models (LLMs), continuing to make inroads in healthcare, it is critical to supplement traditional automated evaluations with human evaluations. Understanding and…

Automatic evaluation methods for large language models (LLMs) are hindered by data contamination, leading to inflated assessments of their effectiveness. Existing strategies, which aim to detect contaminated texts, focus on quantifying…

Computation and Language · Computer Science 2024-06-04 Zhuohao Yu , Chang Gao , Wenjin Yao , Yidong Wang , Wei Ye , Jindong Wang , Xing Xie , Yue Zhang , Shikun Zhang

This paper explores the integration of Large Language Models (LLMs) into Automatic Speech Recognition (ASR) systems to improve transcription accuracy. The increasing sophistication of LLMs, with their in-context learning capabilities and…

Computation and Language · Computer Science 2025-06-03 Zeping Min , Jinbo Wang

The safety and reliability of Automated Driving Systems (ADSs) must be validated prior to large-scale deployment. Among existing validation approaches, scenario-based testing has been regarded as a promising method to improve testing…

Software Engineering · Computer Science 2026-01-05 Yongqi Zhao , Ji Zhou , Dong Bi , Tomislav Mihalj , Jia Hu , Arno Eichberger

The integration of voice-based AI agents in healthcare presents a transformative opportunity to bridge economic and accessibility gaps in digital health delivery. This paper explores the role of large language model (LLM)-powered voice…

Artificial Intelligence · Computer Science 2025-07-28 Bo Wen , Chen Wang , Qiwei Han , Raquel Norel , Julia Liu , Thaddeus Stappenbeck , Jeffrey L. Rogers

Natural Language Processing (NLP) and Voice Recognition agents are rapidly evolving healthcare by enabling efficient, accessible, and professional patient support while automating grunt work. This report serves as my self project wherein…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-21 Kabir Kumar

This position paper argues for a fundamental shift in how Large Language Models (LLMs) are integrated into the mental health care domain. We advocate for their role as co-creators rather than mere assistive tools. While LLMs have the…

Human-Computer Interaction · Computer Science 2025-06-03 Abeer Badawi , Md Tahmid Rahman Laskar , Jimmy Xiangji Huang , Shaina Raza , Elham Dolatabadi

Large Language Models (LLMs) have demonstrated surprising performance across various natural language processing tasks. Recently, medical LLMs enhanced with domain-specific knowledge have exhibited excellent capabilities in medical…

Computation and Language · Computer Science 2024-09-24 Jinqiang Wang , Huansheng Ning , Yi Peng , Qikai Wei , Daniel Tesfai , Wenwei Mao , Tao Zhu , Runhe Huang

The integration of Large Language Models (LLMs) into medical applications has sparked widespread interest across the healthcare industry, from drug discovery and development to clinical decision support, assisting telemedicine, medical…

Computation and Language · Computer Science 2024-12-03 Zifeng Wang , Hanyin Wang , Benjamin Danek , Ying Li , Christina Mack , Hoifung Poon , Yajuan Wang , Pranav Rajpurkar , Jimeng Sun

Large language models (LLMs) have shown considerable potential in supporting medical diagnosis. However, their effective integration into clinical workflows is hindered by physicians' difficulties in perceiving and trusting LLM…

Human-Computer Interaction · Computer Science 2026-01-28 Yuansong Xu , Yichao Zhu , Haokai Wang , Yuchen Wu , Yang Ouyang , Hanlu Li , Wenzhe Zhou , Xinyu Liu , Chang Jiang , Quan Li

Large Language Models (LLMs) have demonstrated remarkable performance on various medical question-answering (QA) benchmarks, including standardized medical exams. However, correct answers alone do not ensure correct logic, and models may…

Computation and Language · Computer Science 2025-06-02 Yuexing Hao , Kumail Alhamoud , Hyewon Jeong , Haoran Zhang , Isha Puri , Philip Torr , Mike Schaekermann , Ariel D. Stern , Marzyeh Ghassemi

Interprofessional education has long relied on case studies and the use of standardized patients to support teamwork, communication, and related collaborative competencies among healthcare professionals. However, traditional approaches are…

Emerging Technologies · Computer Science 2026-02-13 Ruijie Wang , Jie Lu , Bo Pei , Evonne Jones , Jamey Brinson , Timothy Brown

Clinical decision-making is inherently complex, often influenced by cognitive biases, incomplete information, and case ambiguity. Large Language Models (LLMs) have shown promise as tools for supporting clinical decision-making, yet their…

Machine Learning · Computer Science 2025-07-10 Burcu Sayin , Ipek Baris Schlicht , Ngoc Vo Hong , Sara Allievi , Jacopo Staiano , Pasquale Minervini , Andrea Passerini