English
Related papers

Related papers: Automatic Interactive Evaluation for Large Languag…

200 papers

Large language models (LLMs) are emerging as promising tools for mental health care, offering scalable support through their ability to generate human-like responses. However, the effectiveness of these models in clinical settings remains…

Artificial Intelligence · Computer Science 2024-08-22 Yining Hua , Hongbin Na , Zehan Li , Fenglin Liu , Xiao Fang , David Clifton , John Torous

Large language models (LLMs) have achieved significant success in interacting with human. However, recent studies have revealed that these models often suffer from hallucinations, leading to overly confident but incorrect judgments. This…

Computation and Language · Computer Science 2023-09-06 Yusheng Liao , Yutong Meng , Hongcheng Liu , Yanfeng Wang , Yu Wang

With the rapid development of artificial intelligence, large language models (LLMs) have shown promising capabilities in mimicking human-level language comprehension and reasoning. This has sparked significant interest in applying LLMs to…

Computation and Language · Computer Science 2023-11-06 Mingze Yuan , Peng Bao , Jiajia Yuan , Yunhao Shen , Zifan Chen , Yi Xie , Jie Zhao , Yang Chen , Li Zhang , Lin Shen , Bin Dong

The shortage of clinical workforce presents significant challenges in mental healthcare, limiting access to formal diagnostics and services. We aim to tackle this shortage by integrating a customized large language model (LLM) into the…

Computation and Language · Computer Science 2025-05-02 Sichang Tu , Abigail Powers , Natalie Merrill , Negar Fani , Sierra Carter , Stephen Doogan , Jinho D. Choi

Large Language Models (LLMs) have demonstrated impressive capabilities in role-playing scenarios, particularly in simulating domain-specific experts using tailored prompts. This ability enables LLMs to adopt the persona of individuals with…

Artificial Intelligence · Computer Science 2025-01-14 Xinyao Ma , Rui Zhu , Zihao Wang , Jingwei Xiong , Qingyu Chen , Haixu Tang , L. Jean Camp , Lucila Ohno-Machado

This paper presents an innovative large language model (LLM) agent framework for enhancing diagnostic accuracy in simulated clinical environments using the AgentClinic benchmark. The proposed automatic correction enables doctor agents to…

Artificial Intelligence · Computer Science 2024-10-15 Abhishek Dutta , Yen-Che Hsiao

Recognizing daily activities with unobtrusive sensors in smart environments enables various healthcare applications. Monitoring how subjects perform activities at home and their changes over time can reveal early symptoms of health issues,…

Human-Computer Interaction · Computer Science 2024-08-14 Michele Fiori , Gabriele Civitarese , Claudio Bettini

Simulations, although powerful in accurately replicating real-world systems, often remain inaccessible to non-technical users due to their complexity. Conversely, large language models (LLMs) provide intuitive, language-based interactions…

Computation and Language · Computer Science 2025-05-22 Jacob Kleiman , Kevin Frank , Joseph Voyles , Sindy Campagna

With the advent of Large Language Models (LLMs), medical artificial intelligence (AI) has experienced substantial technological progress and paradigm shifts, highlighting the potential of LLMs to streamline healthcare delivery and improve…

Computation and Language · Computer Science 2024-12-10 Lei Liu , Xiaoyan Yang , Junchi Lei , Yue Shen , Jian Wang , Peng Wei , Zhixuan Chu , Zhan Qin , Kui Ren

Objective Structured Clinical Examinations (OSCEs) are essential for medical training, but they require significant resources, including professional actors and expert medical feedback. Although Large Language Models (LLMs) have introduced…

Human-Computer Interaction · Computer Science 2025-08-20 Henrik Voigt , Yurina Sugamiya , Kai Lawonn , Sina Zarrieß , Atsuo Takanishi

This paper explores the potential of using Large Language Models (LLMs) to automate the evaluation of responses in medical Question and Answer (Q\&A) systems, a crucial form of Natural Language Processing. Traditionally, human evaluation…

Computation and Language · Computer Science 2024-09-04 Jack Krolik , Herprit Mahal , Feroz Ahmad , Gaurav Trivedi , Bahador Saket

Central to agentic capability and trustworthiness of language model agents (LMAs) is the extent they maintain stable, reliable, identity over time. However, LMAs inherit pathologies from large language models (LLMs) (statelessness,…

Artificial Intelligence · Computer Science 2025-07-24 Elija Perrier , Michael Timothy Bennett

Large Language Models (LLMs) are increasingly utilized for mental health support; however, current safety benchmarks often fail to detect the complex, longitudinal risks inherent in therapeutic dialogue. We introduce an evaluation framework…

Computation and Language · Computer Science 2026-03-06 Ian Steenstra , Paola Pedrelli , Weiyan Shi , Stacy Marsella , Timothy W. Bickmore

Digital health tools have the potential to significantly improve the delivery of healthcare services. However, their adoption remains comparatively limited due, in part, to challenges surrounding usability and trust. Large Language Models…

Computation and Language · Computer Science 2024-03-01 Fergus Imrie , Paulius Rauba , Mihaela van der Schaar

Accurate disease prediction is vital for timely intervention, effective treatment, and reducing medical complications. While symbolic AI has been applied in healthcare, its adoption remains limited due to the effort required for…

Artificial Intelligence · Computer Science 2026-01-01 Ioanna Gemou , Evangelos Lamprou

The rapid advancements in large language models (LLMs) have opened up new opportunities for transforming patient engagement in healthcare through conversational AI. This paper presents an overview of the current landscape of LLMs in…

Artificial Intelligence · Computer Science 2024-11-27 Bo Wen , Raquel Norel , Julia Liu , Thaddeus Stappenbeck , Farhana Zulkernine , Huamin Chen

The implementation of Artificial Intelligence (AI) in the healthcare industry has garnered considerable attention, attributable to its prospective enhancement of clinical outcomes, expansion of access to superior healthcare, cost reduction,…

Computation and Language · Computer Science 2024-08-23 Arindam Sett , Somaye Hashemifar , Mrunal Yadav , Yogesh Pandit , Mohsen Hejrati

Large Language Models (LLMs) can justify or critique their predictions through discussions with other models or humans, thereby enriching their intrinsic understanding of instances. While proactive discussions in the inference phase have…

Computation and Language · Computer Science 2024-03-04 Mengsay Loem , Masahiro Kaneko , Naoaki Okazaki

Rapid integration of large language models (LLMs) in health care is sparking global discussion about their potential to revolutionize health care quality and accessibility. At a time when improving health care quality and access remains a…

Computers and Society · Computer Science 2025-04-01 Troy Zada , Natalie Tam , Francois Barnard , Marlize Van Sittert , Venkat Bhat , Sirisha Rambhatla