English
Related papers

Related papers: Large Language Models for Medical OSCE Assessment:…

200 papers

Digital health analytics face critical challenges nowadays. The sophisticated analysis of patient-generated health content, which contains complex emotional and medical contexts, requires scarce domain expertise, while traditional ML…

This study explores the application of Large Language Models (LLMs), specifically GPT-4, in the analysis of classroom dialogue, a crucial research task for both teaching diagnosis and quality improvement. Recognizing the knowledge-intensive…

Computation and Language · Computer Science 2024-10-08 Yun Long , Haifeng Luo , Yu Zhang

Effective patient-provider communication is crucial in clinical care, directly impacting patient outcomes and quality of life. Traditional evaluation methods, such as human ratings, patient feedback, and provider self-assessments, are often…

Computation and Language · Computer Science 2024-09-25 Zhiyuan Wang , Fangxu Yuan , Virginia LeBaron , Tabor Flickinger , Laura E. Barnes

Large language models (LLMs) have emerged as powerful tools with transformative potential across numerous domains, including healthcare and medicine. In the medical domain, LLMs hold promise for tasks ranging from clinical decision support…

Computation and Language · Computer Science 2024-05-14 Xiaolan Chen , Jiayang Xiang , Shanfu Lu , Yexin Liu , Mingguang He , Danli Shi

Plain language summaries (PLSs) are essential for facilitating effective communication between clinicians and patients by making complex medical information easier for laypeople to understand and act upon. Large language models (LLMs) have…

Computation and Language · Computer Science 2025-05-16 Yue Guo , Jae Ho Sohn , Gondy Leroy , Trevor Cohen

Large Language Models (LLMs) continue to advance natural language processing with their ability to generate human-like text across a range of tasks. Despite the remarkable success of LLMs in Natural Language Processing (NLP), their…

Computation and Language · Computer Science 2025-07-08 Walid Mohamed Aly , Taysir Hassan A. Soliman , Amr Mohamed AbdelAziz

IMPORTANCE The response effectiveness of different large language models (LLMs) and various individuals, including medical students, graduate students, and practicing physicians, in pediatric ophthalmology consultations, has not been…

Computation and Language · Computer Science 2023-11-09 Jason Holmes , Rui Peng , Yiwei Li , Jinyu Hu , Zhengliang Liu , Zihao Wu , Huan Zhao , Xi Jiang , Wei Liu , Hong Wei , Jie Zou , Tianming Liu , Yi Shao

Clinical summarization is crucial in healthcare as it distills complex medical data into digestible information, enhancing patient understanding and care management. Large language models (LLMs) have shown significant potential in…

Computation and Language · Computer Science 2025-08-21 Anindya Bijoy Das , Shibbir Ahmed , Shahnewaz Karim Sakib

This study investigates the efficacy of large language models (LLMs) as tools for grading master-level student essays. Utilizing a sample of 60 essays in political science, the study compares the accuracy of grades suggested by the GPT-4…

General Economics · Economics 2024-06-25 Magnus Lundgren

Large language models (LLMs) have shown promise in safety-critical applications such as healthcare, yet the ability to quantify performance has lagged. An example of this challenge is in evaluating a summary of the patient's medical record.…

Computation and Language · Computer Science 2024-11-13 Elliot Schumacher , Daniel Rosenthal , Dhruv Naik , Varun Nair , Luladay Price , Geoffrey Tso , Anitha Kannan

Long-form video content constitutes a significant portion of internet traffic, making automated video summarization an essential research problem. However, existing video summarization datasets are notably limited in their size,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Dawit Mureja Argaw , Seunghyun Yoon , Fabian Caba Heilbron , Hanieh Deilamsalehy , Trung Bui , Zhaowen Wang , Franck Dernoncourt , Joon Son Chung

Large language models (LLMs) hold great promise for medical applications and are evolving rapidly, with new models being released at an accelerated pace. However, benchmarking on large-scale real-world data such as electronic health records…

In this paper, we investigate the potential of open-source Large Language Models (LLMs) for grading Unified Modeling Language (UML) class diagrams. In contrast to existing work, which primarily evaluates proprietary LLMs, we focus on…

Computers and Society · Computer Science 2026-03-18 Matthijs Jansen op de Haar , Nacir Bouali , Faizan Ahmed

With the increasing application of large language models (LLMs) in the medical domain, evaluating these models' performance using benchmark datasets has become crucial. This paper presents a comprehensive survey of various benchmark…

With the rapid development of artificial intelligence, large language models (LLMs) have shown promising capabilities in mimicking human-level language comprehension and reasoning. This has sparked significant interest in applying LLMs to…

Computation and Language · Computer Science 2023-11-06 Mingze Yuan , Peng Bao , Jiajia Yuan , Yunhao Shen , Zifan Chen , Yi Xie , Jie Zhao , Yang Chen , Li Zhang , Lin Shen , Bin Dong

Recent advancements in Large Language Models (LLMs) have demonstrated their potential in delivering accurate answers to questions about world knowledge. Despite this, existing benchmarks for evaluating LLMs in healthcare predominantly focus…

Computation and Language · Computer Science 2024-06-18 Zheheng Luo , Chenhan Yuan , Qianqian Xie , Sophia Ananiadou

Recently, there has been growing interest in extending the context length of large language models (LLMs), aiming to effectively process long inputs of one turn or conversations with more extensive histories. While proprietary models such…

Computation and Language · Computer Science 2023-10-05 Chenxin An , Shansan Gong , Ming Zhong , Xingjian Zhao , Mukai Li , Jun Zhang , Lingpeng Kong , Xipeng Qiu

Matching cancer patients to clinical trials is essential for advancing treatment and patient care. However, the inconsistent format of medical free text documents and complex trial eligibility criteria make this process extremely…

Open-source, multilingual medical large language models (LLMs) have the potential to serve linguistically diverse populations across different regions. Adapting generic LLMs for healthcare often requires continual pretraining, but this…

Computation and Language · Computer Science 2024-09-10 Meng Zhou , Surajsinh Parmar , Anubhav Bhatti

Recent advances in large language models (LLMs) have shown potential in clinical text summarization, but their ability to handle long patient trajectories with multi-modal data spread across time remains underexplored. This study…

Computation and Language · Computer Science 2025-09-08 Maya Kruse , Shiyue Hu , Nicholas Derby , Yifu Wu , Samantha Stonbraker , Bingsheng Yao , Dakuo Wang , Elizabeth Goldberg , Yanjun Gao