English
Related papers

Related papers: A Scalable Framework for Evaluating Health Languag…

200 papers

With the rapid development of artificial intelligence, large language models (LLMs) have shown promising capabilities in mimicking human-level language comprehension and reasoning. This has sparked significant interest in applying LLMs to…

Computation and Language · Computer Science 2023-11-06 Mingze Yuan , Peng Bao , Jiajia Yuan , Yunhao Shen , Zifan Chen , Yi Xie , Jie Zhao , Yang Chen , Li Zhang , Lin Shen , Bin Dong

We present DM-Bench, the first benchmark designed to evaluate large language model (LLM) performance across real-world decision-making tasks faced by individuals managing diabetes in their daily lives. Unlike prior health benchmarks that…

Machine Learning · Computer Science 2025-10-06 Maria Ana Cardei , Josephine Lamp , Mark Derdzinski , Karan Bhatia

Large Language Models (LLMs) have gained significant attention in the medical domain for their human-level capabilities, leading to increased efforts to explore their potential in various healthcare applications. However, despite such a…

Artificial Intelligence · Computer Science 2024-10-25 Yifan Yang , Qiao Jin , Qingqing Zhu , Zhizheng Wang , Francisco Erramuspe Álvarez , Nicholas Wan , Benjamin Hou , Zhiyong Lu

Objective: This study investigates the potential of Large Language Models (LLMs) as an alternative to human expert elicitation for extracting structured causal knowledge and facilitating causal modeling in biometric and healthcare…

Artificial Intelligence · Computer Science 2025-04-15 Olha Shaposhnyk , Daria Zahorska , Svetlana Yanushkevich

As intelligent systems become more autonomous, the scientific community focuses on creating decision-making mechanisms that include ethical and moral considerations, unlike traditional utility-maximisation models. To achieve this, a key…

Artificial Intelligence · Computer Science 2026-05-28 Eduardo de la Cruz Fernández , Marcelo Karanik , Sascha Ossowski

Large language models (LLMs) are increasingly used to extract clinical data from electronic health records (EHRs), offering significant improvements in scalability and efficiency for real-world data (RWD) curation in oncology. However, the…

Large language models (LLMs) have shown promise in representing individuals and communities, offering new ways to study complex social dynamics. However, effectively aligning LLMs with specific human groups and systematically assessing the…

Computation and Language · Computer Science 2025-02-12 Minh Duc Chu , Zihao He , Rebecca Dorn , Kristina Lerman

The integration of Large Language Models (LLMs) into healthcare settings has gained significant attention, particularly for question-answering tasks. Given the high-stakes nature of healthcare, it is essential to ensure that LLM-generated…

Medical report generation from imaging data remains a challenging task in clinical practice. While large language models (LLMs) show great promise in addressing this challenge, their effective integration with medical imaging data still…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Chunlei Li , Jingyang Hou , Yilei Shi , Jingliang Hu , Xiao Xiang Zhu , Lichao Mou

The emergence of advanced reasoning capabilities in Large Language Models (LLMs) marks a transformative development in healthcare applications. Beyond merely expanding functional capabilities, these reasoning mechanisms enhance decision…

Artificial Intelligence · Computer Science 2025-08-27 Armin Berger , Sarthak Khanna , David Berghaus , Rafet Sifa

We aim to present a comprehensive overview of the latest advancements in utilizing Large Language Models (LLMs) within the healthcare sector, emphasizing their transformative impact across various medical domains. LLMs have become pivotal…

Computation and Language · Computer Science 2026-04-07 Ummara Mumtaz , Awais Ahmed , Summaya Mumtaz

Electronic Health Records (EHRs) offer considerable potential for clinical prediction, but their complexity and heterogeneity challenge traditional machine learning. Domain-specific EHR foundation models trained on unlabeled EHR data have…

Pluralistic alignment has emerged as a critical frontier in the development of Large Language Models (LLMs), with reward models (RMs) serving as a central mechanism for capturing diverse human values. While benchmarks for general response…

Computation and Language · Computer Science 2026-04-09 Qiyao Ma , Dechen Gao , Rui Cai , Boqi Zhao , Hanchu Zhou , Junshan Zhang , Zhe Zhao

Objectieve:This review aims to deliver a comprehensive analysis of Large Language Models (LLMs) utilization in mental health care, evaluating their effectiveness, identifying challenges, and exploring their potential for future application.…

Background: Biomedical entity normalization is critical to biomedical research because the richness of free-text clinical data, such as progress notes, can often be fully leveraged only after translating words and phrases into structured…

Computation and Language · Computer Science 2024-05-27 Nicholas J Dobbins

Large Language Models (LLMs) have rapidly become important tools in Biomedical and Health Informatics (BHI), enabling new ways to analyze data, treat patients, and conduct research. This study aims to provide a comprehensive overview of LLM…

Digital Libraries · Computer Science 2024-07-30 Huizi Yu , Lizhou Fan , Lingyao Li , Jiayan Zhou , Zihui Ma , Lu Xian , Wenyue Hua , Sijia He , Mingyu Jin , Yongfeng Zhang , Ashvin Gandhi , Xin Ma

Instruction tuning is a pivotal technique for aligning large language models (LLMs) with human intentions, safety constraints, and domain-specific requirements. This survey provides a comprehensive overview of the full pipeline,…

Computation and Language · Computer Science 2025-11-20 Xudong Han , Junjie Yang , Tianyang Wang , Ziqian Bi , Xinyuan Song , Junfeng Hao , Junhao Song

In difficult decision-making scenarios, it is common to have conflicting opinions among expert human decision-makers as there may not be a single right answer. Such decisions may be guided by different attributes that can be used to…

Computation and Language · Computer Science 2024-06-11 Brian Hu , Bill Ray , Alice Leung , Amy Summerville , David Joy , Christopher Funk , Arslan Basharat

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

Computation and Language · Computer Science 2025-06-12 Yuxin Jiang

Biased AI-generated medical advice and misdiagnoses can jeopardize patient safety, making the integrity of AI in healthcare more critical than ever. As Large Language Models (LLMs) take on a growing role in medical decision-making,…

Computation and Language · Computer Science 2024-10-10 Pardis Sadat Zahraei , Zahra Shakeri