English
Related papers

Related papers: H-DDx: A Hierarchical Evaluation Framework for Dif…

200 papers

Large Language Models (LLMs) have transformed natural language processing and extended their powerful capabilities to multi-modal domains. As LLMs continue to advance, it is crucial to develop diverse and appropriate metrics for their…

Machine Learning · Computer Science 2024-10-15 Lai Wei , Zhiquan Tan , Chenghai Li , Jindong Wang , Weiran Huang

Large language models (LLMs) show promise for extracting clinically meaningful information from unstructured health records, yet their translation into real-world settings is constrained by the lack of scalable and trustworthy validation…

The rapid advancement of large language models (LLMs) has accelerated their integration into clinical decision support, particularly in prescription review. To enable systematic and fine-grained evaluation, we developed RxBench, a…

Computation and Language · Computer Science 2025-12-03 Yan Yang , Mouxiao Bian , Peiling Li , Bingjian Wen , Ruiyao Chen , Kangkun Mao , Xiaojun Ye , Tianbin Li , Pengcheng Chen , Bing Han , Jie Xu , Kaifeng Qiu , Junyan Wu

Large language models (LLMs) have demonstrated impressive performance across various domains. However, for clinical diagnosis, higher expectations are required for LLM's reliability and sensitivity: thinking like physicians and remaining…

Computation and Language · Computer Science 2025-04-21 Chenwei Yan , Xiangling Fu , Yuxuan Xiong , Tianyi Wang , Siu Cheung Hui , Ji Wu , Xien Liu

Large language models (LLMs) have achieved remarkable performance on diverse benchmarks, yet existing evaluation practices largely rely on coarse summary metrics that obscure underlying reasoning abilities. In this work, we propose novel…

Methodology · Statistics 2026-03-17 Jia Liu , Zhiyu Xu , Yuqi Gu

The emergence of large language models (LLMs) has significantly influenced numerous fields, including healthcare, by enhancing the capabilities of automated systems to process and generate human-like text. However, despite their…

Information Retrieval · Computer Science 2025-04-23 Mohit Gupta , Akiko Aizawa , Rajiv Ratn Shah

Large language models (LLMs) are increasingly used to support question answering and decision-making in high-stakes, domain-specific settings such as natural hazard response and infrastructure planning, where effective answers must convey…

Computation and Language · Computer Science 2026-02-11 Homaira Huda Shomee , Rochana Chaturvedi , Yangxinyu Xie , Tanwi Mallick

Large language models (LLMs) show promise for supporting clinicians in diagnostic communication by generating explanations and guidance for patients. Yet their ability to produce outputs that are both understandable and empathetic remains…

Computation and Language · Computer Science 2025-11-04 Jianzhou Yao , Shunchang Liu , Guillaume Drui , Rikard Pettersson , Alessandro Blasimme , Sara Kijewski

Clinical diagnosis requires sequential evidence acquisition under uncertainty. However, most Large Language Model (LLM) based diagnostic systems assume fully observed patient information and therefore do not explicitly model how clinical…

Artificial Intelligence · Computer Science 2026-04-08 Xuyang Shen , Haoran Liu , Dongjin Song , Martin Renqiang Min

Integrating Large Language Models (LLMs) in healthcare diagnosis demands systematic frameworks that can handle complex medical scenarios while maintaining specialized expertise. We present KG4Diagnosis, a novel hierarchical multi-agent…

Artificial Intelligence · Computer Science 2025-04-01 Kaiwen Zuo , Yirui Jiang , Fan Mo , Pietro Lio

Automatic disease diagnosis has become increasingly valuable in clinical practice. The advent of large language models (LLMs) has catalyzed a paradigm shift in artificial intelligence, with growing evidence supporting the efficacy of LLMs…

Background Major depressive disorder (MDD) is a leading cause of global disability, yet current diagnostic approaches often rely on subjective assessments and lack the ability to integrate multimodal clinical information. Large language…

Machine Learning · Computer Science 2025-09-30 Yuyang Sha , Hongxin Pan , Gang Luo , Caijuan Shi , Jing Wang , Kefeng Li

Large Language Models (LLMs) have achieved remarkable success in various fields, prompting several studies to explore their potential in recommendation systems. However, these attempts have so far resulted in only modest improvements over…

Information Retrieval · Computer Science 2024-09-20 Junyi Chen , Lu Chi , Bingyue Peng , Zehuan Yuan

Automatic medical report generation can greatly reduce the workload of doctors, but it is often unreliable for real-world deployment. Current methods can write formally fluent sentences but may be factually flawed, introducing serious…

Computational Engineering, Finance, and Science · Computer Science 2025-12-03 Yuan Wang , Shujian Gao , Jiaxiang Liu , Songtao Jiang , Haoxiang Xia , Xiaotian Zhang , Zhaolu Kang , Yemin Wang , Zuozhu Liu

The continuous advancement of large language models (LLMs) has brought increasing attention to the critical issue of developing fair and reliable methods for evaluating their performance. Particularly, the emergence of cheating phenomena,…

Computation and Language · Computer Science 2025-02-26 Qingchen Yu , Zifan Zheng , Shichao Song , Zhiyu Li , Feiyu Xiong , Bo Tang , Ding Chen

Recent advancements in large language models (LLMs) have shown promise in feature engineering for tabular data, but concerns about their reliability persist, especially due to variability in generated outputs. We introduce a multi-level…

Machine Learning · Computer Science 2025-10-01 Yebin Lim , Susik Yoon

In this paper we introduce Hierarchical Diffusion Language Models (HDLM) -- a novel family of discrete diffusion models for language modeling. HDLM builds on a hierarchical vocabulary where low-level tokens with detailed semantics are…

Computation and Language · Computer Science 2025-10-13 Cai Zhou , Chenyu Wang , Dinghuai Zhang , Shangyuan Tong , Yifei Wang , Stephen Bates , Tommi Jaakkola

This position paper examines how large language models (LLMs) can support thematic analysis of unstructured clinical transcripts, a widely used but resource-intensive method for uncovering patterns in patient and provider narratives. We…

Computation and Language · Computer Science 2025-09-30 Seungjun Yi , Joakim Nguyen , Terence Lim , Andrew Well , Joseph Skrovan , Mehak Beri , YongGeon Lee , Kavita Radhakrishnan , Liu Leqi , Mia Markey , Ying Ding

Clinical decision-making requires reasoning over incomplete, imprecise, and linguistically expressed patient narratives. While large language models (LLMs) excel at extracting latent information from natural language, they lack the…

Artificial Intelligence · Computer Science 2026-05-26 Xiaoyang Fan , Yufan Cai , Zhe Hou , Jin Song Dong

Medical Decision-Making (MDM) is a multi-faceted process that requires clinicians to assess complex multi-modal patient data patient, often collaboratively. Large Language Models (LLMs) promise to streamline this process by synthesizing…