English
Related papers

Related papers: MedConceal: A Benchmark for Clinical Hidden-Concer…

200 papers

Physician-physician discussions of patient cases represent a rich source of clinical knowledge and reasoning that could feed AI agents to enrich and even participate in subsequent interactions. However, privacy regulations and ethical…

Computation and Language · Computer Science 2026-04-13 Beny Rubinstein , Sergio Matos

Clinical reasoning refers to the cognitive process that physicians employ in evaluating and managing patients. This process typically involves suggesting necessary examinations, diagnosing patients' diseases, and deciding on appropriate…

Computation and Language · Computer Science 2024-06-11 Jiageng WU , Xian Wu , Jie Yang

We introduce AcuityBench, a benchmark for evaluating whether language models identify the appropriate urgency of care from user medical presentations. Existing health benchmarks emphasize medical question answering, broad health…

The deployment of Large Language Models (LLMs) in high-stakes clinical settings demands rigorous and reliable evaluation. However, existing medical benchmarks remain static, suffering from two critical limitations: (1) data contamination,…

Artificial Intelligence · Computer Science 2026-02-12 Zhiling Yan , Dingjie Song , Zhe Fang , Yisheng Ji , Xiang Li , Quanzheng Li , Lichao Sun

Integrating language models (LMs) in healthcare systems holds great promise for improving medical workflows and decision-making. However, a critical barrier to their real-world adoption is the lack of reliable evaluation of their…

Computation and Language · Computer Science 2025-12-15 Akash Ghosh , Srivarshinee Sridhar , Raghav Kaushik Ravi , Muhsin Muhsin , Sriparna Saha , Chirag Agarwal

Large language models (LLMs) have achieved strong performance on medical exam-style tasks, motivating growing interest in their deployment in real-world clinical settings. However, clinical decision-making is inherently safety-critical,…

Computation and Language · Computer Science 2026-04-13 Xiaohan Ren , Chenxiao Fan , Wenyin Ma , Hongliang He , Chongming Gao , Xiaoyan Zhao , Fuli Feng

Large Language Models (LLMs) have brought huge improvements to Artificial Intelligence (AI), which can be applied to general-purpose tasks. However, their application to textual or spoken medical consultations is still an open research…

Artificial Intelligence · Computer Science 2026-05-27 Heriberto Cuayahuitl , Grace Jang

Traditionally, AI research in medical diagnosis has largely centered on image analysis. While this has led to notable advancements, the absence of patient-reported symptoms continues to hinder diagnostic accuracy. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 K Lokesh , Abhirama Subramanyam Penamakuri , Uday Agarwal , Apoorva Challa , Shreya K Gowda , Somesh Gupta , Anand Mishra

Concept Bottleneck Models (CBMs) are a prominent framework for interpretable AI that map learned visual features to a set of meaningful concepts for task-specific downstream predictions. Their sequential structure enhances transparency by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mohamed Harmanani , Bining Long , Zhuoxin Guo , Paul F. R. Wilson , Amirhossein Sabour , Minh Nguyen Nhat To , Gabor Fichtinger , Purang Abolmaesumi , Parvin Mousavi

AI based mental health diagnosis is often judged by benchmark accuracy, yet in practice its value depends on how psychologists respond whether they accept, adjust, or reject AI suggestions. Mental health makes this especially challenging:…

Human-Computer Interaction · Computer Science 2025-12-11 Filippo Cenacchi , Longbing Cao , Deborah Richards

Vision Language Models (VLMs) are increasingly used for tasks like medical report generation and visual question answering. However, fluent diagnostic text does not guarantee safe visual understanding. In clinical practice, interpretation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Ufaq Khan , Umair Nawaz , L D M S S Teja , Numaan Saeed , Muhammad Bilal , Yutong Xie , Mohammad Yaqub , Muhammad Haris Khan

Clinical decision-making is inherently complex, often influenced by cognitive biases, incomplete information, and case ambiguity. Large Language Models (LLMs) have shown promise as tools for supporting clinical decision-making, yet their…

Machine Learning · Computer Science 2025-07-10 Burcu Sayin , Ipek Baris Schlicht , Ngoc Vo Hong , Sara Allievi , Jacopo Staiano , Pasquale Minervini , Andrea Passerini

In recent years, interest has arisen in using machine learning to improve the efficiency of automatic medical consultation and enhance patient experience. In this article, we propose two frameworks to support automatic medical consultation,…

Computation and Language · Computer Science 2022-12-27 Wei Chen , Zhiwei Li , Hongyi Fang , Qianyuan Yao , Cheng Zhong , Jianye Hao , Qi Zhang , Xuanjing Huang , Jiajie Peng , Zhongyu Wei

Clinical practice guidelines (CPGs) play a pivotal role in ensuring evidence-based decision-making and improving patient outcomes. While Large Language Models (LLMs) are increasingly deployed in healthcare scenarios, it is unclear to which…

Computation and Language · Computer Science 2026-03-27 Andong Tan , Shuyu Dai , Jinglu Wang , Fengtao Zhou , Yan Lu , Xi Wang , Yingcong Chen , Can Yang , Shujie Liu , Hao Chen

This paper contributes with a pragmatic evaluation framework for explainable Machine Learning (ML) models for clinical decision support. The study revealed a more nuanced role for ML explanation models, when these are pragmatically embedded…

Artificial Intelligence · Computer Science 2022-12-22 Oskar Wysocki , Jessica Katharine Davies , Markel Vigo , Anne Caroline Armstrong , Dónal Landers , Rebecca Lee , André Freitas

LLMs have demonstrated impressive performance in answering medical questions, such as achieving passing scores on medical licensing examinations. However, medical board exams or general clinical questions do not capture the complexity of…

Computation and Language · Computer Science 2026-02-19 Hanjie Chen , Zhouxiang Fang , Yash Singla , Mark Dredze

Dermatological care via telemedicine often lacks the rich context of in-person visits. Clinicians must make diagnoses based on a handful of images and brief descriptions, without the benefit of physical exams, second opinions, or reference…

Artificial Intelligence · Computer Science 2025-08-27 Karishma Thakrar , Shreyas Basavatia , Akshay Daftardar

Online healthcare consultations have transformed how patients seek medical advice, offering convenience while introducing new challenges for ensuring consultation success. Predicting whether an online consultation will be successful is…

Machine Learning · Computer Science 2025-11-03 Shuang Geng , Wenli Zhang , Jiaheng Xie , Gemin Liang , Ben Niu , Sudha Ram

Clinical robustness is critical to the safe deployment of medical Large Language Models (LLMs), but key questions remain about how LLMs and humans may differ in response to the real-world variability typified by clinical settings. To…

Artificial Intelligence · Computer Science 2025-06-23 Abinitha Gourabathina , Yuexing Hao , Walter Gerych , Marzyeh Ghassemi

The deployment of Large Language Models in Medical Question Answering is severely hampered by ambiguous user queries, a significant safety risk that demonstrably reduces answer accuracy in high-stakes healthcare settings. In this paper, we…

Computation and Language · Computer Science 2026-01-27 Yaokun Liu , Yifan Liu , Phoebe Mbuvi , Zelin Li , Ruichen Yao , Gawon Lim , Dong Wang