English
Related papers

Related papers: CXReasonAgent: Evidence-Grounded Diagnostic Reason…

200 papers

Scientific reasoning poses an excessive challenge for even the most advanced Large Language Models (LLMs). To make this task more practical and solvable for LLMs, we introduce a new task setting named tool-augmented scientific reasoning.…

Computation and Language · Computer Science 2024-02-22 Yubo Ma , Zhibin Gou , Junheng Hao , Ruochen Xu , Shuohang Wang , Liangming Pan , Yujiu Yang , Yixin Cao , Aixin Sun , Hany Awadalla , Weizhu Chen

Lung cancer clinical decision support demands precise reasoning across complex, multi-stage oncological workflows. Existing multimodal large language models (MLLMs) fail to handle guideline-constrained staging and treatment reasoning. We…

Despite significant progress in Multi-modal Large Language Models (MLLMs), their clinical reasoning capacity for multi-modal diagnosis remains largely unexamined. Current benchmarks, mostly single-modality data, can't evaluate progressive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Gui Wang , Zehao Zhong , YongSong Zhou , Yudong Li , Ende Wu , Wooi Ping Cheah , Rong Qu , Jianfeng Ren , Linlin Shen

Understanding domain-specific theorems often requires more than just text-based reasoning; effective communication through structured visual explanations is crucial for deeper comprehension. While large language models (LLMs) demonstrate…

Artificial Intelligence · Computer Science 2025-05-27 Max Ku , Thomas Chong , Jonathan Leung , Krish Shah , Alvin Yu , Wenhu Chen

Deep learning models show significant potential for advancing AI-assisted medical diagnostics, particularly in detecting lung cancer through medical image modalities such as chest X-rays. However, the black-box nature of these models poses…

Machine Learning · Computer Science 2025-03-31 Amy Rafferty , Rishi Ramaesh , Ajitha Rajan

The large language model (LLM) has achieved significant success across various domains. However, the inherent complexity of causal problems and causal theory poses challenges in accurately describing them in natural language, making it…

Artificial Intelligence · Computer Science 2025-10-15 Kairong Han , Kun Kuang , Ziyu Zhao , Junjian Ye , Fei Wu

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance in complex multimodal tasks. However, these models still suffer from hallucinations, particularly when required to implicitly recognize or infer diverse visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ashish Seth , Dinesh Manocha , Chirag Agarwal

We present a novel approach to Chest X-ray (CXR) Visual Question Answering (VQA), addressing both single-image image-difference questions. Single-image questions focus on abnormalities within a specific CXR ("What abnormalities are seen in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Francesco Dalla Serra , Patrick Schrempf , Chaoyang Wang , Zaiqiao Meng , Fani Deligianni , Alison Q. O'Neil

Reasoning-based large language models have excelled in mathematics and programming, yet their potential in knowledge-intensive medical question answering remains underexplored and insufficiently validated in clinical contexts. To bridge…

Computation and Language · Computer Science 2025-10-10 Yu Sun , Xingyu Qian , Weiwen Xu , Hao Zhang , Chenghao Xiao , Long Li , Deli Zhao , Wenbing Huang , Tingyang Xu , Qifeng Bai , Yu Rong

Healthcare professionals need effective ways to use, understand, and validate AI-driven clinical decision support systems. Existing systems face two key limitations: complex visualizations and a lack of grounding in scientific evidence. We…

Human-Computer Interaction · Computer Science 2025-07-08 Reza Samimi , Aditya Bhattacharya , Lucija Gosak , Gregor Stiglic , Katrien Verbert

Chest Xray imaging is a widely used diagnostic tool in modern medicine, and its high utilization creates substantial workloads for radiologists. To alleviate this burden, vision language models are increasingly applied to automate Chest…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Shaoyang Zhou , Yingshu Li , Yunyi Liu , Lingqiao Liu , Lei Wang , Luping Zhou

Automated fetal ultrasound interpretation requires a workflow from visual perception, including plane recognition and anatomical segmentation, to clinical understanding, including biometric measurement and diagnostic reporting. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xiaotian Hu , Mingxuan Liu , Junwei Huang , Kasidit Anmahapong , Yifei Chen , Yiming Huang , Xuguang Bai , Zihan Li , Hongjia Yang , Yingqi Hao , Hong Xu , Yu Jiang , Tian Tian , Yi Liao , Haibo Qu , Qiyuan Tian

Cause-and-effect reasoning in video is a significant challenge for Vision-Language Models (VLMs), as it requires going beyond surface-level perception to a deeper understanding of causal mechanisms. However, existing benchmarks rarely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Mingfang Zhang , Jingjing Pan , Ashutosh Kumar , Rajat Saini , Mustafa Erdogan , Hsuan-Kung Yang , Caixin Kang , Yifei Huang , Yoichi Sato , Quan Kong

Recent multimodal large language models (MLLMs) achieve strong performance on visual reasoning benchmarks, yet it remains unclear to what extent such performance reflects reasoning directly grounded in visual evidence. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Longteng Guo , Yifan Wang , Pengkang Huo , Tailai Chen , Yuze Wu , Jing Liu , Xinxin Zhu

Medical artificial intelligence (AI) is revolutionizing the interpretation of chest X-ray (CXR) images by providing robust tools for disease diagnosis. However, the effectiveness of these AI models is often limited by their reliance on…

Image and Video Processing · Electrical Eng. & Systems 2024-10-14 Lijian Xu , Ziyu Ni , Hao Sun , Hongsheng Li , Shaoting Zhang

The chest X-ray (CXR) is commonly employed to diagnose thoracic illnesses, but the challenge of achieving accurate automatic diagnosis through this method persists due to the complex relationship between pathology. In recent years, various…

Image and Video Processing · Electrical Eng. & Systems 2023-05-23 Weizhi Nie , Chen Zhang , Dan song , Yunpeng Bai , Keliang Xie , Anan Liu

3D CT analysis spans a continuum from low-level perception to high-level clinical understanding. Existing 3D-oriented analysis methods adopt either isolated task-specific modeling or task-agnostic end-to-end paradigms to produce one-hop…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Ziyue Wang , Linghan Cai , Chang Han Low , Haofeng Liu , Junde Wu , Jingyu Wang , Rui Wang , Lei Song , Jiang Bian , Jingjing Fu , Yueming Jin

Machine reasoning has made great progress in recent years owing to large language models (LLMs). In the clinical domain, however, most NLP-driven projects mainly focus on clinical classification or reading comprehension, and under-explore…

Computation and Language · Computer Science 2024-05-13 Taeyoon Kwon , Kai Tzu-iunn Ong , Dongjin Kang , Seungjun Moon , Jeong Ryong Lee , Dosik Hwang , Yongsik Sim , Beomseok Sohn , Dongha Lee , Jinyoung Yeo

Explainable disease diagnosis, which leverages patient information (e.g., signs and symptoms) and computational models to generate probable diagnoses and reasonings, offers clear clinical values. However, when clinical notes encompass…

Clinical Decision Support Systems (CDSS) utilize evidence-based knowledge and patient data to offer real-time recommendations, with Large Language Models (LLMs) emerging as a promising tool to generate plain-text explanations for medical…

Computation and Language · Computer Science 2023-10-04 D. Umerenkov , G. Zubkova , A. Nesterov