中文
相关论文

相关论文: Knowledge-Augmented Language Models Interpreting S…

200 篇论文

Volumetric medical imaging technologies produce detailed 3D representations of anatomical structures. However, effective medical data visualization and exploration pose significant challenges, especially for individuals with limited medical…

人机交互 · 计算机科学 2025-07-01 Qixuan Liu , Shi Qiu , Yinqiao Wang , Xiwen Wu , Kenneth Siu Ho Chok , Chi-Wing Fu , Pheng-Ann Heng

Chest X-ray (CXR) reporting follows a region-based clinical workflow in which radiologists inspect anatomical regions and integrate localized findings into a final report. However, existing resources for CXR report generation provide these…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Yichen Zhao , Zelin Peng , Fenghe Tang , Piao Yang , Yu Huang , Wei Shen

Longitudinal chest X-ray (CXR) interpretation requires reasoning over disease evolution across multiple patient visits, yet most existing medical VQA benchmarks focus on single images or short-horizon image pairs. We introduce MI-CXR, a…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Sunghwan Steve Cho , Yunseok Han , Jaeyoung Do

The widespread use of chest X-rays (CXRs), coupled with a shortage of radiologists, has driven growing interest in automated CXR analysis and AI-assisted reporting. While existing vision-language models (VLMs) show promise in specific tasks…

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

Chest X-ray (CXR) plays a pivotal role in clinical diagnosis, and a variety of task-specific and foundation models have been developed for automatic CXR interpretation. However, these models often struggle to adapt to new diagnostic tasks…

人工智能 · 计算机科学 2025-10-27 Jinhui Lou , Yan Yang , Zhou Yu , Zhenqi Fu , Weidong Han , Qingming Huang , Jun Yu

Despite the success of deep neural networks in chest X-ray (CXR) diagnosis, supervised learning only allows the prediction of disease classes that were seen during training. At inference, these networks cannot predict an unseen disease…

计算机视觉与模式识别 · 计算机科学 2021-07-15 Nasir Hayat , Hazem Lashen , Farah E. Shamout

Chest X-ray (CXR) is perhaps the most frequently-performed radiological investigation globally. In this work, we present and study several machine learning approaches to develop automated CXR diagnostic models. In particular, we trained…

计算机视觉与模式识别 · 计算机科学 2021-05-10 Edoardo Giacomello , Pier Luca Lanzi , Daniele Loiacono , Luca Nassano

Recent progress in Large Vision-Language Models (LVLMs) has enabled promising applications in medical tasks, such as report generation and visual question answering. However, existing benchmarks focus mainly on the final diagnostic answer,…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Hyungyung Lee , Geon Choi , Jung-Oh Lee , Hangyul Yoon , Hyuk Gi Hong , Edward Choi

Chest X-ray radiographs (CXRs) play a pivotal role in diagnosing and monitoring cardiopulmonary diseases. However, lung opacities in CXRs frequently obscure anatomical structures, impeding clear identification of lung borders and…

图像与视频处理 · 电气工程与系统科学 2025-03-30 Junzhi Ning , Dominic Marshall , Yijian Gao , Xiaodan Xing Yang Nan , Yingying Fang , Sheng Zhang , Matthieu Komorowski , Guang Yang

The chest X-ray (CXR) is commonly employed to diagnose thoracic illnesses, but the challenge of achieving accurate automatic diagnosis through this method persists due to the complex relationship between pathology. In recent years, various…

图像与视频处理 · 电气工程与系统科学 2023-05-23 Weizhi Nie , Chen Zhang , Dan song , Yunpeng Bai , Keliang Xie , Anan Liu

Vision-language models (VLMs) have recently shown remarkable zero-shot performance in medical image understanding, yet their grounding ability, the extent to which textual concepts align with visual evidence, remains underexplored. In the…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Haozhe Luo , Shelley Zixin Shu , Ziyu Zhou , Sebastian Otalora , Mauricio Reyes

The global demand for radiologists is increasing rapidly due to a growing reliance on medical imaging services, while the supply of radiologists is not keeping pace. Advances in computer vision and image processing technologies present…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Shehroz S. Khan , Petar Przulj , Ahmed Ashraf , Ali Abedi

Tabular data is often hidden in text, particularly in medical diagnostic reports. Traditional machine learning (ML) models designed to work with tabular data, cannot effectively process information in such form. On the other hand, large…

IMACT-CXR is an interactive multi-agent conversational tutor that helps trainees interpret chest X-rays by unifying spatial annotation, gaze analysis, knowledge retrieval, and image-grounded reasoning in a single AutoGen-based workflow. The…

人工智能 · 计算机科学 2026-04-17 Tuan-Anh Le , Anh Mai Vu , David Yang , Akash Awasthi , Hien Van Nguyen

Medical imaging analysis plays a critical role in the diagnosis and treatment of various medical conditions. This paper focuses on chest X-ray images and their corresponding radiological reports. It presents a new model that learns a joint…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Gefen Dawidowicz , Elad Hirsch , Ayellet Tal

In intensive care units (ICUs), patients with complex clinical conditions require vigilant monitoring and prompt interventions. Chest X-rays (CXRs) are a vital diagnostic tool, providing insights into clinical trajectories, but their…

Deep learning models have revolutionized medical imaging and diagnostics, yet their opaque nature poses challenges for clinical adoption and trust. Amongst approaches to improve model interpretability, concept-based explanations aim to…

计算机视觉与模式识别 · 计算机科学 2024-10-24 Vijay Sadashivaiah , Pingkun Yan , James A. Hendler

CLIP and BiomedCLIP are examples of vision-language foundation models and offer strong cross-modal embeddings; however, they are not optimized for fine-grained medical retrieval tasks, such as retrieving clinically relevant radiology…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Zhaohui Liang , Sivaramakrishnan Rajaraman , Niccolo Marini , Zhiyun Xue , Sameer Antani

In this work, we present an approach, which we call Embeddings for Language/Image-aligned X-Rays, or ELIXR, that leverages a language-aligned image encoder combined or grafted onto a fixed LLM, PaLM 2, to perform a broad range of chest…