English
Related papers

Related papers: Anatomical Structure-Guided Medical Vision-Languag…

200 papers

Medical image segmentation requires large annotated datasets, creating a significant bottleneck for clinical applications. While few-shot segmentation methods can learn from minimal examples, existing approaches demonstrate suboptimal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Ziyuan Gao

Automating radiology report generation can ease the reporting workload for radiologists. However, existing works focus mainly on the chest area due to the limited availability of public datasets for other regions. Besides, they often rely…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Qi Chen , Yutong Xie , Biao Wu , Xiaomin Chen , James Ang , Minh-Son To , Xiaojun Chang , Qi Wu

In medical image synthesis, model training could be challenging due to the inconsistencies between images of different modalities even with the same patient, typically caused by internal status/tissue changes as different modalities are…

Image and Video Processing · Electrical Eng. & Systems 2021-09-16 Hajar Emami , Ming Dong , Siamak Nejad-Davarani , Carri Glide-Hurst

Retinal diagnosis is inherently bilateral: clinicians compare homologous structures across eyes (e.g., optic disc asymmetry), yet most deep models operate on monocular representations. We investigate whether explicit structural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yingzhe Ma , Xiao Yang , Yuguo Yin , Zheyu Wang

Producing densely annotated data is a difficult and tedious task for medical imaging applications. To address this problem, we propose a novel approach to generate supervision for semi-supervised semantic segmentation. We argue that…

Image and Video Processing · Electrical Eng. & Systems 2022-10-10 Constantin Seibold , Simon Reiß , Jens Kleesiek , Rainer Stiefelhagen

Vision-Language Pretraining (VLP) has achieved remarkable success across various downstream tasks, but such gains are largely driven by scaling up on training data. Yet, literature methods treat image-text pairs as isolated training…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Wenbo Lu

3D visual grounding aims to localize the unique target described by natural languages in 3D scenes. The significant gap between 3D and language modalities makes it a notable challenge to distinguish multiple similar objects through the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Feng Xiao , Hongbin Xu , Guocan Zhao , Wenxiong Kang

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

Accurate 3D brain MRI subtype classification benefits from both localized anatomical cues and long-range contextual reasoning. We present AGA3DNet, a report-grounded framework that incorporates brief anatomical phrases extracted from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Peiyu Duan , Xueqi Guo , Sepehr Farhand , Mehmet Berk Sahin , Xinyuan Zheng , James S. Duncan , Gerardo Hermosillo Valadez , Yoshihisa Shinagawa

Vision-language models have emerged as a powerful tool for previously challenging multi-modal classification problem in the medical domain. This development has led to the exploration of automated image description generation for…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Mansi Kakkar , Dattesh Shanbhag , Chandan Aladahalli , Gurunath Reddy M

Unsupervised domain adaptation for medical image segmentation remains a significant challenge due to substantial domain shifts across imaging modalities, such as CT and MRI. While recent vision-language representation learning methods have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Lalit Maurya , Honghai Liu , Reyer Zwiggelaar

Computed Tomography Report Generation (CTRG) aims to automate the clinical radiology reporting process, thereby reducing the workload of report writing and facilitating patient care. While deep learning approaches have achieved remarkable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hong Liu , Dong Wei , Qiong Peng , Yawen Huang , Xian Wu , Yefeng Zheng , Liansheng Wang

Visual grounding (VG) is the capability to identify the specific regions in an image associated with a particular text description. In medical imaging, VG enhances interpretability by highlighting relevant pathological features…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ta Duc Huy , Duy Anh Huynh , Yutong Xie , Yuankai Qi , Qi Chen , Phi Le Nguyen , Sen Kim Tran , Son Lam Phung , Anton van den Hengel , Zhibin Liao , Minh-Son To , Johan W. Verjans , Vu Minh Hieu Phan

In scene graph generation, a central challenge is modeling polysemous predicates whose meanings shift across contexts. Prior approaches address this issue by decomposing predicates into multiple static prototypes or retrieving semantically…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 NamGyu Jung , Chang Choi

Automatic report generation has arisen as a significant research area in computer-aided diagnosis, aiming to alleviate the burden on clinicians by generating reports automatically based on medical images. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jun Li , Tongkun Su , Baoliang Zhao , Faqin Lv , Qiong Wang , Nassir Navab , Ying Hu , Zhongliang Jiang

Medical Visual Grounding (MVG) aims to identify diagnostically relevant phrases from free-text radiology reports and localize their corresponding regions in medical images, providing interpretable visual evidence to support clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yifan Gao , Tao Zhou , Yi Zhou , Ke Zou , Yizhe Zhang , Huazhu Fu

Accurate yet interpretable image-based diagnosis remains a central challenge in medical AI, particularly in settings characterized by limited data, subtle visual cues, and high-stakes clinical decision-making. Most existing vision models…

Artificial Intelligence · Computer Science 2025-12-23 Midhat Urooj , Ayan Banerjee , Sandeep Gupta

Building generalizable medical AI systems requires pretraining strategies that are data-efficient and domain-aware. Unlike internet-scale corpora, clinical datasets such as MIMIC-CXR offer limited image counts and scarce annotations, but…

Learning from audio-visual data offers many possibilities to express correspondence between the audio and visual content, similar to the human perception that relates aural and visual information. In this work, we present a method for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Shanshan Wang , Archontis Politis , Annamaria Mesaros , Tuomas Virtanen

Deep learning can help uncover patterns in resting-state functional Magnetic Resonance Imaging (rs-fMRI) associated with psychiatric disorders and personal traits. Yet the problem of interpreting deep learning findings is rarely more…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Camila González , Yanis Miraoui , Yiran Fan , Ehsan Adeli , Kilian M. Pohl