English
Related papers

Related papers: Vision-Language Generative Model for View-Specific…

200 papers

Recent transformer-based models have made significant strides in generating radiology reports from chest X-ray images. However, a prominent challenge remains: these models often lack prior knowledge, resulting in the generation of synthetic…

Computation and Language · Computer Science 2023-06-06 Sanghwan Kim , Farhad Nooralahzadeh , Morteza Rohanian , Koji Fujimoto , Mizuho Nishio , Ryo Sakamoto , Fabio Rinaldi , Michael Krauthammer

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Andriy Myronenko , Dong Yang , Baris Turkbey , Mariam Aboian , Sena Azamat , Esra Akcicek , Hongxu Yin , Pavlo Molchanov , Marc Edgar , Yufan He , Pengfei Guo , Yucheng Tang , Daguang Xu

Medical imaging has revolutionized disease diagnosis, yet the potential is hampered by limited access to diverse and privacy-conscious datasets. Open-source medical datasets, while valuable, suffer from data quality and clinical information…

Image and Video Processing · Electrical Eng. & Systems 2023-12-13 Gauri Bhardwaj , Yuvaraj Govindarajulu , Sundaraparipurnan Narayanan , Pavan Kulkarni , Manojkumar Parmar

Radiology Report Generation (RRG) through Vision-Language Models (VLMs) promises to reduce documentation burden, improve reporting consistency, and accelerate clinical workflows. However, their clinical adoption remains limited by the lack…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Marco Salmè , Federico Siciliano , Fabrizio Silvestri , Paolo Soda , Rosa Sicilia , Valerio Guarrasi

Chest radiography is the most common medical image examination for screening and diagnosis in hospitals. Automatic interpretation of chest X-rays at the level of an entry-level radiologist can greatly benefit work prioritization and assist…

Image and Video Processing · Electrical Eng. & Systems 2020-08-11 Sandesh Ghimire , Satyananda Kashyap , Joy T. Wu , Alexandros Karargyris , Mehdi Moradi

Chest X-rays (CXRs) are a widely used imaging modality for the diagnosis and prognosis of lung disease. The image analysis tasks vary. Examples include pathology detection and lung segmentation. There is a large body of work where machine…

Image and Video Processing · Electrical Eng. & Systems 2023-05-19 Syed Muhammad Anwar , Abhijeet Parida , Sara Atito , Muhammad Awais , Gustavo Nino , Josef Kitler , Marius George Linguraru

Visual attribution in medical imaging seeks to make evident the diagnostically-relevant components of a medical image, in contrast to the more common detection of diseased tissue deployed in standard machine vision pipelines (which are less…

Image and Video Processing · Electrical Eng. & Systems 2024-01-04 Ammar A. Siddiqui , Santosh Tirunagari , Tehseen Zia , David Windridge

Interpretation of imaging findings based on morphological characteristics is important for diagnosing pulmonary nodules on chest computed tomography (CT) images. In this study, we constructed a visual question answering (VQA) dataset from…

Image and Video Processing · Electrical Eng. & Systems 2026-01-19 Maiko Nagao , Kaito Urata , Atsushi Teramoto , Kazuyoshi Imaizumi , Masashi Kondo , Hiroshi Fujita

Generative models are becoming popular for the synthesis of medical images. Recently, neural diffusion models have demonstrated the potential to generate photo-realistic images of objects. However, their potential to generate medical images…

Image and Video Processing · Electrical Eng. & Systems 2022-11-03 Hazrat Ali , Shafaq Murad , Zubair Shah

Clustering multi-view data has been a fundamental research topic in the computer vision community. It has been shown that a better accuracy can be achieved by integrating information of all the views than just using one view individually.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Ming Yin , Weitian Huang , Junbin Gao

Diversity in data is critical for the successful training of deep learning models. Leveraged by a recurrent generative adversarial network, we propose the CT-SGAN model that generates large-scale 3D synthetic CT-scan volumes ($\geq…

Image and Video Processing · Electrical Eng. & Systems 2021-11-08 Ahmad Pesaranghader , Yiping Wang , Mohammad Havaei

In this work, we present RadGazeGen, a novel framework for integrating experts' eye gaze patterns and radiomic feature maps as controls to text-to-image diffusion models for high fidelity medical image generation. Despite the recent success…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Moinak Bhattacharya , Gagandeep Singh , Shubham Jain , Prateek Prasanna

Modeling disease progression is crucial for improving the quality and efficacy of clinical diagnosis and prognosis, but it is often hindered by a lack of longitudinal medical image monitoring for individual patients. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Xu Cao , Kaizhao Liang , Kuei-Da Liao , Tianren Gao , Wenqian Ye , Jintai Chen , Zhiguang Ding , Jianguo Cao , James M. Rehg , Jimeng Sun

Large annotated datasets are essential for training robust Computer-Aided Diagnosis (CAD) models for breast cancer detection or risk prediction. However, acquiring such datasets with fine-detailed annotation is both costly and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shunjie-Fabian Zheng , Hyeonjun Lee , Thijs Kooi , Ali Diba

Chest X-ray interpretation is one of the most frequently performed diagnostic tasks in medicine and a primary target for AI development, yet current vision-language models are primarily trained on datasets of paired images and reports, not…

We propose a two-stage multimodal framework that enhances disease classification and region-aware radiology report generation from chest X-rays, leveraging the MIMIC-Eye dataset. In the first stage, we introduce a gaze-guided contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Tanjim Islam Riju , Shuchismita Anwar , Saman Sarker Joy , Farig Sadeque , Swakkhar Shatabda

We developed a rich dataset of Chest X-Ray (CXR) images to assist investigators in artificial intelligence. The data were collected using an eye tracking system while a radiologist reviewed and reported on 1,083 CXR images. The dataset…

Analyzing medical data to find abnormalities is a time-consuming and costly task, particularly for rare abnormalities, requiring tremendous efforts from medical experts. Artificial intelligence has become a popular tool for the automatic…

Imbalanced image datasets are commonly available in the domain of biomedical image analysis. Biomedical images contain diversified features that are significant in predicting targeted diseases. Generative Adversarial Networks (GANs) are…

Image and Video Processing · Electrical Eng. & Systems 2022-11-15 Muhammad Muneeb Saad , Mubashir Husain Rehmani , Ruairi O'Reilly