English
Related papers

Related papers: PASSION: Towards Effective Incomplete Multi-Modal …

200 papers

Pathology image segmentation across multiple centers encounters significant challenges due to diverse sources of heterogeneity including imaging modalities, organs, and scanning equipment, whose variability brings representation bias and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Yuan Zhang , Feng Chen , Yaolei Qi , Guanyu Yang , Huazhu Fu

Learning based on multimodal data has attracted increasing interest recently. While a variety of sensory modalities can be collected for training, not all of them are always available in development scenarios, which raises the challenge to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shicai Wei , Yang Luo , Chunbo Luo

Image diffusion distillation achieves high-fidelity generation with very few sampling steps. However, applying these techniques directly to video diffusion often results in unsatisfactory frame quality due to the limited visual quality in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yuanhao Zhai , Kevin Lin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Chung-Ching Lin , David Doermann , Junsong Yuan , Lijuan Wang

Multi-modal image registration is a crucial pre-processing step in many medical applications. However, it is a challenging task due to the complex intensity relationships between different imaging modalities, which can result in large…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Vasiliki Sideri-Lampretsa , Veronika A. Zimmer , Huaqi Qiu , Georgios Kaissis , Daniel Rueckert

In the domain of medical imaging, many supervised learning based methods for segmentation face several challenges such as high variability in annotations from multiple experts, paucity of labelled data and class imbalanced datasets. These…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Soumick Chatterjee , Franziska Gaidzik , Alessandro Sciarra , Hendrik Mattern , Gábor Janiga , Oliver Speck , Andreas Nürnberger , Sahani Pathiraja

Medical imaging is crucial for diagnosing a patient's health condition, and accurate segmentation of these images is essential for isolating regions of interest to ensure precise diagnosis and treatment planning. Existing methods primarily…

Image and Video Processing · Electrical Eng. & Systems 2025-07-01 Longchao Da , Rui Wang , Xiaojian Xu , Parminder Bhatia , Taha Kass-Hout , Hua Wei , Cao Xiao

In medical image segmentation tasks, diffusion models have shown significant potential. However, mainstream diffusion models suffer from drawbacks such as multiple sampling times and slow prediction results. Recently, consistency models, as…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Kejia Zhang , Lan Zhang , Haiwei Pan , Baolong Yu

Segmentation in dense visual scenes poses significant challenges due to occlusions, background clutter, and scale variations. To address this, we introduce PerSense, an end-to-end, training-free, and model-agnostic one-shot framework for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Muhammad Ibraheem Siddiqui , Muhammad Umer Sheikh , Hassan Abid , Kevin Henry , Muhammad Haris Khan

Simultaneous segmentation of multiple organs from different medical imaging modalities is a crucial task as it can be utilized for computer-aided diagnosis, computer-assisted surgery, and therapy planning. Thanks to the recent advances in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Saeid Asgari Taghanaki , Yefeng Zheng , S. Kevin Zhou , Bogdan Georgescu , Puneet Sharma , Daguang Xu , Dorin Comaniciu , Ghassan Hamarneh

Large-scale, big-variant, high-quality data are crucial for developing robust and successful deep-learning models for medical applications since they potentially enable better generalization performance and avoid overfitting. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zheyuan Zhang , Lanhong Yao , Bin Wang , Debesh Jha , Gorkem Durak , Elif Keles , Alpay Medetalibeyoglu , Ulas Bagci

Denoising Diffusion Probabilistic models have become increasingly popular due to their ability to offer probabilistic modeling and generate diverse outputs. This versatility inspired their adaptation for image segmentation, where multiple…

Medical image and video segmentation is a critical task for precision medicine, which has witnessed considerable progress in developing task or modality-specific and generalist models for 2D images. However, there have been limited studies…

Image and Video Processing · Electrical Eng. & Systems 2025-04-07 Jun Ma , Zongxin Yang , Sumin Kim , Bihui Chen , Mohammed Baharoon , Adibvafa Fallahpour , Reza Asakereh , Hongwei Lyu , Bo Wang

Cardiac image analysis remains fragmented across tasks: anatomical segmentation, disease classification, and grounded clinical report generation are typically handled by separate networks trained under different data regimes. No existing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Hania Ghouse , Maryam Alsharqi , Farhad R. Nezami , Muzammil Behzad

Multimodal ophthalmic imaging-based diagnosis integrates color fundus image with optical coherence tomography (OCT) to provide a comprehensive view of ocular pathologies. However, the uneven global distribution of healthcare resources often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Qinkai Yu , Jianyang Xie , Yitian Zhao , Cheng Chen , Lijun Zhang , Liming Chen , Jun Cheng , Lu Liu , Yalin Zheng , Yanda Meng

Many recommender models have been proposed to investigate how to incorporate multimodal content information into traditional collaborative filtering framework effectively. The use of multimodal information is expected to provide more…

Information Retrieval · Computer Science 2024-08-14 Jinghao Zhang , Guofan Liu , Qiang Liu , Shu Wu , Liang Wang

This study proposes a pipeline that incorporates a novel style transfer model and a simultaneous super-resolution and segmentation model. The proposed pipeline aims to enhance diffusion tensor imaging (DTI) images by translating them into…

Image and Video Processing · Electrical Eng. & Systems 2023-09-28 Lichao Wang , Jiahao Huang , Xiaodan Xing , Yinzhe Wu , Ramyah Rajakulasingam , Andrew D. Scott , Pedro F Ferreira , Ranil De Silva , Sonia Nielles-Vallespin , Guang Yang

The Segment Anything Model (SAM), a foundation model for general image segmentation, has demonstrated impressive zero-shot performance across numerous natural image segmentation tasks. However, SAM's performance significantly declines when…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Cheng Chen , Juzheng Miao , Dufan Wu , Zhiling Yan , Sekeun Kim , Jiang Hu , Aoxiao Zhong , Zhengliang Liu , Lichao Sun , Xiang Li , Tianming Liu , Pheng-Ann Heng , Quanzheng Li

Semi-supervised medical image segmentation aims to leverage minimal expert annotations, yet remains confronted by challenges in maintaining high-quality consistency learning. Excessive perturbations can degrade alignment and hinder precise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Wenbo Xiao , Zhihao Xu , Guiping Liang , Yangjun Deng , Yi Xiao

Segmenting tumors in histological images is vital for cancer diagnosis. While fully supervised models excel with pixel-level annotations, creating such annotations is labor-intensive and costly. Accurate histopathology image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yinsheng He , Xingyu Li , Roger J. Zemp

Multimodal MRI provides critical complementary information for accurate brain tumor segmentation. However, conventional methods struggle when certain modalities are missing due to issues such as image quality, protocol inconsistencies,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Runze Cheng , Xihang Qiu , Ming Li , Ye Zhang , Chun Li , Fei Yu