English
Related papers

Related papers: Uncovering Modality Discrepancy and Generalization…

200 papers

The investigation of uncertainty is of major importance in risk-critical applications, such as medical image segmentation. Belief function theory, a formal framework for uncertainty analysis and multiple evidence fusion, has made…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Ling Huang , Su Ruan , Thierry Denoeux

Computed Tomography (CT) is one of the most popular modalities for medical imaging. By far, CT images have contributed to the largest publicly available datasets for volumetric medical segmentation tasks, covering full-body anatomical…

Image and Video Processing · Electrical Eng. & Systems 2024-11-25 Jin Ye , Ying Chen , Yanjun Li , Haoyu Wang , Zhongying Deng , Ziyan Huang , Yanzhou Su , Chenglong Ma , Yuanfeng Ji , Junjun He

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang

Multi-modality (or multi-channel) imaging is becoming increasingly important and more widely available, e.g. hyperspectral imaging in remote sensing, spectral CT in material sciences as well as multi-contrast MRI and PET-MR in medicine.…

Image and Video Processing · Electrical Eng. & Systems 2020-12-25 Leon Bungert , Matthias J. Ehrhardt

Magnetic resonance (MR) protocols rely on several sequences to assess pathology and organ status properly. Despite advances in image analysis, we tend to treat each sequence, here termed modality, in isolation. Taking advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Agisilaos Chartsias , Giorgos Papanastasiou , Chengjia Wang , Scott Semple , David E. Newby , Rohan Dharmakumar , Sotirios A. Tsaftaris

Medical segmentation models are evaluated empirically. As such an evaluation is based on a limited set of example images, it is unavoidably noisy. Beyond a mean performance measure, reporting confidence intervals is thus crucial. However,…

Image and Video Processing · Electrical Eng. & Systems 2025-03-25 R. El Jurdi , G. Varoquaux , O. Colliot

Dealing with missing modalities in Magnetic Resonance Imaging (MRI) and overcoming their negative repercussions is considered a hurdle in biomedical imaging. The combination of a specified set of modalities, which is selected depending on…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Reza Azad , Nika Khosravi , Mohammad Dehghanmanshadi , Julien Cohen-Adad , Dorit Merhof

Accurate lung tumor segmentation is crucial for improving diagnosis, treatment planning, and patient outcomes in oncology. However, the complexity of tumor morphology, size, and location poses significant challenges for automated…

Image and Video Processing · Electrical Eng. & Systems 2026-02-16 Elena Mulero Ayllón , Massimiliano Mantegna , Linlin Shen , Paolo Soda , Valerio Guarrasi , Matteo Tortora

Foundation segmentation models such as the Segment Anything Model (SAM) have demonstrated strong generalization across natural images; however, their robustness under clinically realistic medical imaging domain shifts remains insufficiently…

Image and Video Processing · Electrical Eng. & Systems 2026-04-29 Sanghati Basu

Automated segmentation of cancerous lesions in PET/CT images is a vital initial task for quantitative analysis. However, it is often challenging to train deep learning-based segmentation methods to high degree of accuracy due to the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Shadab Ahamed , Arman Rahmim

Foundation models have emerged as a powerful paradigm in computational pathology (CPath), enabling scalable and generalizable analysis of histopathological images. While early developments centered on uni-modal models trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Xiaohui Chen , Yi He , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

Federated learning (FL) offers a privacy-preserving paradigm for collaborative medical image analysis without sharing raw data. However, the absence of standardized benchmarks for medical image segmentation hinders fair and comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Meilu Zhu , Zhiwei Wang , Axiu Mao , Yuxing Li , Xiaohan Xing , Yixuan Yuan , Edmund Y. Lam

Synthesizing missing modalities in multi-modal magnetic resonance imaging (MRI) is vital for ensuring diagnostic completeness, particularly when full acquisitions are infeasible due to time constraints, motion artifacts, and patient…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yue Zhang , Zhizheng Zhuo , Siyao Xu , Shan Lv , Zhaoxi Liu , Jun Qiu , Qiuli Wang , Yaou Liu , S. Kevin Zhou

Medical image foundation models have shown the ability to segment organs and tumors with minimal fine-tuning. These models are typically evaluated on task-specific in-distribution (ID) datasets. However, reliable performance on ID datasets…

Image and Video Processing · Electrical Eng. & Systems 2025-01-31 Aneesh Rangnekar , Nishant Nadkarni , Jue Jiang , Harini Veeraraghavan

The Segment Anything Model (SAM) has drawn significant attention from researchers who work on medical image segmentation because of its generalizability. However, researchers have found that SAM may have limited performance on medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Yihao Liu , Jiaming Zhang , Andres Diaz-Pinto , Haowei Li , Alejandro Martin-Gomez , Amir Kheradmand , Mehran Armand

Multimodal semantic segmentation is a pivotal component of computer vision and typically surpasses unimodal methods by utilizing rich information set from various sources.Current models frequently adopt modality-specific frameworks that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Bingyu Li , Da Zhang , Zhiyuan Zhao , Junyu Gao , Xuelong Li

Semantic segmentation of large-scale 3D point clouds is crucial for applications such as autonomous driving and urban digital twins. However, the sparse sampling pattern of LiDAR and the view-dependent geometric distortion in image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Shuai Zhang , Zhecheng Shi , Zhuxiao Li , Jing Ou , Tengxi Wang , Yuan Liu , Wufan Zhao

The objective of this study was to develop a PET tumor-segmentation framework that addresses the challenges of limited spatial resolution, high image noise, and lack of clinical training data with ground-truth tumor boundaries in PET…

Generalizability in deep neural networks plays a pivotal role in medical image segmentation. However, deep learning-based medical image analyses tend to overlook the importance of frequency variance, which is critical element for achieving…

Image and Video Processing · Electrical Eng. & Systems 2024-05-13 Ju-Hyeon Nam , Nur Suriza Syazwany , Su Jung Kim , Sang-Chul Lee

Inadequate generality across different organs and tasks constrains the application of ultrasound (US) image analysis methods in smart healthcare. Building a universal US foundation model holds the potential to address these issues.…

Image and Video Processing · Electrical Eng. & Systems 2024-01-03 Jing Jiao , Jin Zhou , Xiaokang Li , Menghua Xia , Yi Huang , Lihong Huang , Na Wang , Xiaofan Zhang , Shichong Zhou , Yuanyuan Wang , Yi Guo