English
Related papers

Related papers: PASSION: Towards Effective Incomplete Multi-Modal …

200 papers

Medical image segmentation methods generally assume that the process from medical image to segmentation is unbiased, and use neural networks to establish conditional probability models to complete the segmentation task. This assumption does…

Image and Video Processing · Electrical Eng. & Systems 2025-05-29 Ruiguo Yu , Yiyang Zhang , Yuan Tian , Yujie Diao , Di Jin , Witold Pedrycz

Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical, morphological and functional information, increases diagnosis accuracy, and…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Lei Li , Wangbin Ding , Liqun Huang , Xiahai Zhuang , Vicente Grau

Variations in medical imaging modalities and individual anatomical differences pose challenges to cross-modality generalization in multi-modal tasks. Existing methods often concentrate exclusively on common anatomical patterns, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Zhaorui Tan , Xi Yang , Tan Pan , Tianyi Liu , Chen Jiang , Xin Guo , Qiufeng Wang , Anh Nguyen , Yuan Qi , Kaizhu Huang , Yuan Cheng

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Medical image segmentation has advanced rapidly over the past two decades, largely driven by deep learning, which has enabled accurate and efficient delineation of cells, tissues, organs, and pathologies across diverse imaging modalities.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-29 Guoping Xu , Jayaram K. Udupa , Jax Luo , Songlin Zhao , Yajun Yu , Scott B. Raymond , Hao Peng , Lipeng Ning , Yogesh Rathi , Wei Liu , You Zhang

A versatile medical image segmentation model applicable to images acquired with diverse equipment and protocols can facilitate model deployment and maintenance. However, building such a model typically demands a large, diverse, and fully…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Xiaoyang Chen , Hao Zheng , Yuemeng Li , Yuncong Ma , Liang Ma , Hongming Li , Yong Fan

Medical image segmentation is an important analysis task in clinical practice and research. Deep learning has massively advanced the field, but current approaches are mostly based on models trained for a specific task. Training such models…

Image and Video Processing · Electrical Eng. & Systems 2025-12-18 Anwai Archit , Luca Freckmann , Constantin Pape

In medical image segmentation, heterogeneous privacy policies across institutions often make joint training on pooled datasets infeasible, motivating continual image segmentation-learning from data streams without catastrophic forgetting.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiayi Wang , Wei Dai , Haoyu Wang , Sihan Yang , Haixia Bi , Jian Sun

Poor performance of quantitative analysis in histopathological Whole Slide Images (WSI) has been a significant obstacle in clinical practice. Annotating large-scale WSIs manually is a demanding and time-consuming task, unlikely to yield the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Sarah Cechnicka , James Ball , Hadrien Reynaud , Callum Arthurs , Candice Roufosse , Bernhard Kainz

Manual annotation of medical images is highly subjective, leading to inevitable and huge annotation biases. Deep learning models may surpass human performance on a variety of tasks, but they may also mimic or amplify these biases. Although…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Zehui Liao , Shishuai Hu , Yutong Xie , Yong Xia

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

Machine Unlearning aims to remove the influence of specific data or concepts from trained models while preserving overall performance, a capability increasingly required by data protection regulations and responsible AI practices. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Natnael Mola , Leonardo S. B. Pereira , Carolina R. Kelsch , Luis H. Arribas , Juan C. S. M. Avedillo

Multimodal learning with incomplete input data (missing modality) is practical and challenging. In this work, we conduct an in-depth analysis of this challenge and find that modality dominance has a significant negative impact on the model…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hao Wang , Shengda Luo , Guosheng Hu , Jianguo Zhang

Multi-modal learning has made significant advances across diverse pattern recognition applications. However, handling missing modalities, especially under imbalanced missing rates, remains a major challenge. This imbalance triggers a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Binyu Zhao , Wei Zhang , Zhaonian Zou

Multimodal fusion leverages information across modalities to learn better feature representations with the goal of improving performance in fusion-based tasks. However, multimodal datasets, especially in medical settings, are typically…

Machine Learning · Computer Science 2025-02-05 Alejandro Guerra-Manzanares , Farah E. Shamout

Addressing missing modalities presents a critical challenge in multimodal learning. Current approaches focus on developing models that can handle modality-incomplete inputs during inference, assuming that the full set of modalities are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yunpeng Zhao , Cheng Chen , Qing You Pang , Quanzheng Li , Carol Tang , Beng-Ti Ang , Yueming Jin

Medical image segmentation aims to delineate the anatomical or pathological structures of interest, playing a crucial role in clinical diagnosis. A substantial amount of high-quality annotated data is crucial for constructing high-precision…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Zhongnuo Yan , Tong Han , Yuhao Huang , Lian Liu , Han Zhou , Jiongquan Chen , Wenlong Shi , Yan Cao , Xin Yang , Dong Ni

We propose SAMed, a general solution for medical image segmentation. Different from the previous methods, SAMed is built upon the large-scale image segmentation model, Segment Anything Model (SAM), to explore the new research paradigm of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Kaidong Zhang , Dong Liu

Multi-modal medical imaging enables comprehensive diagnostics, yet current foundation models process 2D (e.g. X-ray) and 3D (e.g. CT) data with separate, dimensionality-specific architectures. We present MultiMedVision, a unified framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Frank Li , Bardia Khosravi , Mohammadreza Chavoshi , Young Seok Jeon , Theo Dapamede , Hari Trivedi , Janice Newsome , Judy Gichoya

Collective insights from a group of experts have always proven to outperform an individual's best diagnostic for clinical tasks. For the task of medical image segmentation, existing research on AI-based alternatives focuses more on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Aimon Rahman , Jeya Maria Jose Valanarasu , Ilker Hacihaliloglu , Vishal M Patel