中文
相关论文

相关论文: PASSION: Towards Effective Incomplete Multi-Modal …

200 篇论文

Medical image segmentation methods generally assume that the process from medical image to segmentation is unbiased, and use neural networks to establish conditional probability models to complete the segmentation task. This assumption does…

图像与视频处理 · 电气工程与系统科学 2025-05-29 Ruiguo Yu , Yiyang Zhang , Yuan Tian , Yujie Diao , Di Jin , Witold Pedrycz

Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical, morphological and functional information, increases diagnosis accuracy, and…

图像与视频处理 · 电气工程与系统科学 2022-08-30 Lei Li , Wangbin Ding , Liqun Huang , Xiahai Zhuang , Vicente Grau

Variations in medical imaging modalities and individual anatomical differences pose challenges to cross-modality generalization in multi-modal tasks. Existing methods often concentrate exclusively on common anatomical patterns, thereby…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Zhaorui Tan , Xi Yang , Tan Pan , Tianyi Liu , Chen Jiang , Xin Guo , Qiufeng Wang , Anh Nguyen , Yuan Qi , Kaizhu Huang , Yuan Cheng

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

计算机视觉与模式识别 · 计算机科学 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Medical image segmentation has advanced rapidly over the past two decades, largely driven by deep learning, which has enabled accurate and efficient delineation of cells, tissues, organs, and pathologies across diverse imaging modalities.…

图像与视频处理 · 电气工程与系统科学 2025-08-29 Guoping Xu , Jayaram K. Udupa , Jax Luo , Songlin Zhao , Yajun Yu , Scott B. Raymond , Hao Peng , Lipeng Ning , Yogesh Rathi , Wei Liu , You Zhang

A versatile medical image segmentation model applicable to images acquired with diverse equipment and protocols can facilitate model deployment and maintenance. However, building such a model typically demands a large, diverse, and fully…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Xiaoyang Chen , Hao Zheng , Yuemeng Li , Yuncong Ma , Liang Ma , Hongming Li , Yong Fan

Medical image segmentation is an important analysis task in clinical practice and research. Deep learning has massively advanced the field, but current approaches are mostly based on models trained for a specific task. Training such models…

图像与视频处理 · 电气工程与系统科学 2025-12-18 Anwai Archit , Luca Freckmann , Constantin Pape

In medical image segmentation, heterogeneous privacy policies across institutions often make joint training on pooled datasets infeasible, motivating continual image segmentation-learning from data streams without catastrophic forgetting.…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Jiayi Wang , Wei Dai , Haoyu Wang , Sihan Yang , Haixia Bi , Jian Sun

Poor performance of quantitative analysis in histopathological Whole Slide Images (WSI) has been a significant obstacle in clinical practice. Annotating large-scale WSIs manually is a demanding and time-consuming task, unlikely to yield the…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Sarah Cechnicka , James Ball , Hadrien Reynaud , Callum Arthurs , Candice Roufosse , Bernhard Kainz

Manual annotation of medical images is highly subjective, leading to inevitable and huge annotation biases. Deep learning models may surpass human performance on a variety of tasks, but they may also mimic or amplify these biases. Although…

计算机视觉与模式识别 · 计算机科学 2022-03-23 Zehui Liao , Shishuai Hu , Yutong Xie , Yong Xia

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

计算机视觉与模式识别 · 计算机科学 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

Machine Unlearning aims to remove the influence of specific data or concepts from trained models while preserving overall performance, a capability increasingly required by data protection regulations and responsible AI practices. Despite…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Natnael Mola , Leonardo S. B. Pereira , Carolina R. Kelsch , Luis H. Arribas , Juan C. S. M. Avedillo

Multimodal learning with incomplete input data (missing modality) is practical and challenging. In this work, we conduct an in-depth analysis of this challenge and find that modality dominance has a significant negative impact on the model…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Hao Wang , Shengda Luo , Guosheng Hu , Jianguo Zhang

Multi-modal learning has made significant advances across diverse pattern recognition applications. However, handling missing modalities, especially under imbalanced missing rates, remains a major challenge. This imbalance triggers a…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Binyu Zhao , Wei Zhang , Zhaonian Zou

Multimodal fusion leverages information across modalities to learn better feature representations with the goal of improving performance in fusion-based tasks. However, multimodal datasets, especially in medical settings, are typically…

机器学习 · 计算机科学 2025-02-05 Alejandro Guerra-Manzanares , Farah E. Shamout

Addressing missing modalities presents a critical challenge in multimodal learning. Current approaches focus on developing models that can handle modality-incomplete inputs during inference, assuming that the full set of modalities are…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Yunpeng Zhao , Cheng Chen , Qing You Pang , Quanzheng Li , Carol Tang , Beng-Ti Ang , Yueming Jin

Medical image segmentation aims to delineate the anatomical or pathological structures of interest, playing a crucial role in clinical diagnosis. A substantial amount of high-quality annotated data is crucial for constructing high-precision…

计算机视觉与模式识别 · 计算机科学 2024-02-28 Zhongnuo Yan , Tong Han , Yuhao Huang , Lian Liu , Han Zhou , Jiongquan Chen , Wenlong Shi , Yan Cao , Xin Yang , Dong Ni

We propose SAMed, a general solution for medical image segmentation. Different from the previous methods, SAMed is built upon the large-scale image segmentation model, Segment Anything Model (SAM), to explore the new research paradigm of…

计算机视觉与模式识别 · 计算机科学 2023-10-18 Kaidong Zhang , Dong Liu

Multi-modal medical imaging enables comprehensive diagnostics, yet current foundation models process 2D (e.g. X-ray) and 3D (e.g. CT) data with separate, dimensionality-specific architectures. We present MultiMedVision, a unified framework…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Frank Li , Bardia Khosravi , Mohammadreza Chavoshi , Young Seok Jeon , Theo Dapamede , Hari Trivedi , Janice Newsome , Judy Gichoya

Collective insights from a group of experts have always proven to outperform an individual's best diagnostic for clinical tasks. For the task of medical image segmentation, existing research on AI-based alternatives focuses more on…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Aimon Rahman , Jeya Maria Jose Valanarasu , Ilker Hacihaliloglu , Vishal M Patel