中文
相关论文

相关论文: No Modality Left Behind: Adapting to Missing Modal…

200 篇论文

Recent advances have been made in applying convolutional neural networks to achieve more precise prediction results for medical image segmentation problems. However, the success of existing methods has highly relied on huge computational…

图像与视频处理 · 电气工程与系统科学 2021-08-24 Dian Qin , Jiajun Bu , Zhe Liu , Xin Shen , Sheng Zhou , Jingjun Gu , Zhijua Wang , Lei Wu , Huifen Dai

Combining multiple modalities carrying complementary information through multimodal learning (MML) has shown considerable benefits for diagnosing multiple pathologies. However, the robustness of multimodal models to missing modalities is…

机器学习 · 计算机科学 2024-07-31 Hava Chaptoukaev , Vincenzo Marcianó , Francesco Galati , Maria A. Zuluaga

Brain tumor segmentation is important for diagnosis of the tumor, and current deep-learning methods rely on a large set of annotated images for training, with high annotation costs. Unsupervised segmentation is promising to avoid human…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Xiaochuan Ma , Jia Fu , Wenjun Liao , Shichuan Zhang , Guotai Wang

Segmentation of enhancing tumours or lesions from MRI is important for detecting new disease activity in many clinical contexts. However, accurate segmentation requires the inclusion of medical images (e.g., T1 post contrast MRI) acquired…

图像与视频处理 · 电气工程与系统科学 2021-05-14 Saverio Vadacchino , Raghav Mehta , Nazanin Mohammadi Sepahvand , Brennan Nichyporuk , James J. Clark , Tal Arbel

Multimedia online platforms (e.g., Amazon, TikTok) have greatly benefited from the incorporation of multimedia (e.g., visual, textual, and acoustic) content into their personal recommender systems. These modalities provide intuitive…

信息检索 · 计算机科学 2024-03-12 Wei Wei , Jiabin Tang , Yangqin Jiang , Lianghao Xia , Chao Huang

Brain tumors are one of the deadliest forms of cancer with a mortality rate of over 80%. A quick and accurate diagnosis is crucial to increase the chance of survival. However, in medical analysis, the manual annotation and segmentation of a…

图像与视频处理 · 电气工程与系统科学 2024-03-18 Zachary Schwehr , Sriman Achanta

Improving the performance of semantic segmentation models using multispectral information is crucial, especially for environments with low-light and adverse conditions. Multi-modal fusion techniques pursue either the learning of…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Aniruddh Sikdar , Jayant Teotia , Suresh Sundaram

Simultaneously using multimodal inputs from multiple sensors to train segmentors is intuitively advantageous but practically challenging. A key challenge is unimodal bias, where multimodal segmentors over rely on certain modalities, causing…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Xu Zheng , Haiwei Xue , Jialei Chen , Yibo Yan , Lutao Jiang , Yuanhuiyi Lyu , Kailun Yang , Linfeng Zhang , Xuming Hu

Most of the current state-of-the-art methods for tumor segmentation are based on machine learning models trained on manually segmented images. This type of training data is particularly costly, as manual delineation of tumors is not only…

计算机视觉与模式识别 · 计算机科学 2019-08-21 Pawel Mlynarski , Hervé Delingette , Antonio Criminisi , Nicholas Ayache

Accurate brain tumor segmentation from multi-modal magnetic resonance imaging (MRI) is a prerequisite for precise radiotherapy planning and surgical navigation. While recent Transformer-based models such as Swin UNETR have achieved…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Yan Zhou , Zhen Huang , Yingqiu Li , Yue Ouyang , Suncheng Xiang , Zehua Wang

We propose a new deep learning method for tumour segmentation when dealing with missing imaging modalities. Instead of producing one network for each possible subset of observed modalities or using arithmetic operations to combine feature…

图像与视频处理 · 电气工程与系统科学 2019-10-22 Reuben Dorent , Samuel Joutard , Marc Modat , Sébastien Ourselin , Tom Vercauteren

Segmenting tumors in histological images is vital for cancer diagnosis. While fully supervised models excel with pixel-level annotations, creating such annotations is labor-intensive and costly. Accurate histopathology image segmentation…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Yinsheng He , Xingyu Li , Roger J. Zemp

According to the 2021 World Health Organization (WHO) Classification scheme for gliomas, glioma segmentation is a very important basis for diagnosis and genotype prediction. In general, 3D multimodal brain MRI is an effective diagnostic…

图像与视频处理 · 电气工程与系统科学 2025-06-23 Xiaoyu Shi , Shurong Chai , Yinhao Li , Jingliang Cheng , Jie Bai , Guohua Zhao , Yen-Wei Chen

To improve the prediction of cancer survival using whole-slide images and transcriptomics data, it is crucial to capture both modality-shared and modality-specific information. However, multimodal frameworks often entangle these…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Sanne Abeln , Wilson Silva

We explore Generalizable Tumor Segmentation, aiming to train a single model for zero-shot tumor segmentation across diverse anatomical regions. Existing methods face limitations related to segmentation quality, scalability, and the range of…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Yankai Jiang , Peng Zhang , Donglin Yang , Yuan Tian , Hai Lin , Xiaosong Wang

Recently, deep learning technology has been successfully introduced into Automatic Modulation Recognition (AMR) tasks. However, the success of deep learning is all attributed to the training on large-scale datasets. Such a large amount of…

机器学习 · 计算机科学 2024-08-07 Dongwei Xu , Jiajun Chen , Yao Lu , Tianhao Xia , Qi Xuan , Wei Wang , Yun Lin , Xiaoniu Yang

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

机器学习 · 计算机科学 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

In clinical practice, the robustness of deep learning models for multimodal brain tumor segmentation is severely compromised by incomplete MRI data. This vulnerability stems primarily from modality bias, where models exploit spurious…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Bo Liu , Yulong Zou , Jin Hong

The limited availability of labeled data has driven advancements in semi-supervised learning for medical image segmentation. Modern large-scale models tailored for general segmentation, such as the Segment Anything Model (SAM), have…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Kaiwen Huang , Tao Zhou , Huazhu Fu , Yizhe Zhang , Yi Zhou , Chen Gong , Dong Liang

The accurate segmentation of breast tumors is an important prerequisite for lesion detection, which has significant clinical value for breast tumor research. The mainstream deep learning-based methods have achieved a breakthrough. However,…

图像与视频处理 · 电气工程与系统科学 2023-11-21 Hongjiang Guo , Shengwen Wang , Hao Dang , Kangle Xiao , Yaru Yang , Wenpei Liu , Tongtong Liu , Yiying Wan