English
Related papers

Related papers: Enhancing Modality-Agnostic Representations via Me…

200 papers

Deep learning models have demonstrated great potential in medical 3D imaging, but their development is limited by the expensive, large volume of annotated data required. Active learning (AL) addresses this by training a model on a subset of…

Multi-modal brain tumor segmentation is critical for clinical diagnosis, and it requires accurate identification of distinct internal anatomical subregions. While the recent prompt-based segmentation paradigms enable interactive experiences…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yuxiang Luo , Qing Xu , Hai Huang , Yuqi Ouyang , Zhen Chen , Wenting Duan

Polyp segmentation is a crucial step towards computer-aided diagnosis of colorectal cancer. However, most of the polyp segmentation methods require pixel-wise annotated datasets. Annotated datasets are tedious and time-consuming to produce,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Guangyu Ren , Michalis Lazarou , Jing Yuan , Tania Stathaki

Characterizing a preclinical stage of Alzheimer's Disease (AD) via single imaging is difficult as its early symptoms are quite subtle. Therefore, many neuroimaging studies are curated with various imaging modalities, e.g., MRI and PET,…

Image and Video Processing · Electrical Eng. & Systems 2025-03-06 Seunghun Baek , Jaeyoon Sim , Mustafa Dere , Minjeong Kim , Guorong Wu , Won Hwa Kim

Tumor segmentation stands as a pivotal task in cancer diagnosis. Given the immense dimensions of whole slide images (WSI) in histology, deep learning approaches for WSI classification mainly operate at patch-wise or superpixel-wise level.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Huaqian Wu , Clara Brémond-Martin , Kévin Bouaou , Cédric Clouchoux

Multimodal deep learning, especially vision-language models, have gained significant traction in recent years, greatly improving performance on many downstream tasks, including content moderation and violence detection. However, standard…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zhuokai Zhao , Harish Palani , Tianyi Liu , Lena Evans , Ruth Toner

Multi-modal MR imaging is routinely used in clinical practice to diagnose and investigate brain tumors by providing rich complementary information. Previous multi-modal MRI segmentation methods usually perform modal fusion by concatenating…

Image and Video Processing · Electrical Eng. & Systems 2022-09-01 Zhaohu Xing , Lequan Yu , Liang Wan , Tong Han , Lei Zhu

Brain tumor segmentation plays an essential role in medical image analysis. In recent studies, deep convolution neural networks (DCNNs) are extremely powerful to tackle tumor segmentation tasks. We propose in this paper a novel training…

Image and Video Processing · Electrical Eng. & Systems 2020-10-29 Hieu T. Nguyen , Tung T. Le , Thang V. Nguyen , Nhan T. Nguyen

Multimodal networks have demonstrated remarkable performance improvements over their unimodal counterparts. Existing multimodal networks are designed in a multi-branch fashion that, due to the reliance on fusion strategies, exhibit…

Brain lesion segmentation from multi-modal MRI often assumes fixed modality sets or predefined pathologies, making existing models difficult to adapt across cohorts and imaging protocols. Continual learning (CL) offers a natural solution…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Yousef Sadegheih , Dorit Merhof , Pratibha Kumari

Meta learning is a promising technique for solving few-shot fault prediction problems, which have attracted the attention of many researchers in recent years. Existing meta-learning methods for time series prediction, which predominantly…

Machine Learning · Computer Science 2023-11-07 Hai Su , Jiajun Hu , Songsen Yu

A U-Net based deep learning architecture is designed to segment brain tumors as they appear on various MRI modalities. Special emphasis is lent to the non-enhancing tumor compartment. The latter has not been considered anymore in recent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 T. Schaffer , A. Brawanski , S. Wein , A. M. Tomé , E. W. Lang

We introduce here the idea of Meta-Learning for training EEG BCI decoders. Meta-Learning is a way of training machine learning systems so they learn to learn. We apply here meta-learning to a simple Deep Learning BCI architecture and…

Signal Processing · Electrical Eng. & Systems 2021-03-17 Denghao Li , Pablo Ortega , Xiaoxi Wei , Aldo Faisal

Multi-modal learning relates information across observation modalities of the same physical phenomenon to leverage complementary information. Most multi-modal machine learning methods require that all the modalities used for training are…

Machine Learning · Computer Science 2021-03-10 Vandana Rajan , Alessio Brutti , Andrea Cavallaro

Continual learning is essential for adapting models to new tasks while retaining previously acquired knowledge. While existing approaches predominantly focus on uni-modal data, multi-modal learning offers substantial benefits by utilizing…

Machine Learning · Computer Science 2025-11-11 Evelyn Chee , Wynne Hsu , Mong Li Lee

Radiologists must utilize multiple modal images for tumor segmentation and diagnosis due to the limitations of medical imaging and the diversity of tumor signals. This leads to the development of multimodal learning in segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Chuyun Shen , Wenhao Li , Haoqing Chen , Xiaoling Wang , Fengping Zhu , Yuxin Li , Xiangfeng Wang , Bo Jin

This paper proposes a method MTL-Swin-Unet which is multi-task learning using transformers for classification and semantic segmentation. For spurious-correlation problems, this method allows us to enhance the image representation with two…

Machine Learning · Computer Science 2025-05-14 Kodai Hirata , Tsuyoshi Okita

Missing data is a common problem in machine learning and in retrospective imaging research it is often encountered in the form of missing imaging modalities. We propose to take into account missing modalities in the design and training of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Karin van Garderen , Marion Smits , Stefan Klein

In the diverse field of medical imaging, automatic segmentation has numerous applications and must handle a wide variety of input domains, such as different types of Computed Tomography (CT) scans and Magnetic Resonance (MR) images. This…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Chengyin Li , Hui Zhu , Rafi Ibn Sultan , Hassan Bagher Ebadian , Prashant Khanduri , Chetty Indrin , Kundan Thind , Dongxiao Zhu

The complex heterogeneity of brain tumours is increasingly recognized to demand data of magnitudes and richness only fully-inclusive, large-scale collections drawn from routine clinical care could plausibly offer. This is a task…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 James K Ruffle , Samia Mohinta , Robert J Gray , Harpreet Hyare , Parashkev Nachev