English
Related papers

Related papers: Enhancing Modality-Agnostic Representations via Me…

200 papers

The analysis of multi-modality positron emission tomography and computed tomography (PET-CT) images for computer aided diagnosis applications requires combining the sensitivity of PET to detect abnormal regions with anatomical localization…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Ashnil Kumar , Michael Fulham , Dagan Feng , Jinman Kim

Combining multiple modalities carrying complementary information through multimodal learning (MML) has shown considerable benefits for diagnosing multiple pathologies. However, the robustness of multimodal models to missing modalities is…

Machine Learning · Computer Science 2024-07-31 Hava Chaptoukaev , Vincenzo Marcianó , Francesco Galati , Maria A. Zuluaga

This paper presents a novel predictive model, MetaMorph, for metamorphic registration of images with appearance changes (i.e., caused by brain tumors). In contrast to previous learning-based registration methods that have little or no…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Jian Wang , Jiarui Xing , Jason Druzgal , William M. Wells , Miaomiao Zhang

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang

Multi-modal learning is typically performed with network architectures containing modality-specific layers and shared layers, utilizing co-registered images of different modalities. We propose a novel learning scheme for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Qi Dou , Quande Liu , Pheng Ann Heng , Ben Glocker

Tumor segmentation in multimodal medical images has seen a growing trend towards deep learning based methods. Typically, studies dealing with this topic fuse multimodal image data to improve the tumor segmentation contour for a single…

Image and Video Processing · Electrical Eng. & Systems 2020-09-25 Theresa Neubauer , Maria Wimmer , Astrid Berg , David Major , Dimitrios Lenis , Thomas Beyer , Jelena Saponjski , Katja Bühler

Few-shot learning is a challenging problem that has attracted more and more attention recently since abundant training samples are difficult to obtain in practical applications. Meta-learning has been proposed to address this issue, which…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Xian Zhong , Cheng Gu , Wenxin Huang , Lin Li , Shuqin Chen , Chia-Wen Lin

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

Unsupervised pre-training has been proven as an effective approach to boost various downstream tasks given limited labeled data. Among various methods, contrastive learning learns a discriminative representation by constructing positive and…

Image and Video Processing · Electrical Eng. & Systems 2022-02-17 Jizong Peng , Ping Wang , Marco Pedersoli , Christian Desrosiers

Purpose: Lesion segmentation in medical imaging is key to evaluating treatment response. We have recently shown that reinforcement learning can be applied to radiological images for lesion localization. Furthermore, we demonstrated that…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Joseph Stember , Hrithwik Shalu

Pre-training a recognition model with contrastive learning on a large dataset of unlabeled data has shown great potential to boost the performance of a downstream task, e.g., image classification. However, in domains such as medical…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jizong Peng , Ping Wang , Chrisitian Desrosiers , Marco Pedersoli

Deep learning models perform best when tested on target (test) data domains whose distribution is similar to the set of source (train) domains. However, model generalization can be hindered when there is significant difference in the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Pulkit Khandelwal , Paul Yushkevich

Often in medical imaging, it is prohibitively challenging to produce enough boundary annotations to train deep neural networks for accurate tumor segmentation. We propose the use of weak labels about whether an image presents tumor or…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Eugene Vorontsov , Pavlo Molchanov , Christopher Beckham , Jan Kautz , Samuel Kadoury

Image segmentation is a fundamental problem in biomedical image analysis. Recent advances in deep learning have achieved promising results on many biomedical image segmentation benchmarks. However, due to large variations in biomedical…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Lin Yang , Yizhe Zhang , Jianxu Chen , Siyuan Zhang , Danny Z. Chen

Meta-learning approaches have been proposed to tackle the few-shot learning problem.Typically, a meta-learner is trained on a variety of tasks in the hopes of being generalizable to new tasks. However, the generalizability on new tasks of a…

Machine Learning · Computer Science 2018-05-22 Muhammad Abdullah Jamal , Guo-Jun Qi , Mubarak Shah

Recently, machine learning-based semantic segmentation algorithms have demonstrated their potential to accurately segment regions and contours in medical images, allowing the precise location of anatomical structures and abnormalities.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yifei Wang , Chuhong Zhu

Magnetic resonance (MR) protocols rely on several sequences to assess pathology and organ status properly. Despite advances in image analysis, we tend to treat each sequence, here termed modality, in isolation. Taking advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Agisilaos Chartsias , Giorgos Papanastasiou , Chengjia Wang , Scott Semple , David E. Newby , Rohan Dharmakumar , Sotirios A. Tsaftaris

One of the most challenges in medical imaging is the lack of data and annotated data. It is proven that classical segmentation methods such as U-NET are useful but still limited due to the lack of annotated data. Using a weakly supervised…

Image and Video Processing · Electrical Eng. & Systems 2020-03-20 Amine Amyar , Romain Modzelewski , Pierre Vera , Vincent Morard , Su Ruan

The ability to dynamically extend a model to new data and classes is critical for multiple organ and tumor segmentation. However, due to privacy regulations, accessing previous data and annotations can be problematic in the medical domain.…

Image and Video Processing · Electrical Eng. & Systems 2023-07-24 Yixiao Zhang , Xinyi Li , Huimiao Chen , Alan Yuille , Yaoyao Liu , Zongwei Zhou

Survival analysis stands as a pivotal process in cancer treatment research, crucial for predicting patient survival rates accurately. Recent advancements in data collection techniques have paved the way for enhancing survival predictions by…

Machine Learning · Computer Science 2024-07-26 Linhao Qu , Dan Huang , Shaoting Zhang , Xiaosong Wang