English
Related papers

Related papers: Hetero-Modal Variational Encoder-Decoder for Joint…

200 papers

3D image segmentation plays an important role in biomedical image analysis. Many 2D and 3D deep learning models have achieved state-of-the-art segmentation performance on 3D biomedical image datasets. Yet, 2D and 3D models have their own…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Hao Zheng , Yizhe Zhang , Lin Yang , Peixian Liang , Zhuo Zhao , Chaoli Wang , Danny Z. Chen

Variational Autoencoders (VAEs) have been shown to be remarkably effective in recovering model latent spaces for several computer vision tasks. However, currently trained VAEs, for a number of reasons, seem to fall short in learning…

Machine Learning · Computer Science 2021-07-27 Chandrajit Bajaj , Avik Roy , Haoran Zhang

Current deep learning-based manifold learning algorithms such as the variational autoencoder (VAE) require fully sampled data to learn the probability density of real-world datasets. Once learned, the density can be used for a variety of…

Image and Video Processing · Electrical Eng. & Systems 2021-12-13 Qing Zou , Abdul Haseeb Ahmed , Prashant Nagpal , Sarv Priya , Rolf Schulte , Mathews Jacob

Accurate segmentation of brain tumors plays a key role in the diagnosis and treatment of brain tumor diseases. It serves as a critical technology for quantifying tumors and extracting their features. With the increasing application of deep…

Image and Video Processing · Electrical Eng. & Systems 2024-11-05 Longfeng Shen , Yanqi Hou , Jiacong Chen , Liangjin Diao , Yaxi Duan

Recent advances in deep learning have significantly improved brain tumour segmentation techniques; however, the results still lack confidence and robustness as they solely consider image data without biophysical priors or pathological…

Image and Video Processing · Electrical Eng. & Systems 2024-10-10 Lipei Zhang , Yanqi Cheng , Lihao Liu , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

Unsupervised anomaly detection (UAD) presents a complementary alternative to supervised learning for brain tumor segmentation in magnetic resonance imaging (MRI), particularly when annotated datasets are limited, costly, or inconsistent. In…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Gerard Comas-Quiles , Carles Garcia-Cabrera , Julia Dietlmeier , Noel E. O'Connor , Ferran Marques

Multi-modal learning is typically performed with network architectures containing modality-specific layers and shared layers, utilizing co-registered images of different modalities. We propose a novel learning scheme for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Qi Dou , Quande Liu , Pheng Ann Heng , Ben Glocker

Accurate and efficient brain tumor segmentation remains a critical challenge in neuroimaging due to the heterogeneous nature of tumor subregions and the high computational cost of volumetric inference. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Fatemeh Ziaeetabar

Multimodal networks have demonstrated remarkable performance improvements over their unimodal counterparts. Existing multimodal networks are designed in a multi-branch fashion that, due to the reliance on fusion strategies, exhibit…

Clustering high-dimensional data, such as images or biological measurements, is a long-standingproblem and has been studied extensively. Recently, Deep Clustering has gained popularity due toits flexibility in fitting the specific…

Machine Learning · Computer Science 2020-12-21 Andreas Kopf , Vincent Fortuin , Vignesh Ram Somnath , Manfred Claassen

Blood vessels (BVs) play a critical role in the Tumor Micro-Environment (TME), potentially influencing cancer progression and treatment response. However, manually quantifying BVs in Hematoxylin and Eosin (H&E) stained images is challenging…

Image and Video Processing · Electrical Eng. & Systems 2025-01-27 Jiaqi Lv , Stefan S Antonowicz , Shan E Ahmed Raza

In real world clinical environments, training and applying deep learning models on multi-modal medical imaging data often struggles with partially incomplete data. Standard approaches either discard missing samples, require imputation or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Christoph Fürböck , Paul Weiser , Branko Mitic , Philipp Seeböck , Thomas Helbich , Georg Langs

Hyperspectral image analysis often requires selecting the most informative bands instead of processing the whole data without losing the key information. Existing band reduction (BR) methods have the capability to reveal the nonlinear…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Muhammad Ahmad , Asad Khan , Adil Mehmood Khan , Rasheed Hussain

Deep learning has quickly become the weapon of choice for brain lesion segmentation. However, few existing algorithms pre-configure any biological context of their chosen segmentation tissues, and instead rely on the neural network's…

Computer Vision and Pattern Recognition · Computer Science 2017-09-12 Andrew Beers , Ken Chang , James Brown , Emmett Sartor , CP Mammen , Elizabeth Gerstner , Bruce Rosen , Jayashree Kalpathy-Cramer

The missing modality issue is critical but non-trivial to be solved by multi-modal models. Current methods aiming to handle the missing modality problem in multi-modal tasks, either deal with missing modalities only during evaluation or…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Hu Wang , Yuanhong Chen , Congbo Ma , Jodie Avery , Louise Hull , Gustavo Carneiro

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing…

Machine Learning · Computer Science 2026-05-19 Sina Tabakhi , Chen , Chen , Haiping Lu

Deep learning has demonstrated remarkable success in medical image segmentation and computer-aided diagnosis. In particular, numerous advanced methods have achieved state-of-the-art performance in brain tumor segmentation from MRI scans.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xiaoyu Shi , Rahul Kumar Jain , Yinhao Li , Ruibo Hou , Jingliang Cheng , Jie Bai , Guohua Zhao , Lanfen Lin , Rui Xu , Yen-wei Chen

Over the last few years machine learning has demonstrated groundbreaking results in many areas of medical image analysis, including segmentation. A key assumption, however, is that the train- and test distributions match. We study a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Kenneth Lau , Jonas Adler , Jens Sjölund

Brain lesion segmentation plays an essential role in neurological research and diagnosis. As brain lesions can be caused by various pathological alterations, different types of brain lesions tend to manifest with different characteristics…

Image and Video Processing · Electrical Eng. & Systems 2024-07-17 Xinru Zhang , Ni Ou , Berke Doga Basaran , Marco Visentin , Mengyun Qiao , Renyang Gu , Cheng Ouyang , Yaou Liu , Paul M. Matthew , Chuyang Ye , Wenjia Bai