English
Related papers

Related papers: Multi-modal Variational Autoencoders for normative…

200 papers

Anomaly detection is vital in various industrial scenarios, including the identification of unusual patterns in production lines and the detection of manufacturing defects for quality control. Existing techniques tend to be specialized in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Xiaohao Xu , Yunkang Cao , Huaxin Zhang , Nong Sang , Xiaonan Huang

Normative modeling has emerged as a pivotal approach for characterizing heterogeneity and individual variance in neurodegenerative diseases, notably Alzheimer's disease(AD). One of the challenges of cortical normative modeling is the…

Image and Video Processing · Electrical Eng. & Systems 2026-03-13 Jianwei Zhang , Yonggang Shi

Multi-modal data-sets are ubiquitous in modern applications, and multi-modal Variational Autoencoders are a popular family of models that aim to learn a joint representation of the different modalities. However, existing approaches suffer…

Machine Learning · Computer Science 2023-12-19 Mustapha Bounoua , Giulio Franzese , Pietro Michiardi

Pathological brain appearances may be so heterogeneous as to be intelligible only as anomalies, defined by their deviation from normality rather than any specific pathological characteristic. Amongst the hardest tasks in medical imaging,…

Image and Video Processing · Electrical Eng. & Systems 2021-02-24 Walter Hugo Lopez Pinaya , Petru-Daniel Tudosiu , Robert Gray , Geraint Rees , Parashkev Nachev , Sebastien Ourselin , M. Jorge Cardoso

The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an…

Machine Learning · Computer Science 2023-11-21 Mine Öğretir , Siddharth Ramchandran , Dimitrios Papatheodorou , Harri Lähdesmäki

Human perception is inherently multimodal. We integrate, for instance, visual, proprioceptive and tactile information into one experience. Hence, multimodal learning is of importance for building robotic systems that aim at robustly…

Machine Learning · Computer Science 2024-11-04 Carlotta Langer , Yasmin Kim Georgie , Ilja Porohovoj , Verena Vanessa Hafner , Nihat Ay

Multimodal imaging has transformed neuroscience research. While it presents unprecedented opportunities, it also imposes serious challenges. Particularly, it is difficult to combine the merits of the interpretability attributed to a simple…

Methodology · Statistics 2021-11-25 Xiaowu Dai , Lexin Li

Predicting survival in Amyotrophic Lateral Sclerosis (ALS) is a challenging task. Magnetic resonance imaging (MRI) data provide in vivo insight into brain health, but the low prevalence of the condition and resultant data scarcity limit…

The paper presents the application of Variational Autoencoders (VAE) for data dimensionality reduction and explorative analysis of mass spectrometry imaging data (MSI). The results confirm that VAEs are capable of detecting the patterns…

Quantitative Methods · Quantitative Biology 2017-08-25 Paolo Inglese , James L. Alexander , Anna Mroz , Zoltan Takats , Robert Glen

Variational autoencoder (VAE) is one of the most common techniques in the field of medical image generation, where this architecture has shown advanced researchers in recent years and has developed into various architectures. VAE has…

Machine Learning · Computer Science 2024-11-13 Khadija Rais , Mohamed Amroune , Abdelmadjid Benmachiche , Mohamed Yassine Haouam

Recent advances in deep learning led to novel generative modeling techniques that achieve unprecedented quality in generated samples and performance in learning complex distributions in imaging data. These new models in medical image…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Xiaoran Chen , Nick Pawlowski , Martin Rajchl , Ben Glocker , Ender Konukoglu

Anomaly detection in medical images is a challenging task, since anomalies are not typically available during training. Recent methods leverage a single pretext task coupled with a large-scale pre-trained model to reach state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Bogdan Alexandru Bercean , Florinel Alin Croitoru , Vlad Hondru , Ciprian Mihai Ceausescu , Andreea Iuliana Ionescu , Radu Tudor Ionescu

Multimodal VAEs seek to model the joint distribution over heterogeneous data (e.g.\ vision, language), whilst also capturing a shared representation across such modalities. Prior work has typically combined information from the modalities…

Machine Learning · Computer Science 2022-12-19 Tom Joy , Yuge Shi , Philip H. S. Torr , Tom Rainforth , Sebastian M. Schmon , N. Siddharth

Recent efforts towards video anomaly detection (VAD) try to learn a deep autoencoder to describe normal event patterns with small reconstruction errors. The video inputs with large reconstruction errors are regarded as anomalies at the test…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yuandu Lai , Yahong Han , Yaowei Wang

Building a scalable machine learning system for unsupervised anomaly detection via representation learning is highly desirable. One of the prevalent methods is using a reconstruction error from variational autoencoder (VAE) via maximizing…

Machine Learning · Computer Science 2020-05-08 Seonho Park , George Adosoglou , Panos M. Pardalos

Recent developments in high throughput profiling of individual neurons have spurred data driven exploration of the idea that there exist natural groupings of neurons referred to as cell types. The promise of this idea is that the immense…

Neurons and Cognition · Quantitative Biology 2019-11-14 Rohan Gala , Nathan Gouwens , Zizhen Yao , Agata Budzillo , Osnat Penn , Bosiljka Tasic , Gabe Murphy , Hongkui Zeng , Uygar Sümbül

Computational models of neurodegeneration aim to emulate the evolving pattern of pathology in the brain during neurodegenerative disease, such as Alzheimer's disease. Previous studies have made specific choices on the mechanisms of…

Quantitative Methods · Quantitative Biology 2023-08-11 Tiantian He , Elinor Thompson , Anna Schroder , Neil P. Oxtoby , Ahmed Abdulaal , Frederik Barkhof , Daniel C. Alexander

We present a multi-module framework based on Conditional Variational Autoencoder (CVAE) to detect anomalies in the power signals coming from multiple High Voltage Converter Modulators (HVCMs). We condition the model with the specific…

Modelling the underlying mechanisms of neurodegenerative diseases demands methods that capture heterogeneous and spatially varying dynamics from sparse, high-dimensional neuroimaging data. Integrating partial differential equation (PDE)…

Image and Video Processing · Electrical Eng. & Systems 2025-09-19 Sanduni Pinnawala , Annabelle Hartanto , Ivor J. A. Simpson , Peter A. Wijeratne

Medical multimodal representation learning aims to integrate heterogeneous data into unified patient representations to support clinical outcome prediction. However, real-world medical datasets commonly contain systematic biases from…

Machine Learning · Computer Science 2026-05-19 Xiaoguang Zhu , Linxiao Gong , Lianlong Sun , Yang Liu , Haoyu Wang , Jing Liu