English
Related papers

Related papers: Generalizing Multimodal Variational Methods to Set…

200 papers

Variational autoencoder (VAE) is a deep generative model for unsupervised learning, allowing to encode observations into the meaningful latent space. VAE is prone to catastrophic forgetting when tasks arrive sequentially, and only the data…

Machine Learning · Computer Science 2021-11-04 Anna Kuzina , Evgenii Egorov , Evgeny Burnaev

Many different methods to train deep generative models have been introduced in the past. In this paper, we propose to extend the variational auto-encoder (VAE) framework with a new type of prior which we call "Variational Mixture of…

Machine Learning · Computer Science 2018-02-27 Jakub M. Tomczak , Max Welling

Data often are formed of multiple modalities, which jointly describe the observed phenomena. Modeling the joint distribution of multimodal data requires larger expressive power to capture high-level concepts and provide better data…

Machine Learning · Computer Science 2020-09-09 Sasho Nedelkoski , Mihail Bogojeski , Odej Kao

In this paper, we propose a cross-modal variational auto-encoder (CMVAE) for content-based micro-video background music recommendation. CMVAE is a hierarchical Bayesian generative model that matches relevant background music to a…

Multimedia · Computer Science 2022-12-13 Jing Yi , Yaochen Zhu , Jiayi Xie , Zhenzhong Chen

Content mismatch usually occurs when data from one modality is translated to another, e.g. language learners producing mispronunciations (errors in speech) when reading a sentence (target text) aloud. However, most existing alignment…

Machine Learning · Computer Science 2023-01-10 Wei Wei , Huang Hengguan , Gu Xiangming , Wang Hao , Wang Ye

Multimodal sentiment analysis (MSA) is a fundamental complex research problem due to the heterogeneity gap between different modalities and the ambiguity of human emotional expression. Although there have been many successful attempts to…

Machine Learning · Computer Science 2022-07-05 Jiahao Zheng , Sen Zhang , Xiaoping Wang , Zhigang Zeng

Generative models for multimodal data permit the identification of latent factors that may be associated with important determinants of observed data heterogeneity. Common or shared factors could be important for explaining variation across…

Machine Learning · Statistics 2024-03-12 Kaspar Märtens , Christopher Yau

Long-term human motion can be represented as a series of motion modes---motion sequences that capture short-term temporal dynamics---with transitions between them. We leverage this structure and present a novel Motion Transformation…

Machine Learning · Computer Science 2018-08-15 Xinchen Yan , Akash Rastogi , Ruben Villegas , Kalyan Sunkavalli , Eli Shechtman , Sunil Hadap , Ersin Yumer , Honglak Lee

Multimodal remote sensing classification often suffers from missing modalities caused by sensor failures and environmental interference, leading to severe performance degradation. In this work, we rethink missing-modality learning from a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Qinghao Gao , Jiahui Qu , Wenqian Dong

Learning latent representations that are simultaneously expressive, geometrically well-structured, and reliably calibrated remains a central challenge for Variational Autoencoders (VAEs). Standard VAEs typically assume a diagonal Gaussian…

Machine Learning · Computer Science 2025-12-02 Mehmet Can Yavuz

Variational Autoencoder (VAE), a simple and effective deep generative model, has led to a number of impressive empirical successes and spawned many advanced variants and theoretical investigations. However, recent studies demonstrate that,…

Machine Learning · Computer Science 2019-01-08 Xuezhe Ma , Chunting Zhou , Eduard Hovy

In this paper, we present a multimodal and dynamical VAE (MDVAE) applied to unsupervised audio-visual speech representation learning. The latent space is structured to dissociate the latent dynamical factors that are shared between the…

Sound · Computer Science 2024-02-21 Samir Sadok , Simon Leglaive , Laurent Girin , Xavier Alameda-Pineda , Renaud Séguier

Elucidating the functional mechanisms of the primary visual cortex (V1) remains a fundamental challenge in systems neuroscience. Current computational models face two critical limitations, namely the challenge of cross-modal integration…

Neurons and Cognition · Quantitative Biology 2024-12-20 Yu Zhu , Bo Lei , Chunfeng Song , Wanli Ouyang , Shan Yu , Tiejun Huang

One of the major shortcomings of variational autoencoders is the inability to produce generations from the individual modalities of data originating from mixture distributions. This is primarily due to the use of a simple isotropic Gaussian…

Machine Learning · Computer Science 2019-12-02 Frantzeska Lavda , Magda Gregorová , Alexandros Kalousis

Deep generative models with latent variables have been used lately to learn joint representations and generative processes from multi-modal data. These two learning mechanisms can, however, conflict with each other and representations can…

Machine Learning · Computer Science 2023-01-24 Rogelio A. Mancisidor , Michael Kampffmeyer , Kjersti Aas , Robert Jenssen

Despite the recent success in probabilistic modeling and their applications, generative models trained using traditional inference techniques struggle to adapt to new distributions, even when the target distribution may be closely related…

Machine Learning · Computer Science 2019-09-17 Mike Wu , Kristy Choi , Noah Goodman , Stefano Ermon

Deep learning, even if it is very successful nowadays, traditionally needs very large amounts of labeled data to perform excellent on the classification task. In an attempt to solve this problem, the one-shot learning paradigm, which makes…

Computer Vision and Pattern Recognition · Computer Science 2018-04-23 Decebal Constantin Mocanu , Elena Mocanu

Multi-view data from the same source often exhibit correlation. This is mirrored in correlation between the latent spaces of separate variational autoencoders (VAEs) trained on each data-view. A multi-view VAE approach is proposed that…

Machine Learning · Statistics 2025-08-01 Ella S. C. Orme , Marina Evangelou , Ulrich Paquet

Multi-modal entity alignment (MMEA) aims to identify equivalent entity pairs across different multi-modal knowledge graphs (MMKGs). Existing approaches focus on how to better encode and aggregate information from different modalities.…

Information Retrieval · Computer Science 2024-04-30 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

Multimodal learning with variational autoencoders (VAEs) requires estimating joint distributions to evaluate the evidence lower bound (ELBO). Current methods, the product and mixture of experts, aggregate single-modality distributions…

Machine Learning · Computer Science 2025-05-05 Rogelio A Mancisidor , Robert Jenssen , Shujian Yu , Michael Kampffmeyer