English
Related papers

Related papers: Autoencoders and Probabilistic Inference with Miss…

200 papers

In many scientific disciplines, the features of interest cannot be observed directly, so must instead be inferred from observed behaviour. Latent variable analyses are increasingly employed to systematise these inferences, and Principal…

The problem of estimating event truths from conflicting agent opinions in a social network is investigated. An autoencoder learns the complex relationships between event truths, agent reliabilities and agent observations. A Bayesian network…

Machine Learning · Computer Science 2021-01-26 Jielong Yang , Wee Peng Tay

Conformal Autoencoders are a neural network architecture that imposes orthogonality conditions between the gradients of latent variables to obtain disentangled representations of data. In this work we show that orthogonality relations…

Machine Learning · Computer Science 2025-07-14 George A. Kevrekidis , Zan Ahmad , Mauro Maggioni , Soledad Villar , Yannis G. Kevrekidis

We present a representation learning algorithm that learns a low-dimensional latent dynamical system from high-dimensional \textit{sequential} raw data, e.g., video. The framework builds upon recent advances in amortized inference methods…

Machine Learning · Computer Science 2020-01-29 Jung-Su Ha , Young-Jin Park , Hyeok-Joo Chae , Soon-Seo Park , Han-Lim Choi

Multi-modal data-sets are ubiquitous in modern applications, and multi-modal Variational Autoencoders are a popular family of models that aim to learn a joint representation of the different modalities. However, existing approaches suffer…

Machine Learning · Computer Science 2023-12-19 Mustapha Bounoua , Giulio Franzese , Pietro Michiardi

Ubiquitous linear Gaussian exploratory tools such as principle component analysis (PCA) and factor analysis (FA) remain widely used as tools for: exploratory analysis, pre-processing, data visualization and related tasks. However, due to…

Machine Learning · Computer Science 2021-03-02 Adam Farooq , Yordan P. Raykov , Petar Raykov , Max A. Little

Advances in variational inference enable parameterisation of probabilistic models by deep neural networks. This combines the statistical transparency of the probabilistic modelling framework with the representational power of deep learning.…

Computation and Language · Computer Science 2020-05-05 Tom Pelsmaeker , Wilker Aziz

Network data are often sampled with auxiliary information or collected through the observation of a complex system over time, leading to multiple network snapshots indexed by a continuous variable. Many methods in statistical network…

Methodology · Statistics 2024-07-16 Peter W. MacDonald , Elizaveta Levina , Ji Zhu

Distributions are fundamental statistical elements that play essential theoretical and practical roles. The article discusses experiences of training neural networks to classify univariate empirical distributions and to represent them on…

Machine Learning · Computer Science 2020-04-07 Alex Glushkovsky

Longitudinal data are important in numerous fields, such as healthcare, sociology and seismology, but real-world datasets present notable challenges for practitioners because they can be high-dimensional, contain structured missingness…

Machine Learning · Computer Science 2024-07-01 Maksim Sinelnikov , Manuel Haussmann , Harri Lähdesmäki

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

Machine Learning · Statistics 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

Connectivity estimation is challenging in the context of high-dimensional data. A useful preprocessing step is to group variables into clusters, however, it is not always clear how to do so from the perspective of connectivity estimation.…

Machine Learning · Statistics 2018-05-25 Ricardo Pio Monti , Aapo Hyvärinen

We deal with the problem of learning the underlying disentangled latent factors that are shared between the paired bi-modal data in cross-modal retrieval. Our assumption is that the data in both modalities are complex, structured, and high…

Machine Learning · Computer Science 2020-12-02 Minyoung Kim , Ricardo Guerrero , Vladimir Pavlovic

Machine-learning models have demonstrated a great ability to learn complex patterns and make predictions. In high-dimensional nonlinear problems of fluid dynamics, data representation often greatly affects the performance and…

Fluid Dynamics · Physics 2022-07-29 Runze Li , Yufei Zhang , Haixin Chen

Variational autoencoders (VAE) often use Gaussian or category distribution to model the inference process. This puts a limit on variational learning because this simplified assumption does not match the true posterior distribution, which is…

Machine Learning · Computer Science 2017-02-28 Ke Sun , Xiangliang Zhang

Feature attribution methods (FAs), such as gradients and attention, are widely employed approaches to derive the importance of all input features to the model predictions. Existing work in natural language processing has mostly focused on…

Computation and Language · Computer Science 2024-02-09 Zhixue Zhao , Boxuan Shan

In many data analysis tasks, it is beneficial to learn representations where each dimension is statistically independent and thus disentangled from the others. If data generating factors are also statistically independent, disentangled…

Machine Learning · Statistics 2019-12-12 Harshvardhan Sikka , Weishun Zhong , Jun Yin , Cengiz Pehlevan

Deep learning methods can classify various unstructured data such as images, language, and voice as input data. As the task of classifying anomalies becomes more important in the real world, various methods exist for classifying using deep…

Computer Vision and Pattern Recognition · Computer Science 2022-01-06 UJu Gim , YeongHyeon Park

This work addresses the problem of missing data in time-series analysis focusing on (a) estimation of model parameters in the presence of missing data and (b) reconstruction of missing data. Standard approaches used to solve these problems…

Methodology · Statistics 2020-01-01 Dimitri Igdalov , Olga Kaiser , Ilia Horenko

Missing data is an inevitable and common problem in data-driven intelligent transportation systems (ITS). In the past decade, scholars have done many research on the recovery of missing traffic data, however how to make full use of…

Signal Processing · Electrical Eng. & Systems 2022-08-17 Yuting Ding , Di Wu