English
Related papers

Related papers: On Latent Distributions Without Finite Mean in Gen…

200 papers

Building on the remarkable achievements in generative sampling of natural images, we propose an innovative challenge, potentially overly ambitious, which involves generating samples of entire multivariate time series that resemble images.…

The distribution of a neural network's latent representations has been successfully used to detect out-of-distribution (OOD) data. This work investigates whether this distribution moreover correlates with a model's epistemic uncertainty,…

Machine Learning · Computer Science 2021-02-24 Janis Postels , Hermann Blum , Yannick Strümpler , Cesar Cadena , Roland Siegwart , Luc Van Gool , Federico Tombari

Neural samplers such as variational autoencoders (VAEs) or generative adversarial networks (GANs) approximate distributions by transforming samples from a simple random source---the latent space---to samples from a more complex distribution…

Machine Learning · Statistics 2018-02-09 Nutan Chen , Alexej Klushyn , Richard Kurle , Xueyan Jiang , Justin Bayer , Patrick van der Smagt

Discriminative linear models are a popular tool in machine learning. These can be generally divided into two types: The first is linear classifiers, such as support vector machines, which are well studied and provide state-of-the-art…

Machine Learning · Computer Science 2012-07-02 Koby Crammer , Amir Globerson

Stochastic Interpolants (SI) is a powerful framework for generative modeling, capable of flexibly transforming between two probability distributions. However, its use in jointly optimized latent variable models remains unexplored as it…

Machine Learning · Computer Science 2026-04-23 Saurabh Singh , Dmitry Lagun

The latent position cluster model is a popular model for the statistical analysis of network data. This approach assumes that there is an underlying latent space in which the actors follow a finite mixture distribution. Moreover, actors…

Computation · Statistics 2013-08-23 Nial Friel , Caitriona Ryan , Jason Wyse

We identify and analyze a surprising phenomenon of Latent Diffusion Models (LDMs) where the final steps of the diffusion can degrade sample quality. In contrast to conventional arguments that justify early stopping for numerical stability,…

Machine Learning · Statistics 2026-03-03 Yu-Han Wu , Quentin Berthet , Gérard Biau , Claire Boyer , Romuald Elie , Pierre Marion

Given data, deep generative models, such as variational autoencoders (VAE) and generative adversarial networks (GAN), train a lower dimensional latent representation of the data space. The linear Euclidean geometry of data space pulls back…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Line Kuhnel , Tom Fletcher , Sarang Joshi , Stefan Sommer

Deep generative models with latent variables have been used lately to learn joint representations and generative processes from multi-modal data. These two learning mechanisms can, however, conflict with each other and representations can…

Machine Learning · Computer Science 2023-01-24 Rogelio A. Mancisidor , Michael Kampffmeyer , Kjersti Aas , Robert Jenssen

We establish some limit theorems for quasi-arithmetic means of random variables. This class of means contains the arithmetic, geometric and harmonic means. Our feature is that the generators of quasi-arithmetic means are allowed to be…

Statistics Theory · Mathematics 2022-05-09 Yuichi Akaoka , Kazuki Okamura , Yoshiki Otobe

Probabilistic forecasting of high dimensional multivariate time series is a notoriously challenging task, both in terms of computational burden and distribution modeling. Most previous work either makes simple distribution assumptions or…

Machine Learning · Computer Science 2021-01-27 Nam Nguyen , Brian Quanz

We analyze the (unconditional) distribution of a linear predictor that is constructed after a data-driven model selection step in a linear regression model. First, we derive the exact finite-sample cumulative distribution function (cdf) of…

Statistics Theory · Mathematics 2008-12-02 Hannes Leeb

In this work, we explore the theoretical properties of conditional deep generative models under the statistical framework of distribution regression where the response variable lies in a high-dimensional ambient space but concentrates…

Statistics Theory · Mathematics 2026-02-02 Shivam Kumar , Yun Yang , Lizhen Lin

The methodology developed in this article is motivated by a wide range of prediction and uncertainty quantification problems that arise in Statistics, Machine Learning and Applied Mathematics, such as non-parametric regression, multi-class…

Methodology · Statistics 2019-03-26 Victor Chen , Matthew M. Dunlop , Omiros Papaspiliopoulos , Andrew M. Stuart

Graphical models are commonly used tools for modeling multivariate random variables. While there exist many convenient multivariate distributions such as Gaussian distribution for continuous data, mixed data with the presence of discrete…

Machine Learning · Statistics 2014-04-30 Jianqing Fan , Han Liu , Yang Ning , Hui Zou

The latent position cluster model is a popular model for the statistical analysis of network data. This model assumes that there is an underlying latent space in which the actors follow a finite mixture distribution. Moreover, actors which…

Computation · Statistics 2017-02-02 Caitriona Ryan , Jason Wyse , Nial Friel

Multivariate categorical data occur in many applications of machine learning. One of the main difficulties with these vectors of categorical variables is sparsity. The number of possible observations grows exponentially with vector length,…

Machine Learning · Statistics 2015-03-10 Yarin Gal , Yutian Chen , Zoubin Ghahramani

Cascaded models are multi-scale generative models with a marked capacity for producing perceptually impressive samples at high resolutions. In this work, we show that they can also be excellent likelihood models, so long as we overcome a…

Machine Learning · Computer Science 2025-01-14 Henry Li , Ronen Basri , Yuval Kluger

Most work on supervised learning research has focused on marginal predictions. In decision problems, joint predictive distributions are essential for good performance. Previous work has developed methods for assessing low-order predictive…

Machine Learning · Statistics 2022-03-01 Ian Osband , Zheng Wen , Seyed Mohammad Asghari , Vikranth Dwaracherla , Xiuyuan Lu , Benjamin Van Roy

In this paper, we construct an intermediate distribution linking the Gaussian and the Cauchy distribution. We provide the probability density function and the corresponding characteristic function of the intermediate distribution. Because…

Data Analysis, Statistics and Probability · Physics 2015-06-11 Tong Liu , Ping Zhang , Wu-Sheng Dai , Mi Xie