English
Related papers

Related papers: Latent space projection predictive inference

200 papers

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

Deeply-learned planning methods are often based on learning representations that are optimized for unrelated tasks. For example, they might be trained on reconstructing the environment. These representations are then combined with predictor…

Machine Learning · Computer Science 2021-03-18 Hlynur Davíð Hlynsson , Merlin Schüler , Robin Schiewer , Tobias Glasmachers , Laurenz Wiskott

We propose a novel shape representation useful for analyzing and processing shape collections, as well for a variety of learning and inference tasks. Unlike most approaches that capture variability in a collection by using a template model…

Graphics · Computer Science 2018-06-13 Ruqi Huang , Panos Achlioptas , Leonidas Guibas , Maks Ovsjanikov

Several recent works have explored stochastic gradient methods for variational inference that exploit the geometry of the variational-parameter space. However, the theoretical properties of these methods are not well-understood and these…

Machine Learning · Statistics 2016-08-15 Mohammad Emtiyaz Khan , Reza Babanezhad , Wu Lin , Mark Schmidt , Masashi Sugiyama

A powerful and flexible approach to structured prediction consists in embedding the structured objects to be predicted into a feature space of possibly infinite dimension by means of output kernels, and then, solving a regression problem in…

Machine Learning · Statistics 2020-11-03 Luc Brogat-Motte , Alessandro Rudi , Céline Brouard , Juho Rousu , Florence d'Alché-Buc

Constraints are a natural choice for prior information in Bayesian inference. In various applications, the parameters of interest lie on the boundary of the constraint set. In this paper, we use a method that implicitly defines a…

Statistics Theory · Mathematics 2022-09-27 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

An analysis of high-dimensional data can offer a detailed description of a system but is often challenged by the curse of dimensionality. General dimensionality reduction techniques can alleviate such difficulty by extracting a few…

Methodology · Statistics 2021-09-28 Di Bo , Hoon Hwangbo , Vinit Sharma , Corey Arndt , Stephanie C. TerMaath

Reliable predictive uncertainty estimation plays an important role in enabling the deployment of neural networks to safety-critical settings. A popular approach for estimating the predictive uncertainty of neural networks is to define a…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Zonghao Chen , Yee Whye Teh , Yarin Gal

This paper presents a probabilistic approach to represent and quantify model-form uncertainties in the reduced-order modeling of complex systems using operator inference techniques. Such uncertainties can arise in the selection of an…

Machine Learning · Statistics 2024-11-08 Jin Yi Yong , Rudy Geelen , Johann Guilleminot

We propose a new method for simplification of Gaussian process (GP) models by projecting the information contained in the full encompassing model and selecting a reduced number of variables based on their predictive relevance. Our results…

Methodology · Statistics 2017-12-18 Juho Piironen , Aki Vehtari

High-dimensional, heterogeneous data with complex feature interactions pose significant challenges for traditional predictive modeling approaches. While Projection to Latent Structures (PLS) remains a popular technique, it struggles to…

Machine Learning · Computer Science 2025-10-21 Farwa Abbas , Hussain Ahmad , Claudia Szabo

Multivariate distributions often carry latent structures that are difficult to identify and estimate, and which better reflect the data generating mechanism than extrinsic structures exhibited simply by the raw data. In this paper, we…

Methodology · Statistics 2025-04-16 Bryon Aragam , Ruiyi Yang

We consider the inverse Ising problem, i.e. the inference of network couplings from observed spin trajectories for a model with continuous time Glauber dynamics. By introducing two sets of auxiliary latent random variables we render the…

Machine Learning · Statistics 2017-12-22 Christian Donner , Manfred Opper

We present a novel approach for constrained Bayesian inference. Unlike current methods, our approach does not require convexity of the constraint set. We reduce the constrained variational inference to a parametric optimization over the…

Machine Learning · Computer Science 2013-09-27 Oluwasanmi Koyejo , Joydeep Ghosh

Latent representations are used extensively for downstream tasks, such as visualization, interpolation or feature extraction of deep learning models. Invariant and equivariant neural networks are powerful and well-established models for…

Machine Learning · Computer Science 2025-01-16 Andreas Abildtrup Hansen , Anna Calissano , Aasa Feragen

Variational Bayesian inference is an important machine-learning tool that finds application from statistics to robotics. The goal is to find an approximate probability density function (PDF) from a chosen family that is in some sense…

Machine Learning · Computer Science 2022-09-27 Timothy D. Barfoot , Gabriele M. T. D'Eleuterio

Latent force models are a class of hybrid models for dynamic systems, combining simple mechanistic models with flexible Gaussian process (GP) perturbations. An extension of this framework to include multiplicative interactions between the…

Machine Learning · Statistics 2019-01-01 Daniel J. Tait , Bruce J. Worton

Generative classifiers offer potential advantages over their discriminative counterparts, namely in the areas of data efficiency, robustness to data shift and adversarial examples, and zero-shot learning (Ng and Jordan,2002; Yogatama et…

Computation and Language · Computer Science 2019-10-02 Xiaoan Ding , Kevin Gimpel

Pose Machines provide a sequential prediction framework for learning rich implicit spatial models. In this work we show a systematic design for how convolutional networks can be incorporated into the pose machine framework for learning…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Shih-En Wei , Varun Ramakrishna , Takeo Kanade , Yaser Sheikh

We present a model that can automatically learn alignments between high-dimensional data in an unsupervised manner. Our proposed method casts alignment learning in a framework where both alignment and data are modelled simultaneously.…

Machine Learning · Statistics 2019-03-04 Ieva Kazlauskaite , Carl Henrik Ek , Neill D. F. Campbell