English
Related papers

Related papers: A Bayesian Gaussian Process-Based Latent Discrimin…

200 papers

Heteroscedastic regression considering the varying noises among observations has many applications in the fields like machine learning and statistics. Here we focus on the heteroscedastic Gaussian process (HGP) regression which integrates…

Machine Learning · Statistics 2020-01-22 Haitao Liu , Yew-Soon Ong , Jianfei Cai

Deep neural networks (DNNs) have become a key part of many modern software applications. After training and validating, the DNN is deployed as an irrevocable component and applied in real-world scenarios. Although most DNNs are built…

Machine Learning · Computer Science 2021-03-31 JingWei Xu , Siyuan Zhu , Zenan Li , Chang Xu

The Dynamical Gaussian Process Latent Variable Models provide an elegant non-parametric framework for learning the low dimensional representations of the high-dimensional time-series. Real world observational studies, however, are often…

Machine Learning · Computer Science 2019-09-26 Thanh Le , Vasant Honavar

Deep Gaussian processes (DGPs) provide a rich class of models that can better represent functions with varying regimes or sharp changes, compared to conventional GPs. In this work, we propose a novel inference method for DGPs for computer…

Machine Learning · Statistics 2022-08-18 Deyu Ming , Daniel Williamson , Serge Guillas

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

Numerically solving partial differential equations (PDEs) can be challenging and computationally expensive. This has led to the development of reduced-order models (ROMs) that are accurate but faster than full order models (FOMs). Recently,…

Computational Engineering, Finance, and Science · Computer Science 2024-05-30 Christophe Bonneville , Youngsoo Choi , Debojyoti Ghosh , Jonathan L. Belof

Graphical models are commonly used tools for modeling multivariate random variables. While there exist many convenient multivariate distributions such as Gaussian distribution for continuous data, mixed data with the presence of discrete…

Machine Learning · Statistics 2014-04-30 Jianqing Fan , Han Liu , Yang Ning , Hui Zou

Gaussian processes (GPs) can provide a principled approach to uncertainty quantification with easy-to-interpret kernel hyperparameters, such as the lengthscale, which controls the correlation distance of function values. However, selecting…

In this paper, we propose projected gradient descent (PGD) algorithms for signal estimation from noisy nonlinear measurements. We assume that the unknown $p$-dimensional signal lies near the range of an $L$-Lipschitz continuous generative…

Machine Learning · Statistics 2022-09-22 Zhaoqiang Liu , Jun Han

It is desirable to combine the expressive power of deep learning with Gaussian Process (GP) in one expressive Bayesian learning model. Deep kernel learning showed success in adopting a deep network for feature extraction followed by a GP…

Machine Learning · Computer Science 2021-10-26 Chi-Ken Lu , Patrick Shafto

We investigate statistical properties of a likelihood approach to nonparametric estimation of a singular distribution using deep generative models. More specifically, a deep generative model is used to model high-dimensional data that are…

Machine Learning · Statistics 2023-03-29 Minwoo Chae , Dongha Kim , Yongdai Kim , Lizhen Lin

There is increasing interest in the problem of nonparametric regression with high-dimensional predictors. When the number of predictors $D$ is large, one encounters a daunting problem in attempting to estimate a $D$-dimensional surface…

Statistics Theory · Mathematics 2014-06-17 Yun Yang , David B. Dunson

Planning is a powerful approach to control problems with known environment dynamics. In unknown environments the agent needs to learn a model of the system dynamics to make planning applicable. This is particularly challenging when the…

Machine Learning · Computer Science 2020-05-11 Nathanael Bosch , Jan Achterhold , Laura Leal-Taixé , Jörg Stückler

Distributed Gaussian process (DGP) is a popular approach to scale GP to big data which divides the training data into some subsets, performs local inference for each partition, and aggregates the results to acquire global prediction. To…

Machine Learning · Computer Science 2022-02-08 Hamed Jalali , Gjergji Kasneci

We study information-theoretic phase transitions for the detectability of latent geometry in bipartite random geometric graphs RGGs with Gaussian d-dimensional latent vectors while only a subset of edges carries latent information…

Probability · Mathematics 2026-04-13 Andreas Göbel , Marcus Pappik , Leon Schiller

This paper introduces an active learning framework for manifold Gaussian Process (GP) regression, combining manifold learning with strategic data selection to improve accuracy in high-dimensional spaces. Our method jointly optimizes a…

Machine Learning · Statistics 2026-05-12 Yuanxing Cheng , Lulu Kang , Yiwei Wang , Chun Liu

Deep Gaussian processes (DGPs) can model complex marginal densities as well as complex mappings. Non-Gaussian marginals are essential for modelling real-world data, and can be generated from the DGP by incorporating uncorrelated variables…

Machine Learning · Statistics 2019-05-15 Hugh Salimbeni , Vincent Dutordoir , James Hensman , Marc Peter Deisenroth

The Gaussian process latent variable model (GP-LVM) provides a flexible approach for non-linear dimensionality reduction that has been widely applied. However, the current approach for training GP-LVMs is based on maximum likelihood, where…

Machine Learning · Statistics 2014-09-09 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

We propose L3DG, the first approach for generative 3D modeling of 3D Gaussians through a latent 3D Gaussian diffusion formulation. This enables effective generative 3D modeling, scaling to generation of entire room-scale scenes which can be…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Barbara Roessle , Norman Müller , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Angela Dai , Matthias Nießner

Likelihood-based deep generative models (DGMs) have gained significant attention for their ability to approximate the distributions of high-dimensional data. However, these models lack a performance guarantee in assigning higher likelihood…

Machine Learning · Computer Science 2025-02-04 Behrooz Montazeran , Ullrich Köthe