English
Related papers

Related papers: Hierarchical Gaussian Processes with Wasserstein-2…

200 papers

We study learning problems in which the conditional distribution of the output given the input varies as a function of additional task variables. In varying-coefficient models with Gaussian process priors, a Gaussian process generates the…

Machine Learning · Computer Science 2015-10-15 Matthias Bussas , Christoph Sawade , Tobias Scheffer , Niels Landwehr

The object of study in this paper is the expected $2$-Wasserstein distance between the empirical measures of several point processes and their respective limit. For this, the main tool developed is a smoothing procedure in Euclidean spaces…

Probability · Mathematics 2026-03-20 P. García Arias

Collections of probability distributions arise in a variety of applications ranging from user activity pattern analysis to brain connectomics. In practice these distributions can be defined over diverse domain types including finite…

Methodology · Statistics 2023-06-16 Raif Rustamov , Subhabrata Majumdar

We present a novel approach to approximate Gaussian and mixture-of-Gaussians filtering. Our method relies on a variational approximation via a gradient-flow representation. The gradient flow is derived from a Kullback--Leibler discrepancy…

Computation · Statistics 2023-06-21 Adrien Corenflos , Hany Abdulsamad

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

Machine Learning · Statistics 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

The family of Mat\'ern kernels are often used in spatial statistics, function approximation and Gaussian process methods in machine learning. One reason for their popularity is the presence of a smoothness parameter that controls, for…

Statistics Theory · Mathematics 2025-06-06 Moritz Korte-Stapff , Toni Karvonen , Eric Moulines

Generative Adversarial Nets (GANs) are very successful at modeling distributions from given samples, even in the high-dimensional case. However, their formulation is also known to be hard to optimize and often not stable. While this is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Ishan Deshpande , Ziyu Zhang , Alexander Schwing

The proliferation of large data sets and Bayesian inference techniques motivates demand for better data sparsification. Coresets provide a principled way of summarizing a large dataset via a smaller one that is guaranteed to match the…

Machine Learning · Statistics 2020-03-04 Sebastian Claici , Aude Genevay , Justin Solomon

The proximal algorithm is a powerful tool to minimize nonlinear and nonsmooth functionals in a general metric space. Motivated by the recent progress in studying the training dynamics of the noisy gradient descent algorithm on two-layer…

Optimization and Control · Mathematics 2026-05-19 Shuailong Zhu , Xiaohui Chen

In high-dimensional time series analysis, Gaussian approximation (GA) schemes under various distance measures or on various collections of subsets of the Euclidean space play a fundamental role in a wide range of statistical inference…

Statistics Theory · Mathematics 2025-06-11 Miaoshiqi Liu , Jun Yang , Zhou Zhou

This paper is an attempt to bridge the conceptual gaps between researchers working on the two widely used approaches based on positive definite kernels: Bayesian learning or inference using Gaussian processes on the one side, and…

Machine Learning · Statistics 2018-07-10 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K Sriperumbudur

Outlier Detection is a critical and cardinal research task due its array of applications in variety of domains ranging from data mining, clustering, statistical analysis, fraud detection, network intrusion detection and diagnosis of…

Machine Learning · Computer Science 2018-03-15 Archit Harsh , John E. Ball , Pan Wei

Many machine learning problems can be seen as approximating a \textit{target} distribution using a \textit{particle} distribution by minimizing their statistical discrepancy. Wasserstein Gradient Flow can move particles along a path that…

Machine Learning · Statistics 2024-06-07 Song Liu , Jiahao Yu , Jack Simons , Mingxuan Yi , Mark Beaumont

The analysis of parametric and non-parametric uncertainties of very large dynamical systems requires the construction of a stochastic model of said system. Linear approaches relying on random matrix theory and principal componant analysis…

Machine Learning · Statistics 2023-02-02 Hamza Boukraichi , Nissrine Akkari , Fabien Casenave , David Ryckelynck

This paper proposes a nonparametric Bayesian framework called VariScan for simultaneous clustering, variable selection, and prediction in high-throughput regression settings. Poisson-Dirichlet processes are utilized to detect…

Methodology · Statistics 2019-10-08 Subharup Guha , Veerabhadran Baladandayuthapani

This paper introduces algorithms to select/design kernels in Gaussian process regression/kriging surrogate modeling techniques. We adopt the setting of kernel method solutions in ad hoc functional spaces, namely Reproducing Kernel Hilbert…

Machine Learning · Statistics 2022-09-07 Jean-Luc Akian , Luc Bonnet , Houman Owhadi , Éric Savin

The Gaussian kernel plays a central role in machine learning, uncertainty quantification and scattered data approximation, but has received relatively little attention from a numerical analysis standpoint. The basic problem of finding an…

Numerical Analysis · Mathematics 2021-04-02 Toni Karvonen , Chris J. Oates , Mark Girolami

Statistical models are an essential tool to model, forecast and understand the hydrological processes in watersheds. In particular, the understanding of time lags associated with the delay between rainfall occurrence and subsequent changes…

The mean-field theory for two-layer neural networks considers infinitely wide networks that are linearly parameterized by a probability measure over the parameter space. This nonparametric perspective has significantly advanced both the…

Machine Learning · Computer Science 2025-08-08 Sinho Chewi , Philippe Rigollet , Yuling Yan

We consider state estimation for networked systems where measurements from sensor nodes are contaminated by outliers. A new hierarchical measurement model is formulated for outlier detection by integrating the outlier-free measurement model…

Applications · Statistics 2022-11-08 Hongwei Wang , Hongbin Li , Wei Zhang , Junyi Zuo , Heping Wang , Jun Fang