English
Related papers

Related papers: Multiscale Sparse Microcanonical Models

200 papers

We introduce a novel Bayesian approach for variable selection using Gaussian process regression, which is crucial for enhancing interpretability and model regularization. Our method employs nearest neighbor Gaussian processes, serving as…

Gaussian process (GP) regression has been widely used in supervised machine learning due to its flexibility and inherent ability to describe uncertainty in function estimation. In the context of control, it is seeing increasing use for…

Systems and Control · Computer Science 2020-01-01 Lukas Hewing , Juraj Kabzan , Melanie N. Zeilinger

We introduce a nonparametric approach for estimating drift and diffusion functions in systems of stochastic differential equations from observations of the state vector. Gaussian processes are used as flexible models for these functions and…

Data Analysis, Statistics and Probability · Physics 2018-08-15 Philipp Batz , Andreas Ruttor , Manfred Opper

We introduce a new interpretation of sparse variational approximations for Gaussian processes using inducing points, which can lead to more scalable algorithms than previous methods. It is based on decomposing a Gaussian process as a sum of…

Machine Learning · Statistics 2024-02-27 Jiaxin Shi , Michalis K. Titsias , Andriy Mnih

We study nonparametric Bayesian inference for the intensity function of a covariate-driven point process. We extend recent results from the literature, showing that a wide class of Gaussian priors, combined with flexible link functions,…

Statistics Theory · Mathematics 2025-05-27 Patric Dolmeta , Matteo Giordano

Gaussian Processes (GPs) are Bayesian models that provide uncertainty estimates associated to the predictions made. They are also very flexible due to their non-parametric nature. Nevertheless, GPs suffer from poor scalability as the number…

Machine Learning · Computer Science 2021-07-16 Bahram Jafrasteh , Carlos Villacampa-Calvo , Daniel Hernández-Lobato

We study general coordinate-wise MCMC schemes (such as Metropolis-within-Gibbs samplers), which are commonly used to fit Bayesian non-conjugate hierarchical models. We relate their convergence properties to the ones of the corresponding…

Computation · Statistics 2026-01-12 Filippo Ascolani , Gareth O. Roberts , Giacomo Zanella

We characterize the sample size required for accurate graphical model selection from non-stationary samples. The observed data is modeled as a vector-valued zero-mean Gaussian random process whose samples are uncorrelated but have different…

Machine Learning · Computer Science 2019-06-28 Nguyen Q. Tran , Oleksii Abramenko , Alexander Jung

Let $(X_j)_{j\geq1}$ be a multivariate long-range dependent Gaussian process. We study the asymptotic behavior of the corresponding sequential empirical process indexed by a class of functions. If some entropy condition is satisfied we have…

Probability · Mathematics 2017-01-06 Jannis Buchsteiner

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

We study estimation and prediction of Gaussian processes with covariance model belonging to the generalized Cauchy (GC) family, under fixed domain asymptotics. Gaussian processes with this kind of covariance function provide separate…

Methodology · Statistics 2019-07-23 Moreno Bevilacqua , Tarik Faouzi

The use of Gaussian process models is typically limited to datasets with a few tens of thousands of observations due to their complexity and memory footprint. The two most commonly used methods to overcome this limitation are 1) the…

Machine Learning · Statistics 2020-01-16 Vincent Adam , Stefanos Eleftheriadis , Nicolas Durrande , Artem Artemev , James Hensman

Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms,…

Methodology · Statistics 2017-08-21 Luca Faes , Daniele Marinazzo , Sebastiano Stramaglia

Monte-Carlo techniques are standard numerical tools for exploring non-Gaussian and multivariate likelihoods. Many variants of the original Metropolis-Hastings algorithm have been proposed to increase the sampling efficiency. Motivated by…

Cosmology and Nongalactic Astrophysics · Physics 2024-10-31 Maximilian Philipp Herzog , Heinrich von Campe , Rebecca Maria Kuntz , Lennart Röver , Björn Malte Schäfer

Gaussian processes are a natural way of defining prior distributions over functions of one or more input variables. In a simple nonparametric regression problem, where such a function gives the mean of a Gaussian distribution for an…

Data Analysis, Statistics and Probability · Physics 2008-02-03 Radford M. Neal

Data-driven modelling and computational predictions based on maximum entropy principle (MaxEnt-principle) aim at finding as-simple-as-possible - but not simpler then necessary - models that allow to avoid the data overfitting problem. We…

Computation · Statistics 2020-11-25 Horenko Illia , Marchenko Ganna , Gagliardini Patrick

The anisotropic quantum Heisenberg model with Curie-Weiss-type interactions is studied analytically in several variants of the microcanonical ensemble. (Non)equivalence of microcanonical and canonical ensembles is investigated by studying…

Statistical Mechanics · Physics 2014-09-25 Gerrit Olivier , Michael Kastner

Multi-output Gaussian process (MGP) is commonly used as a transfer learning method to leverage information among multiple outputs. A key advantage of MGP is providing uncertainty quantification for prediction, which is highly important for…

Machine Learning · Statistics 2024-09-06 Wang Xinming , Li Yongxiang , Yue Xiaowei , Wu Jianguo

The sparse pseudo-input Gaussian process (SPGP) is a new approximation method for speeding up GP regression in the case of a large number of data points N. The approximation is controlled by the gradient optimization of a small set of M…

Machine Learning · Computer Science 2012-07-02 Edward Snelson , Zoubin Ghahramani

Gaussian processes (GPs) provide a probabilistic nonparametric representation of functions in regression, classification, and other problems. Unfortunately, exact learning with GPs is intractable for large datasets. A variety of approximate…

Machine Learning · Computer Science 2010-02-23 Yuan Qi , Ahmed H. Abdel-Gawad , Thomas P. Minka