English
Related papers

Related papers: Conditionally Gaussian Random Sequences for an Int…

200 papers

This chapter presents specific aspects of Gaussian process modeling in the presence of complex noise. Starting from the standard homoscedastic model, various generalizations from the literature are presented: input varying noise variance,…

Optimization and Control · Mathematics 2024-12-11 Mickael Binois , Arindam Fadikar , Abby Stevens

Gaussian multiplicative noise is commonly used as a stochastic regularisation technique in training of deterministic neural networks. A recent paper reinterpreted the technique as a specific algorithm for approximate inference in Bayesian…

Machine Learning · Statistics 2017-11-09 Jiri Hron , Alexander G. de G. Matthews , Zoubin Ghahramani

Gravitational wave detectors like the Einstein Telescope and LISA generate long multivariate time series, which pose significant challenges in spectral density estimation due to a number of overlapping signals as well as the presence of…

General Relativity and Quantum Cosmology · Physics 2024-09-23 Jianan Liu , Avi Vajpeyi , Renate Meyer , Kamiel Janssens , Jeung Eun Lee , Patricio Maturana-Russel , Nelson Christensen , Yixuan Liu

We investigate the frequentist guarantees of the variational sparse Gaussian process regression model. In the theoretical analysis, we focus on the variational approach with spectral features as inducing variables. We derive guarantees and…

Statistics Theory · Mathematics 2023-09-29 Dennis Nieman , Botond Szabo , Harry van Zanten

Variational Bayesian neural nets combine the flexibility of deep learning with Bayesian uncertainty estimation. Unfortunately, there is a tradeoff between cheap but simple variational families (e.g.~fully factorized) or expensive and…

Machine Learning · Computer Science 2018-02-27 Guodong Zhang , Shengyang Sun , David Duvenaud , Roger Grosse

It is a common phenomenon that for high-dimensional and nonparametric statistical models, rate-optimal estimators balance squared bias and variance. Although this balancing is widely observed, little is known whether methods exist that…

Statistics Theory · Mathematics 2023-03-21 Alexis Derumigny , Johannes Schmidt-Hieber

This paper considers the problem of estimating a periodic function in a continuous time regression model with an additive stationary gaussian noise having unknown correlation function. A general model selection procedure on the basis of…

Statistics Theory · Mathematics 2010-11-10 Victor Konev , Serguei Pergamenchtchikov

In high dimension, it is customary to consider Lasso-type estimators to enforce sparsity. For standard Lasso theory to hold, the regularization parameter should be proportional to the noise level, yet the latter is generally unknown in…

Machine Learning · Statistics 2017-10-19 Mathurin Massias , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

We develop an automated variational method for inference in models with Gaussian process (GP) priors and general likelihoods. The method supports multiple outputs and multiple latent functions and does not require detailed knowledge of the…

Machine Learning · Statistics 2018-11-06 Edwin V. Bonilla , Karl Krauth , Amir Dezfouli

We present a simple variant of the Gaussian mechanism for answering differentially private queries when the sensitivity space has a certain common structure. Our motivating problem is the fundamental task of answering $d$ counting queries…

Cryptography and Security · Computer Science 2025-03-19 Christian Janos Lebeda

This paper focuses on efficient computational approaches to compute approximate solutions of a linear inverse problem that is contaminated with mixed Poisson--Gaussian noise, and when there are additional outliers in the measured data. The…

Numerical Analysis · Mathematics 2018-01-22 Marie Kubínová , James G. Nagy

This paper is centered around the approximation of dynamical systems by means of Gaussian processes. To this end, trajectories of such systems must be collected to be used as training data. The measurements of these trajectories are…

Systems and Control · Electrical Eng. & Systems 2025-04-02 Tobias M. Wolff , Victor G. Lopez , Matthias A. Müller

This paper introduces a consistent estimator and rate of convergence for the precision matrix of asset returns in large portfolios using a non-linear factor model within the deep learning framework. Our estimator remains valid even in low…

Machine Learning · Statistics 2023-08-30 Mehmet Caner , Maurizio Daniele

Inference for GP models with non-Gaussian noises is computationally expensive when dealing with large datasets. Many recent inference methods approximate the posterior distribution with a simpler distribution defined on a small number of…

Machine Learning · Computer Science 2018-09-11 Linfeng Liu , Liping Liu

A continuous-time regression model with a jointly strictly sub-Gaussian random noise is considered in the paper. Upper exponential bounds for probabilities of large deviations of the least squares estimator for the regression parameter are…

Probability · Mathematics 2018-06-12 Alexander V. Ivanov , Igor V. Orlovskyi

We consider model-based clustering methods for continuous, correlated data that account for external information available in the presence of mixed-type fixed covariates by proposing the MoEClust suite of models. These models allow…

Methodology · Statistics 2021-07-15 Keefe Murphy , Thomas Brendan Murphy

An empirical Bayes approach to the estimation of possibly sparse sequences observed in Gaussian white noise is set out and investigated. The prior considered is a mixture of an atom of probability at zero and a heavy-tailed density \gamma,…

Statistics Theory · Mathematics 2007-06-13 Iain M. Johnstone , Bernard W. Silverman

Gravitational-wave parameter estimation for compact binary signals typically relies on sequential estimation of the properties of the detector Gaussian noise and of the binary parameters. This procedure assumes that the noise variance,…

General Relativity and Quantum Cosmology · Physics 2022-11-14 Cailin Plunkett , Sophie Hourihane , Katerina Chatziioannou

Real-world measurement noise in applications like robotics is often correlated in time, but we typically assume i.i.d. Gaussian noise for filtering. We propose general Gaussian Processes as a non-parametric model for correlated measurement…

Machine Learning · Statistics 2019-09-25 Vince Kurtz , Hai Lin

Variational autoencoders often assume isotropic Gaussian priors and mean-field posteriors, hence do not exploit structure in scenarios where we may expect similarity or consistency across latent variables. Gaussian process variational…

Machine Learning · Statistics 2020-11-17 Metod Jazbec , Michael Pearce , Vincent Fortuin