English
Related papers

Related papers: Bayesian Inference and Learning in Gaussian Proces…

200 papers

This work presents a data-driven method for learning low-dimensional time-dependent physics-based surrogate models whose predictions are endowed with uncertainty estimates. We use the operator inference approach to model reduction that…

Numerical Analysis · Mathematics 2025-03-19 Shane A. McQuarrie , Anirban Chaudhuri , Karen E. Willcox , Mengwu Guo

The performance of learning-based control techniques crucially depends on how effectively the system is explored. While most exploration techniques aim to achieve a globally accurate model, such approaches are generally unsuited for systems…

Machine Learning · Computer Science 2020-06-11 Alexandre Capone , Jonas Umlauft , Thomas Beckers , Armin Lederer , Sandra Hirche

The methodology developed in this article is motivated by a wide range of prediction and uncertainty quantification problems that arise in Statistics, Machine Learning and Applied Mathematics, such as non-parametric regression, multi-class…

Methodology · Statistics 2019-03-26 Victor Chen , Matthew M. Dunlop , Omiros Papaspiliopoulos , Andrew M. Stuart

Gaussian processes are Bayesian non-parametric models used in many areas. In this work, we propose a Non-stationary Heteroscedastic Gaussian process model which can be learned with gradient-based techniques. We demonstrate the…

Machine Learning · Computer Science 2022-12-26 Zeel B Patel , Nipun Batra , Kevin Murphy

Learning dynamical models from data is not only fundamental but also holds great promise for advancing principle discovery, time-series prediction, and controller design. Among various approaches, Gaussian Process State-Space Models…

Machine Learning · Computer Science 2025-10-20 Tengjie Zheng , Haipeng Chen , Lin Cheng , Shengping Gong , Xu Huang

In this paper, we introduce the notion of Gaussian processes indexed by probability density functions for extending the Mat\'ern family of covariance functions. We use some tools from information geometry to improve the efficiency and the…

Methodology · Statistics 2020-11-09 A. Fradi , Y. Feunteun , C. Samir , M. Baklouti , F. Bachoc , J-M. Loubes

We propose a new variational inference algorithm for learning in Gaussian Process State-Space Models (GPSSMs). Our algorithm enables learning of unstable and partially observable systems, where previous algorithms fail. Our main algorithmic…

Machine Learning · Computer Science 2020-06-11 Silvan Melchior , Sebastian Curi , Felix Berkenkamp , Andreas Krause

Predictive dynamical models for marine ecosystems are used for a variety of needs. Due to sparse measurements and limited understanding of the myriad of ocean processes, there is however significant uncertainty. There is model uncertainty…

Computational Engineering, Finance, and Science · Computer Science 2023-06-06 Abhinav Gupta , Pierre F. J. Lermusiaux

We propose a novel sampling framework for inference in probabilistic models: an active learning approach that converges more quickly (in wall-clock time) than Markov chain Monte Carlo (MCMC) benchmarks. The central challenge in…

Machine Learning · Statistics 2014-11-04 Tom Gunter , Michael A. Osborne , Roman Garnett , Philipp Hennig , Stephen J. Roberts

We consider the modeling of data generated by a latent continuous-time Markov jump process with a state space of finite but unknown dimensions. Typically in such models, the number of states has to be pre-specified, and Bayesian inference…

Methodology · Statistics 2021-08-12 Yu Luo , David A. Stephens

We present a scalable and robust Bayesian inference method for linear state space models. The method is applied to demand forecasting in the context of a large e-commerce platform, paying special attention to intermittent and bursty target…

Within the past two decades, Gaussian process regression has been increasingly used for modeling dynamical systems due to some beneficial properties such as the bias variance trade-off and the strong connection to Bayesian mathematics. As…

Systems and Control · Electrical Eng. & Systems 2021-02-11 Thomas Beckers

We present a survey of some of our recent results on Bayesian nonparametric inference for a multitude of stochastic processes. The common feature is that the prior distribution in the cases considered is on suitable sets of piecewise…

Statistics Theory · Mathematics 2024-06-04 Denis Belomestny , Frank van der Meulen , Peter Spreij

Inference for mechanistic models is challenging because of nonlinear interactions between model parameters and a lack of identifiability. Here we focus on a specific class of mechanistic models, which we term stable differential equations.…

Computation · Statistics 2017-12-13 Philip Maybank , Ingo Bojak , Richard G. Everitt

Gaussian process is a theoretically appealing model for nonparametric analysis, but its computational cumbersomeness hinders its use in large scale and the existing reduced-rank solutions are usually heuristic. In this work, we propose a…

Machine Learning · Statistics 2015-11-25 Leo L. Duan , Xia Wang , Rhonda D. Szczesniak

State-space models (SSM) are central to describe time-varying complex systems in countless signal processing applications such as remote sensing, networks, biomedicine, and finance to name a few. Inference and prediction in SSMs are…

Computation · Statistics 2022-10-26 Víctor Elvira , Émilie Chouzenoux

State-space models effectively model multivariate time series by updating over time a representation of the system state from which predictions are made. The state representation is usually a vector without any explicit structure.…

Machine Learning · Computer Science 2026-04-07 Daniele Zambon , Andrea Cini , Cesare Alippi

Circular time series has received relatively little attention in statistics and modeling complex circular time series using the state space approach is non-existent in the literature. In this article we introduce a flexible Bayesian…

Methodology · Statistics 2017-03-16 Satyaki Mazumder , Sourabh Bhattacharya

Capturing the correlation emerging between constituents of many-body systems accurately is one of the key challenges for the appropriate description of various systems whose properties are underpinned by quantum mechanical fundamentals.…

Quantum Physics · Physics 2023-08-17 Yannic Rath

When dealing with datasets containing a billion instances or with simulations that require a supercomputer to execute, computational resources become part of the equation. We can improve the efficiency of learning and inference by…

Machine Learning · Computer Science 2014-03-06 Max Welling