English
Related papers

Related papers: Splitting Gaussian Process Regression for Streamin…

200 papers

Statistical models are an essential tool to model, forecast and understand the hydrological processes in watersheds. In particular, the understanding of time lags associated with the delay between rainfall occurrence and subsequent changes…

Gaussian processes with derivative information are useful in many settings where derivative information is available, including numerous Bayesian optimization and regression tasks that arise in the natural sciences. Incorporating derivative…

Machine Learning · Computer Science 2021-07-12 Misha Padidar , Xinran Zhu , Leo Huang , Jacob R. Gardner , David Bindel

We formulate a reduced-order strategy for efficiently forecasting complex high-dimensional dynamical systems entirely based on data streams. The first step of our method involves reconstructing the dynamics in a reduced-order subspace of…

Data Analysis, Statistics and Probability · Physics 2017-03-08 Zhong Yi Wan , Themistoklis P. Sapsis

Gaussian processes (GPs) are flexible non-parametric models, with a capacity that grows with the available data. However, computational constraints with standard inference procedures have limited exact GPs to problems with fewer than about…

Nonstationary non-Gaussian spatial data are common in many disciplines, including climate science, ecology, epidemiology, and social sciences. Examples include count data on disease incidence and binary satellite data on cloud mask…

Computation · Statistics 2020-11-30 Benjamin Seiyon Lee , Jaewoo Park

The Gaussian process is an indispensable tool for spatial data analysts. The onset of the "big data" era, however, has lead to the traditional Gaussian process being computationally infeasible for modern spatial data. As such, various…

The Gaussian mixture model is a classic technique for clustering and data modeling that is used in numerous applications. With the rise of big data, there is a need for parameter estimation techniques that can handle streaming data and…

Artificial Intelligence · Computer Science 2016-09-20 Priyank Jaini , Pascal Poupart

Gaussian process classification is a popular method with a number of appealing properties. We show how to scale the model within a variational inducing point framework, outperforming the state of the art on benchmark datasets. Importantly,…

Machine Learning · Statistics 2014-11-10 James Hensman , Alex Matthews , Zoubin Ghahramani

We present a general framework for classification of sparse and irregularly-sampled time series. The properties of such time series can result in substantial uncertainty about the values of the underlying temporal processes, while making…

Machine Learning · Statistics 2016-11-01 Steven Cheng-Xian Li , Benjamin Marlin

Gaussian processes are the gold standard for many real-world modeling problems, especially in cases where a model's success hinges upon its ability to faithfully represent predictive uncertainty. These problems typically exist as parts of…

We propose a novel class of dynamic shrinkage processes for Bayesian time series and regression analysis. Building upon a global-local framework of prior construction, in which continuous scale mixtures of Gaussian distributions are…

Methodology · Statistics 2019-07-02 Daniel R. Kowal , David S. Matteson , David Ruppert

Gaussian processes provide a framework for nonlinear nonparametric Bayesian inference widely applicable across science and engineering. Unfortunately, their computational burden scales cubically with the training sample size, which in the…

Machine Learning · Statistics 2021-07-16 Alec Koppel , Hrusikesha Pradhan , Ketan Rajawat

Many applications in speech, robotics, finance, and biology deal with sequential data, where ordering matters and recurrent structures are common. However, this structure cannot be easily captured by standard kernel functions. To model such…

Machine Learning · Computer Science 2017-10-06 Maruan Al-Shedivat , Andrew Gordon Wilson , Yunus Saatchi , Zhiting Hu , Eric P. Xing

In this paper, we study the problem of learning a mixture of Gaussians with streaming data: given a stream of $N$ points in $d$ dimensions generated by an unknown mixture of $k$ spherical Gaussians, the goal is to estimate the model…

Machine Learning · Computer Science 2017-07-11 Aditi Raghunathan , Ravishankar Krishnaswamy , Prateek Jain

Gaussian processes (GPs) are sophisticated distributions to model functional data. Whilst theoretically appealing, they are computationally cumbersome except for small datasets. We implement two methods for scaling GP inference in Stan:…

Methodology · Statistics 2024-01-11 Till Hoffmann , Jukka-Pekka Onnela

By enabling constraint-aware online model adaptation, model predictive control using Gaussian process (GP) regression has exhibited impressive performance in real-world applications and received considerable attention in the learning-based…

Optimization and Control · Mathematics 2024-09-17 Amon Lahr , Andrea Zanelli , Andrea Carron , Melanie N. Zeilinger

Yield curve forecasting is an important problem in finance. In this work we explore the use of Gaussian Processes in conjunction with a dynamic modeling strategy, much like the Kalman Filter, to model the yield curve. Gaussian Processes…

Machine Learning · Statistics 2017-03-07 Rajiv Sambasivan , Sourish Das

We consider the problem of breaking a multivariate (vector) time series into segments over which the data is well explained as independent samples from a Gaussian distribution. We formulate this as a covariance-regularized maximum…

Optimization and Control · Mathematics 2018-04-30 David Hallac , Peter Nystrup , Stephen Boyd

Safety-critical technical systems operating in unknown environments require the ability to quickly adapt their behavior, which can be achieved in control by inferring a model online from the data stream generated during operation. Gaussian…

Systems and Control · Electrical Eng. & Systems 2022-02-24 Armin Lederer , Mingmin Zhang , Samuel Tesfazgi , Sandra Hirche

Emerging applications of machine learning in numerous areas involve continuous gathering of and learning from streams of data. Real-time incorporation of streaming data into the learned models is essential for improved inference in these…

Machine Learning · Computer Science 2020-12-01 Matthew Nokleby , Haroon Raja , Waheed U. Bajwa