English
Related papers

Related papers: An Efficient Implementation for Spatial-Temporal G…

200 papers

Excellent variational approximations to Gaussian process posteriors have been developed which avoid the $\mathcal{O}\left(N^3\right)$ scaling with dataset size $N$. They reduce the computational cost to $\mathcal{O}\left(NM^2\right)$, with…

Machine Learning · Statistics 2019-09-05 David R. Burt , Carl E. Rasmussen , Mark van der Wilk

This paper introduces a new sparse spatio-temporal structured Gaussian process regression framework for online and offline Bayesian inference. This is the first framework that gives a time-evolving representation of the interdependencies…

Machine Learning · Statistics 2018-08-01 Danil Kuzin , Olga Isupova , Lyudmila Mihaylova

Non-Gaussian spatial and spatio-temporal data are becoming increasingly prevalent, and their analysis is needed in a variety of disciplines. FRK is an R package for spatial/spatio-temporal modelling and prediction with very large data sets…

Computation · Statistics 2022-11-22 Matthew Sainsbury-Dale , Andrew Zammit-Mangion , Noel Cressie

The application of Gaussian processes (GPs) to large data sets is limited due to heavy memory and computational requirements. A variety of methods has been proposed to enable scalability, one of which is to exploit structure in the kernel…

Machine Learning · Computer Science 2019-12-30 Jan Graßhoff , Alexandra Jankowski , Philipp Rostalski

Koopman Mode Decomposition (KMD) is a technique of nonlinear time-series analysis that originates from point spectrum of the Koopman operator defined for an underlying nonlinear dynamical system. We present a numerical algorithm of KMD…

Signal Processing · Electrical Eng. & Systems 2019-11-18 Akitoshi Masuda , Yoshihiko Susuki , Manel Martínez-Ramón , Andrea Mammoli , Atsushi Ishigame

We consider the accuracy of an approximate posterior distribution in nonparametric regression problems by combining posterior distributions computed on subsets of the data defined by the locations of the independent variables. We show that…

Statistics Theory · Mathematics 2025-04-29 Botond Szabo , Amine Hadji , Aad van der Vaart

The Gaussian process state-space model (GPSSM) has attracted extensive attention for modeling complex nonlinear dynamical systems. However, the existing GPSSM employs separate Gaussian processes (GPs) for each latent state dimension,…

Machine Learning · Computer Science 2023-09-06 Zhidi Lin , Juan Maroñas , Ying Li , Feng Yin , Sergios Theodoridis

Gaussian Processes are widely used for regression tasks. A known limitation in the application of Gaussian Processes to regression tasks is that the computation of the solution requires performing a matrix inversion. The solution also…

Machine Learning · Computer Science 2017-08-22 Sourish Das , Sasanka Roy , Rajiv Sambasivan

A generator of spatio-temporal pseudo-random Gaussian fields that satisfy the "proportionality of scales" property (Tsyroulnikov, 2001) is presented. The generator is based on a third-order in time stochastic differential equation with a…

Data Analysis, Statistics and Probability · Physics 2018-05-15 Michael Tsyrulnikov , Dmitry Gayfulin

Gaussian processes are used in many machine learning applications that rely on uncertainty quantification. Recently, computational tools for working with these models in geometric settings, such as when inputs lie on a Riemannian manifold,…

Machine Learning · Statistics 2023-10-31 Paul Rosa , Viacheslav Borovitskiy , Alexander Terenin , Judith Rousseau

Gaussian processes (GPs) produce good probabilistic models of functions, but most GP kernels require $O((n+m)n^2)$ time, where $n$ is the number of data points and $m$ the number of predictive locations. We present a new kernel that allows…

Machine Learning · Computer Science 2023-04-03 Michael K. Cohen , Samuel Daulton , Michael A. Osborne

In this paper, we develop a new and effective approach to nonparametric quantile regression that accommodates ultrahigh-dimensional data arising from spatio-temporal processes. This approach proves advantageous in staving off computational…

Methodology · Statistics 2024-05-27 Soudeep Deb , Claudia Neves , Subhrajyoty Roy

We develop a novel framework to accelerate Gaussian process regression (GPR). In particular, we consider localization kernels at each data point to down-weigh the contributions from other data points that are far away, and we derive the GPR…

Machine Learning · Statistics 2022-10-19 Davit Gogolashvili , Bogdan Kozyrskiy , Maurizio Filippone

This paper proposes an online learning method of Gaussian process state-space model (GP-SSM). GP-SSM is a probabilistic representation learning scheme that represents unknown state transition and/or measurement models as Gaussian processes…

Robotics · Computer Science 2024-10-30 Soon-Seo Park , Young-Jin Park , Youngjae Min , Han-Lim Choi

Gaussian processes (GPs) are important probabilistic tools for inference and learning in spatio-temporal modelling problems such as those in climate science and epidemiology. However, existing GP approximations do not simultaneously support…

Machine Learning · Computer Science 2021-06-21 Will Tebbutt , Arno Solin , Richard E. Turner

Explosive growth in spatio-temporal data and its wide range of applications have attracted increasing interests of researchers in the statistical and machine learning fields. The spatio-temporal regression problem is of paramount importance…

Machine Learning · Computer Science 2020-09-15 Aniruddha Rajendra Rao , Qiyao Wang , Haiyan Wang , Hamed Khorasgani , Chetan Gupta

Exact Gaussian Process (GP) regression has O(N^3) runtime for data size N, making it intractable for large N. Many algorithms for improving GP scaling approximate the covariance with lower rank matrices. Other work has exploited structure…

Machine Learning · Statistics 2012-09-24 Elad Gilboa , Yunus Saatçi , John P. Cunningham

Quantifying spatial and/or temporal associations in multivariate geolocated data of different types is achievable via spatial random effects in a Bayesian hierarchical model, but severe computational bottlenecks arise when spatial…

Methodology · Statistics 2024-04-02 Michele Peruzzi , David B. Dunson

Gaussian processes provide a flexible framework for forecasting, removing noise, and interpreting long temporal datasets. State space modelling (Kalman filtering) enables these non-parametric models to be deployed on long datasets by…

Machine Learning · Computer Science 2018-11-19 Arno Solin , James Hensman , Richard E. Turner

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size.…

Machine Learning · Computer Science 2014-08-12 Jie Chen , Nannan Cao , Kian Hsiang Low , Ruofei Ouyang , Colin Keng-Yan Tan , Patrick Jaillet