English
Related papers

Related papers: Modelling local and global phenomena with sparse G…

200 papers

Monitoring daily weather fields is critical for climate science, agriculture, and environmental planning, yet fully probabilistic spatio-temporal models become computationally prohibitive at continental scale. We present a case study on…

Applications · Statistics 2026-02-12 Tim Gyger , Reinhard Furrer , Fabio Sigrist

We propose a flexible dual functional factor model for modelling high-dimensional functional time series. In this model, a high-dimensional fully functional factor parametrisation is imposed on the observed functional processes, whereas a…

Econometrics · Economics 2024-01-15 Chenlei Leng , Degui Li , Hanlin Shang , Yingcun Xia

We develop a new efficient methodology for Bayesian global sensitivity analysis for large-scale multivariate data. The focus is on computationally demanding models with correlated variables. A multivariate Gaussian process is used as a…

Methodology · Statistics 2022-01-25 Oluwole Oyebamiji , Christopher Nemeth , Paula Harrison , Rob Dunford , George Cojocaru

Recent work has focused on the problem of conducting linear regression when the number of covariates is very large, potentially greater than the sample size. To facilitate this, one useful tool is to assume that the model can be well…

Methodology · Statistics 2011-11-21 Zhou Fang

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

Machine Learning · Statistics 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

Sparse variational Gaussian processes (GPs) construct tractable posterior approximations to GP models. At the core of these methods is the assumption that the true posterior distribution over training function values ${\bf f}$ and inducing…

Machine Learning · Computer Science 2025-06-27 Michalis K. Titsias

Convolutional sparse coding (CSC) can learn representative shift-invariant patterns from multiple kinds of data. However, existing CSC methods can only model noises from Gaussian distribution, which is restrictive and unrealistic. In this…

Machine Learning · Computer Science 2020-04-22 Yaqing Wang , James T. Kwok , Lionel M. Ni

The celebrated sparse representation model has led to remarkable results in various signal processing tasks in the last decade. However, despite its initial purpose of serving as a global prior for entire signals, it has been commonly used…

Information Theory · Computer Science 2017-10-11 Vardan Papyan , Jeremias Sulam , Michael Elad

Exact Gaussian Process (GP) regression has O(N^3) runtime for data size N, making it intractable for large N. Many algorithms for improving GP scaling approximate the covariance with lower rank matrices. Other work has exploited structure…

Machine Learning · Statistics 2012-09-24 Elad Gilboa , Yunus Saatçi , John P. Cunningham

This paper introduces a new kind of seasonal fractional autoregressive process (SFAR) driven by fractional Gaussian noise (fGn). The new model includes a standard seasonal AR model and fGn. {The estimation of the parameters of this new…

Applications · Statistics 2025-04-01 Chunhao Cai , Yiwu Shang

We develop an automated variational method for inference in models with Gaussian process (GP) priors and general likelihoods. The method supports multiple outputs and multiple latent functions and does not require detailed knowledge of the…

Machine Learning · Statistics 2018-11-06 Edwin V. Bonilla , Karl Krauth , Amir Dezfouli

Graphical models describe associations between variables through the notion of conditional independence. Gaussian graphical models are a widely used class of such models where the relationships are formalized by non-null entries of the…

Methodology · Statistics 2023-08-08 Sagnik Bhadury , Riten Mitra , Jeremy T. Gaskins

In this work, we propose a novel framework for large-scale Gaussian process (GP) modeling. Contrary to the global, and local approximations proposed in the literature to address the computational bottleneck with exact GP modeling, we employ…

Machine Learning · Statistics 2023-12-19 Akhil Vakayil , Roshan Joseph

The growing field of large-scale time domain astronomy requires methods for probabilistic data analysis that are computationally tractable, even with large datasets. Gaussian Processes are a popular class of models used for this purpose…

Instrumentation and Methods for Astrophysics · Physics 2017-11-15 Daniel Foreman-Mackey , Eric Agol , Sivaram Ambikasaran , Ruth Angus

Over the past decade, the celebrated sparse representation model has achieved impressive results in various signal and image processing tasks. A convolutional version of this model, termed convolutional sparse coding (CSC), has been…

Signal Processing · Electrical Eng. & Systems 2018-10-03 Ives Rey-Otero , Jeremias Sulam , Michael Elad

In a variety of disciplines such as social sciences, psychology, medicine and economics, the recorded data are considered to be noisy measurements of latent variables connected by some causal structure. This corresponds to a family of…

Machine Learning · Computer Science 2014-08-12 Ricardo Silva , Robert B. Gramacy

In a variety of disciplines such as social sciences, psychology, medicine and economics, the recorded data are considered to be noisy measurements of latent variables connected by some causal structure. This corresponds to a family of…

Machine Learning · Computer Science 2010-03-15 Ricardo Silva , Robert B. Gramacy

Gaussian Process state-space models capture complex temporal dependencies in a principled manner by placing a Gaussian Process prior on the transition function. These models have a natural interpretation as discretized stochastic…

Machine Learning · Computer Science 2022-02-24 Krista Longi , Jakob Lindinger , Olaf Duennbier , Melih Kandemir , Arto Klami , Barbara Rakitsch

Sparse high dimensional graphical model selection is a popular topic in contemporary machine learning. To this end, various useful approaches have been proposed in the context of $\ell_1$-penalized estimation in the Gaussian framework.…

Computation · Statistics 2022-02-04 Sang-Yun Oh , Onkar Dalal , Kshitij Khare , Bala Rajaratnam

We introduce fully scalable Gaussian processes, an implementation scheme that tackles the problem of treating a high number of training instances together with high dimensional input data. Our key idea is a representation trick over the…

Machine Learning · Statistics 2018-07-16 Aristeidis Panos , Petros Dellaportas , Michalis K. Titsias