English
Related papers

Related papers: Gridding and Parameter Expansion for Scalable Late…

200 papers

Current approaches for modeling discrete-valued outcomes associated with spatially-dependent areal units incur computational and theoretical challenges, especially in the Bayesian setting when full posterior inference is desired. As an…

Methodology · Statistics 2025-05-22 J. Brandon Carter , Catherine A. Calder

We develop Bayesian machine learning methods for mixed data sampling (MIDAS) regressions. This involves handling frequency mismatches and specifying functional relationships between many predictors and the dependent variable. We use…

Econometrics · Economics 2024-09-11 Niko Hauzenberger , Massimiliano Marcellino , Michael Pfarrhofer , Anna Stelzer

Nonparametric regression for massive numbers of samples (n) and features (p) is an increasingly important problem. In big n settings, a common strategy is to partition the feature space, and then separately apply simple models to each…

Machine Learning · Statistics 2014-06-10 Rajarshi Guhaniyogi , David B. Dunson

Many problems arising in applications result in the need to probe a probability distribution for functions. Examples include Bayesian nonparametric statistics and conditioned diffusion processes. Standard MCMC algorithms typically become…

Computation · Statistics 2015-03-20 S. L. Cotter , G. O. Roberts , A. M. Stuart , D. White

Multivariate time series anomaly detection has numerous real-world applications and is being extensively studied. Modeling pairwise correlations between variables is crucial. Existing methods employ learnable graph structures and graph…

Machine Learning · Computer Science 2025-01-24 Zehao Liu , Mengzhou Gao , Pengfei Jiao

There has been considerable interest in making Bayesian inference more scalable. In big data settings, most literature focuses on reducing the computing time per iteration, with less focused on reducing the number of iterations needed in…

Methodology · Statistics 2017-09-28 Leo L. Duan , James E. Johndrow , David B. Dunson

We develop a framework for learning sparse nonparametric directed acyclic graphs (DAGs) from data. Our approach is based on a recent algebraic characterization of DAGs that led to a fully continuous program for score-based learning of DAG…

Machine Learning · Statistics 2020-03-25 Xun Zheng , Chen Dan , Bryon Aragam , Pradeep Ravikumar , Eric P. Xing

Graph-based causal discovery methods aim to capture conditional independencies consistent with the observed data and differentiate causal relationships from indirect or induced ones. Successful construction of graphical models of data…

Machine Learning · Statistics 2021-01-08 Boris Hayete , Fred Gruber , Anna Decker , Raymond Yan

Credible forecasting and representation learning of dynamical systems are of ever-increasing importance for reliable decision-making. To that end, we propose a family of Gaussian processes (GP) for dynamical systems with linear…

Machine Learning · Computer Science 2025-02-11 Petar Bevanda , Max Beier , Armin Lederer , Alexandre Capone , Stefan Sosnowski , Sandra Hirche

Deep Gaussian processes (DGPs) are multi-layer hierarchical generalisations of Gaussian processes (GPs) and are formally equivalent to neural networks with multiple, infinitely wide hidden layers. DGPs are probabilistic and non-parametric…

A recent approach to building consensus protocols on top of Directed Acyclic Graphs (DAGs) shows much promise due to its simplicity and stable throughput. However, as each node in the DAG typically includes a linear number of references to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-03 Michael Anoprenko , Andrei Tonkikh , Alexander Spiegelman , Petr Kuznetsov , Anatoliy Zinovyev , Konstantin Shprenger

Gaussian Process (GP) regression is a flexible modeling technique used to predict outputs and to capture uncertainty in the predictions. However, the GP regression process becomes computationally intensive when the training spatial dataset…

Computation · Statistics 2024-09-19 Juliette Mukangango , Amanda Muyskens , Benjamin W. Priest

We develop a scalable class of models for latent variable estimation using composite Gaussian processes, with a focus on derivative Gaussian processes. We jointly model multiple data sources as outputs to improve the accuracy of latent…

Multivariate Gaussian processes (GPs) offer a powerful probabilistic framework to represent complex interdependent phenomena. They pose, however, significant computational challenges in high-dimensional settings, which frequently arise in…

Many modern spatial models express the stochastic variation component as a basis expansion with random coefficients. Low rank models, approximate spectral decompositions, multiresolution representations, stochastic partial differential…

Methodology · Statistics 2019-02-20 Mitchell Krock , William Kleiber , Stephen Becker

While much research effort has been dedicated to scaling up sparse Gaussian process (GP) models based on inducing variables for big data, little attention is afforded to the other less explored class of low-rank GP approximations that…

Machine Learning · Statistics 2016-11-21 Quang Minh Hoang , Trong Nghia Hoang , Kian Hsiang Low

This paper presents a new variable selection approach integrated with Gaussian process (GP) regression. We consider a sparse projection of input variables and a general stationary covariance model that depends on the Euclidean distance…

Machine Learning · Computer Science 2020-08-26 Chiwoo Park , David J. Borth , Nicholas S. Wilson , Chad N. Hunter

The Gaussian process state-space model (GPSSM) has attracted extensive attention for modeling complex nonlinear dynamical systems. However, the existing GPSSM employs separate Gaussian processes (GPs) for each latent state dimension,…

Machine Learning · Computer Science 2023-09-06 Zhidi Lin , Juan Maroñas , Ying Li , Feng Yin , Sergios Theodoridis

Graph condensation reduces the size of large graphs while preserving performance, addressing the scalability challenges of Graph Neural Networks caused by computational inefficiencies on large datasets. Existing methods often rely on…

Machine Learning · Computer Science 2025-10-10 Lin Wang , Qing Li

Gaussian processes (GPs) are Bayesian nonparametric models for function approximation with principled predictive uncertainty estimates. Deep Gaussian processes (DGPs) are multilayer generalizations of GPs that can represent complex marginal…

Machine Learning · Statistics 2024-09-20 Qiuxian Meng , Yongyou Zhang