English
Related papers

Related papers: Modelling local and global phenomena with sparse G…

200 papers

Sparse additive modeling is a class of effective methods for performing high-dimensional nonparametric regression. In this work we show how shape constraints such as convexity/concavity and their extensions, can be integrated into additive…

Machine Learning · Computer Science 2017-05-03 Junming Yin , Yaoliang Yu

Adaptive learning is necessary for non-stationary environments where the learning machine needs to forget past data distribution. Efficient algorithms require a compact model update to not grow in computational burden with the incoming data…

Machine Learning · Computer Science 2023-07-11 Vanessa Gómez-Verdejo , Emilio Parrado-Hernández , Manel Martínez-Ramón

This paper presents a Gaussian process (GP) model for estimating piecewise continuous regression functions. In scientific and engineering applications of regression analysis, the underlying regression functions are piecewise continuous in…

Methodology · Statistics 2021-04-15 Chiwoo Park

Gaussian process regression is a frequently used statistical method for flexible yet fully probabilistic non-linear regression modeling. A common obstacle is its computational complexity which scales poorly with the number of observations.…

Methodology · Statistics 2026-03-10 Adam Gorm Hoffmann , Claus Thorn Ekstrøm , Andreas Kryger Jensen

Gaussian Process (GP) models are a powerful and flexible tool for non-parametric regression and classification. Computation for GP models is intensive, since computing the posterior density, $\pi$, for covariance function parameters…

Computation · Statistics 2013-05-13 Chunyi Wang , Radford M. Neal

Approximate Bayesian inference methods that scale to very large datasets are crucial in leveraging probabilistic models for real-world time series. Sparse Markovian Gaussian processes combine the use of inducing variables with efficient…

Machine Learning · Statistics 2021-06-10 William J. Wilkinson , Arno Solin , Vincent Adam

We propose a method for inferring the conditional independence graph (CIG) of a high-dimensional Gaussian vector time series (discrete-time process) from a finite-length observation. By contrast to existing approaches, we do not rely on a…

Machine Learning · Statistics 2015-10-28 Alexander Jung

We consider the scenario where one observes an outcome variable and sets of features from multiple assays, all measured on the same set of samples. One approach that has been proposed for dealing with this type of data is ``sparse multiple…

Quantitative Methods · Quantitative Biology 2014-01-24 Samuel M. Gross , Robert Tibshirani

In applications of Gaussian processes where quantification of uncertainty is a strict requirement, it is necessary to accurately characterize the posterior distribution over Gaussian process covariance parameters. Normally, this is done by…

Computation · Statistics 2016-04-01 Xiaoyu Xiong , Václav Šmídl , Maurizio Filippone

A recent novel extension of multi-output Gaussian processes handles heterogeneous outputs assuming that each output has its own likelihood function. It uses a vector-valued Gaussian process prior to jointly model all likelihoods' parameters…

Machine Learning · Statistics 2020-07-15 Juan-José Giraldo , Mauricio A. Álvarez

We propose generalized conditional functional principal components analysis (GC-FPCA) for the joint modeling of the fixed and random effects of non-Gaussian functional outcomes. The method scales up to very large functional data sets by…

Methodology · Statistics 2024-11-18 Yu Lu , Xinkai Zhou , Erjia Cui , Dustin Rogers , Ciprian M. Crainiceanu , Julia Wrobel , Andrew Leroux

Nonstationary Gaussian process models can capture complex spatially varying dependence structures in spatial datasets. However, the large number of observations in modern datasets makes fitting such models computationally intractable with…

Computation · Statistics 2022-06-13 Paul G. Beckman , Christopher J. Geoga , Michael L. Stein , Mihai Anitescu

We study estimation and prediction of Gaussian processes with covariance model belonging to the generalized Cauchy (GC) family, under fixed domain asymptotics. Gaussian processes with this kind of covariance function provide separate…

Methodology · Statistics 2019-07-23 Moreno Bevilacqua , Tarik Faouzi

Additive nonparametric regression models provide an attractive tool for variable selection in high dimensions when the relationship between the response and predictors is complex. They offer greater flexibility compared to parametric…

Machine Learning · Statistics 2016-07-12 Garret Vo , Debdeep Pati

The functional generalized additive model (FGAM) was recently proposed in McLean et al. (2013) as a more flexible alternative to the common functional linear model (FLM) for regressing a scalar on functional covariates. In this paper, we…

Methodology · Statistics 2017-05-29 Mathew W. McLean , Fabian Scheipl , Giles Hooker , Sonja Greven , David Ruppert

Developing suitable approximate models for analyzing and simulating complex nonlinear systems is practically important. This paper aims at exploring the skill of a rich class of nonlinear stochastic models, known as the conditional Gaussian…

Numerical Analysis · Mathematics 2022-06-01 Nan Chen , Yingda Li , Honghu Liu

Gaussian Process (GP) models provide a flexible framework for prediction and uncertainty quantification. For most covariance functions, however, exact GP prediction with $n$ points scales as $\mathcal{O}(n^3)$, making it prohibitively…

Computation · Statistics 2026-05-29 Samanyu Arora , Christopher J. Geoga

Multivariate regression techniques are commonly applied to explore the associations between large numbers of outcomes and predictors. In real-world applications, the outcomes are often of mixed types, including continuous measurements,…

Methodology · Statistics 2020-10-19 Aditya Mishra , Dipak K. Dey , Yong Chen , Kun Chen

We consider a sparse high-dimensional varying coefficients model with random effects, a flexible linear model allowing covariates and coefficients to have a functional dependence with time. For each individual, we observe discretely sampled…

Statistics Theory · Mathematics 2021-10-14 Michael Law , Ya'acov Ritov

We propose a new method for simplification of Gaussian process (GP) models by projecting the information contained in the full encompassing model and selecting a reduced number of variables based on their predictive relevance. Our results…

Methodology · Statistics 2017-12-18 Juho Piironen , Aki Vehtari
‹ Prev 1 3 4 5 6 7 10 Next ›