English
Related papers

Related papers: Adaptive RKHS Fourier Features for Compositional G…

200 papers

In developing data-driven modeling methodologies, there is an ongoing need to reconcile the strong predictive performance of opaque black-box models with the transparency required for critical applications. This work introduces an…

Machine Learning · Statistics 2026-05-21 Xin Huang , Jia Li , Jun Yu

Deep neural networks have revolutionized many fields, but their black-box nature also occasionally prevents their wider adoption in fields such as healthcare and finance, where interpretable and explainable models are required. The recent…

Machine Learning · Computer Science 2024-03-20 Wei Zhang , Brian Barr , John Paisley

We propose a novel online Gaussian process (GP) model that is capable of capturing long-term memory in sequential data in an online learning setting. Our model, Online HiPPO Sparse Variational Gaussian Process (OHSVGP), leverages the HiPPO…

Machine Learning · Computer Science 2025-09-30 Wenlong Chen , Naoki Kiyohara , Harrison Bo Hua Zhu , Jacob Curran-Sebastian , Samir Bhatt , Yingzhen Li

We introduce a framework and early results for massively scalable Gaussian processes (MSGP), significantly extending the KISS-GP approach of Wilson and Nickisch (2015). The MSGP framework enables the use of Gaussian processes (GPs) on…

Machine Learning · Computer Science 2015-11-06 Andrew Gordon Wilson , Christoph Dann , Hannes Nickisch

Bayesian model updating based on Gaussian Process (GP) models has received attention in recent years, which incorporates kernel-based GPs to provide enhanced fidelity response predictions. Although most kernel functions provide high fitting…

Despite the widespread utilization of Gaussian process models for versatile nonparametric modeling, they exhibit limitations in effectively capturing abrupt changes in function smoothness and accommodating relationships with heteroscedastic…

Machine Learning · Statistics 2023-09-01 Taehee Lee , Jun S. Liu

We address the task of simultaneous feature fusion and modeling of discrete ordinal outputs. We propose a novel Gaussian process(GP) auto-encoder modeling approach. In particular, we introduce GP encoders to project multiple observed…

Machine Learning · Statistics 2016-09-07 Stefanos Eleftheriadis , Ognjen Rudovic , Marc P. Deisenroth , Maja Pantic

Exact Gaussian Process (GP) regression has O(N^3) runtime for data size N, making it intractable for large N. Many algorithms for improving GP scaling approximate the covariance with lower rank matrices. Other work has exploited structure…

Machine Learning · Statistics 2012-09-24 Elad Gilboa , Yunus Saatçi , John P. Cunningham

We propose a novel Bayesian methodology for inference in functional linear and logistic regression models based on the theory of reproducing kernel Hilbert spaces (RKHS's). We introduce general models that build upon the RKHS generated by…

Methodology · Statistics 2025-09-09 José R. Berrendero , Antonio Coín , Antonio Cuevas

Gaussian Processes (GPs) are flexible, nonparametric Bayesian models widely used for regression and classification because of their ability to capture complex data patterns and quantify predictive uncertainty. However, the O(n^3)…

Machine Learning · Computer Science 2026-01-14 Hua Huang , Tianshi Xu , Yuanzhe Xi , Edmond Chow

The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential…

Optimization and Control · Mathematics 2020-07-14 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

Learning dynamical models from data is not only fundamental but also holds great promise for advancing principle discovery, time-series prediction, and controller design. Among various approaches, Gaussian Process State-Space Models…

Machine Learning · Computer Science 2025-10-20 Tengjie Zheng , Haipeng Chen , Lin Cheng , Shengping Gong , Xu Huang

Kernel methods approximate nonlinear maps in a data-driven manner by projecting the target map onto a finite-dimensional Hilbert space called the solution space. Traditionally, this space is a subspace of a fixed ambient reproducing kernel…

Numerical Analysis · Mathematics 2026-01-30 Tamás Dózsa , Andrea Angino , Zoltán Szabó , József Bokor , Matthias Voigt

We introduce a Gaussian process model of functions which are additive. An additive function is one which decomposes into a sum of low-dimensional functions, each depending on only a subset of the input variables. Additive GPs generalize…

Machine Learning · Statistics 2011-12-20 David Duvenaud , Hannes Nickisch , Carl Edward Rasmussen

The key task of physical simulation is to solve partial differential equations (PDEs) on discretized domains, which is known to be costly. In particular, high-fidelity solutions are much more expensive than low-fidelity ones. To reduce the…

Machine Learning · Statistics 2020-06-11 Zheng Wang , Wei Xing , Robert Kirby , Shandian Zhe

Kernel methods form a powerful, versatile, and theoretically-grounded unifying framework to solve nonlinear problems in signal processing and machine learning. The standard approach relies on the kernel trick to perform pairwise evaluations…

Machine Learning · Computer Science 2019-12-11 Kan Li , Jose C. Principe

Gaussian processes (GPs) are very widely used for modeling of unknown functions or surfaces in applications ranging from regression to classification to spatial processes. Although there is an increasingly vast literature on applications,…

Methodology · Statistics 2017-06-28 Lizhen Lin , Mu Niu , Pokman Cheung , David Dunson

Gaussian processes (GPs) have been extensively utilized as nonparametric models for component separation in 21 cm data analyses. This exploits the distinct spectral behavior of the cosmological and foreground signals, which are modeled…

Cosmology and Nongalactic Astrophysics · Physics 2025-05-13 Kangning Diao , Richard D. P. Grumitt , Yi Mao

This paper proposes a framework for multi-robot systems to perform simultaneous learning and coverage of a domain of interest characterized by an unknown and potentially time-varying density function. To overcome the limitations of Gaussian…

Robotics · Computer Science 2025-11-11 Ruijie Du , Ruoyu Lin , Yanning Shen , Magnus Egerstedt

Gaussian processes (GPs) are powerful non-parametric function estimators. However, their applications are largely limited by the expensive computational cost of the inference procedures. Existing stochastic or distributed synchronous…

Machine Learning · Statistics 2017-06-14 Hao Peng , Shandian Zhe , Yuan Qi