English
Related papers

Related papers: Non-Stationary Spectral Kernels

200 papers

We present a novel approach for fully non-stationary Gaussian process regression (GPR), where all three key parameters -- noise variance, signal variance and lengthscale -- can be simultaneously input-dependent. We develop gradient-based…

Machine Learning · Statistics 2015-08-19 Markus Heinonen , Henrik Mannerström , Juho Rousu , Samuel Kaski , Harri Lähdesmäki

Spectral density functions quantify how environmental modes couple to quantum systems and govern their open dynamics. Inferring such frequency-dependent functions from time-domain measurements is an ill-conditioned inverse problem. Here, we…

Local polynomial regression of order at least one often performs poorly in regions of sparse data. Local constant regression is exceptional in this regard, though it is the least accurate method in general, especially at the boundaries of…

Methodology · Statistics 2024-06-18 Chunlei Ge , W. John Braun

The success of non-linear optics relies largely on pulse-to-pulse consistency. In contrast, covariance based techniques used in photoionization electron spectroscopy and mass spectrometry have shown that wealth of information can be…

Understanding and predicting environmental phenomena often requires the construction of spatio-temporal statistical models, which are typically Gaussian processes. A common assumption made on Gaussian processes is that of covariance…

Methodology · Statistics 2023-03-17 Quan Vu , Andrew Zammit-Mangion , Stephen J. Chuter

Stationary time series models built from parametric distributions are, in general, limited in scope due to the assumptions imposed on the residual distribution and autoregression relationship. We present a modeling approach for univariate…

Methodology · Statistics 2016-05-04 Maria DeYoreo , Athanasios Kottas

Spectral approximation and variational inducing learning for the Gaussian process are two popular methods to reduce computational complexity. However, in previous research, those methods always tend to adopt the orthonormal basis functions,…

Machine Learning · Statistics 2021-07-15 Wenqi Fang , Guanlin Wu , Jingjing Li , Zheng Wang , Jiang Cao , Yang Ping

Rahimi and Recht (2007) introduced the idea of decomposing positive definite shift-invariant kernels by randomly sampling from their spectral distribution for machine learning applications. This famous technique, known as Random Fourier…

Machine Learning · Computer Science 2026-02-24 Nicolas Langrené , Xavier Warin , Pierre Gruet

Discrete mixture models are one of the most successful approaches for density estimation. Under a Bayesian nonparametric framework, Dirichlet process location-scale mixture of Gaussian kernels is the golden standard, both having nice…

Methodology · Statistics 2013-12-02 Antonio Canale , Bruno Scarpa

Standard sparse pseudo-input approximations to the Gaussian process (GP) cannot handle complex functions well. Sparse spectrum alternatives attempt to answer this but are known to over-fit. We suggest the use of variational inference for…

Machine Learning · Statistics 2015-03-23 Yarin Gal , Richard Turner

A nonparametric kernel density estimator for directional-linear data is introduced. The proposal is based on a product kernel accounting for the different nature of both (directional and linear) components of the random vector. Expressions…

Despite a large corpus of recent work on scaling up Gaussian processes, a stubborn trade-off between computational speed, prediction and uncertainty quantification accuracy, and customizability persists. This is because the vast majority of…

Machine Learning · Computer Science 2025-12-09 Marcus M. Noack , Mark D. Risser , Hengrui Luo , Vardaan Tekriwal , Ronald J. Pandolfi

We introduce the wavelet scattering spectra which provide non-Gaussian models of time-series having stationary increments. A complex wavelet transform computes signal variations at each scale. Dependencies across scales are captured by the…

Data Analysis, Statistics and Probability · Physics 2023-06-21 Rudy Morel , Gaspar Rochette , Roberto Leonarduzzi , Jean-Philippe Bouchaud , Stéphane Mallat

We derive an estimator of the spectral density of a functional time series that is the output of a multilayer perceptron neural network. The estimator is motivated by difficulties with the computation of existing spectral density estimators…

Methodology · Statistics 2026-01-05 Neda Mohammadi , Soham Sarkar , Piotr Kokoszka

We propose a general nonparametric Bayesian framework for binary regression, which is built from modeling for the joint response-covariate distribution. The observed binary responses are assumed to arise from underlying continuous random…

Methodology · Statistics 2016-09-06 Maria DeYoreo , Athanasios Kottas

In the paper we study nonlocal functionals whose kernels are homogeneous generalized functions. We also use such functionals to solve the Korteweg-de Vries , the nonlinear Schr\"odinger and the Davey-Stewartson equations.

High Energy Physics - Theory · Physics 2007-05-23 A. S. Fokas , I. M. Gelfand , M. V. Zyskin

We develop a novel approach towards causal inference. Rather than structural equations over a causal graph, we learn stochastic differential equations (SDEs) whose stationary densities model a system's behavior under interventions. These…

Machine Learning · Computer Science 2024-03-19 Lars Lorch , Andreas Krause , Bernhard Schölkopf

Density estimation represents one of the most successful applications of Bayesian nonparametrics. In particular, Dirichlet process mixtures of normals are the gold standard for density estimation and their asymptotic properties have been…

Statistics Theory · Mathematics 2015-07-02 Antonio Canale , Pierpaolo De Blasi

In this paper, we give a new covariation spectral representation of some non stationary symmetric $\alpha$-stable processes (S$\alpha$S). This representation is based on a weaker covariation pseudo additivity condition which is more general…

Probability · Mathematics 2008-02-22 Nourddine Azzaoui

Doubly stochastic Poisson processes, also known as the Cox processes, frequently occur in various scientific fields. In this article, motivated primarily by analyzing Cox process data in biophysics, we propose a nonparametric kernel-based…

Applications · Statistics 2011-01-07 Tingting Zhang , S. C. Kou