English
Related papers

Related papers: Index Set Fourier Series Features for Approximatin…

200 papers

We consider the problem of detecting and quantifying the periodic component of a function given noise-corrupted observations of a limited number of input/output tuples. Our approach is based on Gaussian process regression which provides a…

Statistics Theory · Mathematics 2016-08-22 Nicolas Durrande , James Hensman , Magnus Rattray , Neil D. Lawrence

We introduce a fast algorithm for Gaussian process regression in low dimensions, applicable to a widely-used family of non-stationary kernels. The non-stationarity of these kernels is induced by arbitrary spatially-varying vertical and…

Numerical Analysis · Mathematics 2025-03-28 P. Michael Kielstra , Michael Lindsey

Bayesian computational strategies for inference can be inefficient in approximating the posterior distribution in models that exhibit some form of periodicity. This is because the probability mass of the marginal posterior distribution of…

Machine Learning · Statistics 2025-12-01 Javier Lopez-Santiago , Luca Martino , Joaquin Miguez , Gonzalo Vazquez-Vilar

We propose a method for the approximation of high- or even infinite-dimensional feature vectors, which play an important role in supervised learning. The goal is to reduce the size of the training data, resulting in lower storage…

Machine Learning · Statistics 2021-04-06 Patrick Gelß , Stefan Klus , Ingmar Schuster , Christof Schütte

The random Fourier features (RFFs) method is a powerful and popular technique in kernel approximation for scalability of kernel methods. The theoretical foundation of RFFs is based on the Bochner theorem that relates symmetric, positive…

Machine Learning · Computer Science 2022-09-20 Mingzhen He , Fan He , Fanghui Liu , Xiaolin Huang

Time series analysis finds wide applications in fields such as weather forecasting, anomaly detection, and behavior recognition. Previous methods attempted to model temporal variations directly using 1D time series. However, this has been…

Machine Learning · Computer Science 2024-11-08 Qiang Wu , Gechang Yao , Zhixi Feng , Shuyuan Yang

Tensor algebras give rise to one of the most powerful measures of similarity for sequences of arbitrary length called the signature kernel accompanied with attractive theoretical guarantees from stochastic analysis. Previous algorithms to…

Machine Learning · Statistics 2024-11-25 Csaba Toth , Harald Oberhauser , Zoltan Szabo

One of the main computational bottlenecks when working with kernel based learning is dealing with the large and typically dense kernel matrix. Techniques dealing with fast approximations of the matrix vector product for these kernel…

Machine Learning · Computer Science 2024-04-29 Theresa Wagner , Franziska Nestler , Martin Stoll

This paper proposes Fourier-based and wavelet-based techniques for analyzing periodic financial time series. Conventional models such as the periodic autoregressive conditional heteroscedastic (PGARCH) and periodic autoregressive…

Methodology · Statistics 2025-05-12 Rhea Davis , N. Balakrishna

Simulating a Gaussian process requires sampling from a high-dimensional Gaussian distribution, which scales cubically with the number of sample locations. Spectral methods address this challenge by exploiting the Fourier representation,…

Machine Learning · Statistics 2026-02-27 Arsalan Jawaid , Abdullah Karatas , Jörg Seewig

Kernel methods are an incredibly popular technique for extending linear models to non-linear problems via a mapping to an implicit, high-dimensional feature space. While kernel methods are computationally cheaper than an explicit feature…

Machine Learning · Statistics 2019-02-26 Philip Milton , Emanuele Giorgi , Samir Bhatt

The method of random Fourier features (RFF), proposed in a seminal paper by Rahimi and Recht (NIPS'07), is a powerful technique to find approximate low-dimensional representations of points in (high-dimensional) kernel space, for…

Machine Learning · Computer Science 2023-04-14 Kuan Cheng , Shaofeng H. -C. Jiang , Luojian Wei , Zhide Wei

We extend the diffusion-map formalism to data sets that are induced by asymmetric kernels. Analytical convergence results of the resulting expansion are proved, and an algorithm is proposed to perform the dimensional reduction. In this work…

Machine Learning · Computer Science 2024-01-24 Alvaro Almeida Gomez , Antonio Silva Neto , Jorge zubelli

Periodicity of a texture is one of the important visual characteristics and is often used as a measure for textural discrimination at the structural level. Knowledge about periodicity of a texture is very essential in the field of texture…

Computer Vision and Pattern Recognition · Computer Science 2013-11-18 V. Asha , N. U. Bhajantri , P. Nagabhushan

Factor modeling is a powerful statistical technique that permits to capture the common dynamics in a large panel of data with a few latent variables, or factors, thus alleviating the curse of dimensionality. Despite its popularity and…

Econometrics · Economics 2021-03-03 Varlam Kutateladze

We introduce a class of algorithms for constructing Fourier representations of Gaussian processes in $1$ dimension that are valid over ranges of hyperparameter values. The scaling and frequencies of the Fourier basis functions are evaluated…

Computation · Statistics 2024-06-05 Philip Greengard

Sparse variational approximations are popular methods for scaling up inference and learning in Gaussian processes to larger datasets. For $N$ training points, exact inference has $O(N^3)$ cost; with $M \ll N$ features, state of the art…

Machine Learning · Statistics 2024-04-15 Talay M Cheema , Carl Edward Rasmussen

Neural time-series analysis has traditionally focused on modeling data in the time domain, often with some approaches incorporating equivalent Fourier domain representations as auxiliary spectral features. In this work, we shift the main…

Machine Learning · Computer Science 2024-10-08 Minjung Kim , Yusuke Hioka , Michael Witbrock

Long-term time series forecasting is a long-standing challenge in various applications. A central issue in time series forecasting is that methods should expressively capture long-term dependency. Furthermore, time series forecasting…

Machine Learning · Computer Science 2024-11-06 Xingyu Zhang , Siyu Zhao , Zeen Song , Huijie Guo , Jianqi Zhang , Changwen Zheng , Wenwen Qiang

We consider the problem of detecting multiple changes in multiple independent time series. The search for the best segmentation can be expressed as a minimization problem over a given cost function. We focus on dynamic programming…

Methodology · Statistics 2024-05-20 Liudmila Pishchagina , Guillem Rigaill , Vincent Runge