English
Related papers

Related papers: Asymmetric Correntropy for Robust Adaptive Filteri…

200 papers

In this work, we investigate Gaussian process regression used to recover a function based on noisy observations. We derive upper and lower error bounds for Gaussian process regression with possibly misspecified correlation functions. The…

Statistics Theory · Mathematics 2022-07-20 Wenjia Wang , Bing-Yi Jing

A distributed average consensus algorithm robust to a wide range of impulsive channel noise distributions is proposed. This work is the first of its kind in the literature to propose a consensus algorithm which relaxes the requirement of…

Systems and Control · Computer Science 2015-06-22 Sivaraman Dasarathan , Cihan Tepedelenlioglu , Mahesh Banavar , Andreas Spanias

Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process…

Machine Learning · Computer Science 2015-02-19 Rafael Boloix-Tortosa , F. Javier Payán-Somet , Eva Arias-de-Reyna , Juan José Murillo-Fuentes

We propose a scalable robust learning algorithm combining kernel smoothing and robust optimization. Our method is motivated by the convex analysis perspective of distributionally robust optimization based on probability metrics, such as the…

Machine Learning · Computer Science 2022-02-22 Jia-Jie Zhu , Christina Kouridi , Yassine Nemmour , Bernhard Schölkopf

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson

Non-conservative uncertainty bounds are key for both assessing an estimation algorithm's accuracy and in view of downstream tasks, such as its deployment in safety-critical contexts. In this paper, we derive a tight, non-asymptotic…

Machine Learning · Computer Science 2026-01-16 Amon Lahr , Johannes Köhler , Anna Scampicchio , Melanie N. Zeilinger

Random feature maps are used to decrease the computational cost of kernel machines in large-scale problems. The Mondrian kernel is one such example of a fast random feature approximation of the Laplace kernel, generated by a computationally…

Machine Learning · Computer Science 2025-03-13 Calvin Osborne , Eliza O'Reilly

Many three-dimensional spatial fields are anisotropic, with directions of rapid and slow variation that need not align with the coordinate axes. Standard Gaussian process kernels with Automatic Relevance Determination (ARD) capture only…

Machine Learning · Statistics 2026-05-13 Kane Warrior , Dalia Chakrabarty

Scaling analysis, in which one infers scaling exponents and a scaling function in a scaling law from given data, is a powerful tool for determining universal properties of critical phenomena in many fields of science. However, there are…

Statistical Mechanics · Physics 2015-07-08 Kenji Harada

This paper considers a disturbance attenuation problem for a linear discrete time invariant system under random disturbances with imprecisely known probability distributions. The statistical uncertainty is measured in terms of relative…

Systems and Control · Computer Science 2015-03-19 Michael M. Tchaikovsky , Alexander P. Kurdyukov , Victor N. Timin

This paper presents a simple and efficient method to convolve an image with a Gaussian kernel. The computation is performed in a constant number of operations per pixel using running sums along the image rows and columns. We investigate the…

Computer Vision and Pattern Recognition · Computer Science 2011-07-26 Elhanan Elboher , Michael Werman

Gaussian process regression (GPR) or kernel ridge regression is a widely used and powerful tool for nonlinear prediction. Therefore, active learning (AL) for GPR, which actively collects data labels to achieve an accurate prediction with…

We propose a new monotonically convergent algorithm which can enforce spectral constraints on the control field (and extends to arbitrary filters). The procedure differs from standard algorithms in that at each iteration the control field…

Quantum Physics · Physics 2015-05-13 M. Lapert , R. Tehini , G. Turinici , D. Sugny

This paper is concerned with a problem of robust filtering for a finite-dimensional linear discrete time invariant system with two output signals, one of which is directly observed while the other has to be estimated. The system is assumed…

Systems and Control · Computer Science 2014-12-10 Igor G. Vladimirov

Kernel methods give powerful, flexible, and theoretically grounded approaches to solving many problems in machine learning. The standard approach, however, requires pairwise evaluations of a kernel function, which can lead to scalability…

Machine Learning · Computer Science 2021-04-08 Danica J. Sutherland , Jeff Schneider

We present a new smooth, Gaussian-like kernel that allows the kernel density estimate for an angular distribution to be exactly represented by a finite number of its Fourier series coefficients. Distributions of angular quantities, such as…

Computer Vision and Pattern Recognition · Computer Science 2016-06-10 Michael T. McCann , Matthew Fickus , Jelena Kovacevic

This work incorporates the multi-modality of the data distribution into a Gaussian Process regression model. We approach the problem from a discriminative perspective by learning, jointly over the training data, the target space variance in…

Machine Learning · Computer Science 2018-03-20 Silvia L. Pintea , Jan C. van Gemert , Arnold W. M. Smeulders

We consider the problem of robust estimation involving filtering and smoothing for nonlinear state space models which are disturbed by heavy-tailed impulsive noises. To deal with heavy-tailed noises and improve the robustness of the…

Applications · Statistics 2020-12-01 Hongwei Wang , Hongbin Li , Junyi Zuo , Wei Zhang , Heping Wang

The standard Kernel Quadrature method for numerical integration with random point sets (also called Bayesian Monte Carlo) is known to converge in root mean square error at a rate determined by the ratio $s/d$, where $s$ and $d$ encode the…

Machine Learning · Statistics 2017-08-01 Francois-Xavier Briol , Chris J. Oates , Jon Cockayne , Wilson Ye Chen , Mark Girolami

The Gaussian kernel and its traditional normalizations (e.g., row-stochastic) are popular approaches for assessing similarities between data points. Yet, they can be inaccurate under high-dimensional noise, especially if the noise magnitude…

Statistics Theory · Mathematics 2023-07-12 Boris Landa , Xiuyuan Cheng