English
Related papers

Related papers: Local Kernels that Approximate Bayesian Regulariza…

200 papers

Model-based approaches bear great promise for decision making of agents interacting with the physical world. In the context of spatial environments, different types of problems such as localisation, mapping, navigation or autonomous…

Machine Learning · Statistics 2019-06-21 Atanas Mirchev , Baris Kayalibay , Maximilian Soelch , Patrick van der Smagt , Justin Bayer

Bayesian optimization is a data-efficient technique which can be used for control parameter tuning, parametric policy adaptation, and structure design in robotics. Many of these problems require optimization of functions defined on…

We propose a novel framework for matching estimators for causal effect from observational data that is based on minimizing the dual norm of estimation error when expressed as an operator. We show that many popular matching estimators can be…

Methodology · Statistics 2017-03-01 Nathan Kallus

Kernel based regularized interpolation is a well known technique to approximate a continuous multivariate function using a set of scattered data points and the corresponding function evaluations, or data values. This method has some…

Numerical Analysis · Mathematics 2018-07-26 Gabriele Santin , Dominik Wittwar , Bernard Haasdonk

The bilateral and nonlocal means filters are instances of kernel-based filters that are popularly used in image processing. It was recently shown that fast and accurate bilateral filtering of grayscale images can be performed using a…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Pravin Nair , Kunal N. Chaudhury

The problem of efficient approximation of a linear operator induced by the Gaussian or softmax kernel is often addressed using random features (RFs) which yield an unbiased approximation of the operator's result. Such operators emerge in…

Machine Learning · Computer Science 2023-02-03 Valerii Likhosherstov , Krzysztof Choromanski , Avinava Dubey , Frederick Liu , Tamas Sarlos , Adrian Weller

Kernelization is a general theoretical framework for preprocessing instances of NP-hard problems into (generally smaller) instances with bounded size, via the repeated application of data reduction rules. For the fundamental Max Cut…

Data Structures and Algorithms · Computer Science 2019-05-28 Damir Ferizovic , Demian Hespe , Sebastian Lamm , Matthias Mnich , Christian Schulz , Darren Strash

Bayesian filtering approximates the true underlying behavior of a time-varying system by inverting an explicit generative model to convert noisy measurements into state estimates. This process typically requires either storage, inversion,…

Machine Learning · Computer Science 2023-11-20 Gianluca M. Bencomo , Jake C. Snell , Thomas L. Griffiths

This paper summarizes the work on implementing few solutions for the Steiner Tree problem which we undertook in the PAAL project. The main focus of the project is the development of generic implementations of approximation algorithms…

Data Structures and Algorithms · Computer Science 2014-10-29 Krzysztof Ciebiera , Piotr Godlewski , Piotr Sankowski , Piotr Wygocki

We present simple, user-friendly bounds for the expected operator norm of a random kernel matrix under general conditions on the kernel function $k(\cdot,\cdot)$. Our approach uses decoupling results for U-statistics and the non-commutative…

Machine Learning · Statistics 2025-11-07 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

We propose a method to reduce non-uniform sample variance to a predetermined target level. The proposed space-variant filter can equalize variance of the non-stationary signal, or vary filtering strength based on image features, such as…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Alexander Zamyatin

We study a class of regularized proximal operators in Wasserstein-2 space. We derive their solutions by kernel integration formulas. We obtain the Wasserstein proximal operator using a pair of forward-backward partial differential equations…

Optimization and Control · Mathematics 2023-01-26 Wuchen Li , Siting Liu , Stanley Osher

This paper studies the probabilistic function approximation problem over reproducing kernel Hilbert spaces. We show the existence and uniqueness of the optimizer under mild assumptions. Furthermore, we generalize the celebrated representer…

Functional Analysis · Mathematics 2025-07-16 Dongwei Chen , Kai-Hsiang Wang

Approximate Bayesian Computation (ABC for short) is a family of computational techniques which offer an almost automated solution in situations where evaluation of the posterior likelihood is computationally prohibitive, or whenever…

Statistics Theory · Mathematics 2013-06-04 Gérard Biau , Frédéric Cérou , Arnaud Guyader

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

We propose new estimates for the frontier of a set of points. They are defined as kernel estimates covering all the points and whose associated support is of smallest surface. The estimates are written as linear combinatio- ns of kernel…

Methodology · Statistics 2011-03-31 Guillaume Bouchard , Stéphane Girard , Anatoli Iouditski , Alexander Nazin

Several statistical approaches based on reproducing kernels have been proposed to detect abrupt changes arising in the full distribution of the observations and not only in the mean or variance. Some of these approaches enjoy good…

Statistics Theory · Mathematics 2017-10-13 Alain Celisse , Guillemette Marot , Morgane Pierre-Jean , Guillem Rigaill

In practice, objective functions of real-time control systems can have multiple local minimums or can dramatically change over the function space, making them hard to optimize. To efficiently optimize such systems, in this paper, we develop…

Optimization and Control · Mathematics 2022-01-26 Haowei Wang , Songhao Wang , Qun Meng , Szu Hui Ng

We study Nystr\"om type subsampling approaches to large scale kernel methods, and prove learning bounds in the statistical learning setting, where random sampling and high probability estimates are considered. In particular, we prove that…

Machine Learning · Statistics 2016-03-18 Alessandro Rudi , Raffaello Camoriano , Lorenzo Rosasco

Since introduced by Martinet and Rockafellar, the proximal point algorithm was generalized in many fruitful directions. More recently, in 2002, Pennanen studied the proximal point algorithm without monotonicity. A year later, Iusem and…