English
Related papers

Related papers: Local Kernels that Approximate Bayesian Regulariza…

200 papers

We introduce a probabilistic approach to the LMS filter. By means of an efficient approximation, this approach provides an adaptable step-size LMS algorithm together with a measure of uncertainty about the estimation. In addition, the…

Machine Learning · Statistics 2016-04-11 Jesus Fernandez-Bes , Víctor Elvira , Steven Van Vaerenbergh

In the classical bilateral filter, a fixed Gaussian range kernel is used along with a spatial kernel for edge-preserving smoothing. We consider a generalization of this filter, the so-called adaptive bilateral filter, where the center and…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Ruturaj G. Gavaskar , Kunal N. Chaudhury

We study the higher H\"older regularity of local weak solutions to a class of nonlinear nonlocal elliptic equations with kernels that satisfy a mild continuity assumption. An interesting feature of our main result is that the obtained…

Analysis of PDEs · Mathematics 2021-01-19 Simon Nowak

This article addresses two topics of significant mathematical and practical interest in the theory of kernel approximation: the existence of local and stable bases and the L_p--boundedness of the least squares operator. The latter is an…

Classical Analysis and ODEs · Mathematics 2011-03-10 Thomas Hangelbroek , Fran J Narcowich , Xingping Sun , Joe D Ward

Particle swarm optimization is a popular method for solving difficult optimization problems. There have been attempts to formulate the method in formal probabilistic or stochastic terms (e.g. bare bones particle swarm) with the aim to…

Neural and Evolutionary Computing · Computer Science 2012-11-19 Peter Andras

The paper describes an application of Aggregating Algorithm to the problem of regression. It generalizes earlier results concerned with plain linear regression to kernel techniques and presents an on-line algorithm which performs nearly as…

Machine Learning · Computer Science 2012-07-19 Alex Gammerman , Yuri Kalnishkan , Vladimir Vovk

Proximal algorithms have gained popularity in recent years in large-scale and distributed optimization problems. One such problem is the phase retrieval problem, for which proximal operators have been proposed recently. The phase retrieval…

Optimization and Control · Mathematics 2018-08-16 Biel Roig-Solvas , Lee Makowski , Dana H. Brooks

In this paper, we consider a squared $L_1/L_2$ regularized model for sparse signal recovery from noisy measurements. We first establish the existence of optimal solutions to the model under mild conditions. Next, we propose a proximal…

Optimization and Control · Mathematics 2025-11-10 Na Zhang , Hong Chen , Qia Li , Junpeng Zhou

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

Machine Learning · Computer Science 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

The bilateral filter is a versatile non-linear filter that has found diverse applications in image processing, computer vision, computer graphics, and computational photography. A widely-used form of the filter is the Gaussian bilateral…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Kunal N. Chaudhury

We present a probabilistic viewpoint to multiple kernel learning unifying well-known regularised risk approaches and recent advances in approximate Bayesian inference relaxations. The framework proposes a general objective function suitable…

Machine Learning · Statistics 2012-06-08 Hannes Nickisch , Matthias Seeger

We consider the problem of improving kernel approximation via randomized feature maps. These maps arise as Monte Carlo approximation to integral representations of kernel functions and scale up kernel methods for larger datasets. Based on…

Machine Learning · Computer Science 2018-10-31 Marina Munkhoeva , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

For the past 30 years or so, machine learning has stimulated a great deal of research in the study of approximation capabilities (expressive power) of a multitude of processes, such as approximation by shallow or deep neural networks,…

Machine Learning · Computer Science 2025-01-07 Hrushikesh Mhaskar

Motivated by the surge of interest in Koopman operator theory, we propose a machine-learning alternative based on a functional Bayesian perspective for operator-theoretic modeling of unknown, data-driven, nonlinear dynamical systems. This…

Machine Learning · Computer Science 2024-11-04 Kan Li , José C. Príncipe

In the last years, the success of kernel-based regularisation techniques in solving impulse response modelling tasks has revived the interest on linear system identification. In this work, an alternative perspective on the same problem is…

Systems and Control · Computer Science 2016-10-25 Anna Marconato , Maarten Schoukens , Johan Schoukens

We propose a new technique for constructing low-rank approximations of matrices that arise in kernel methods for machine learning. Our approach pairs a novel automatically constructed analytic expansion of the underlying kernel function…

Machine Learning · Computer Science 2022-02-09 John Paul Ryan , Anil Damle

In this paper, we consider a non-local approximation of the time-dependent Eikonal equation defined on a Riemannian manifold. We show that the local and the non-local problems are well-posed in the sense of viscosity solutions and we prove…

Analysis of PDEs · Mathematics 2024-09-23 Jalal M. Fadili , Nicolas Forcadel , Rita Zantout

In practical Bayesian optimization, we must often search over structures with differing numbers of parameters. For instance, we may wish to search over neural network architectures with an unknown number of layers. To relate performance…

Machine Learning · Statistics 2014-09-16 Kevin Swersky , David Duvenaud , Jasper Snoek , Frank Hutter , Michael A. Osborne

This work is concerned with the kernel-based approximation of a complex-valued function from data, where the frequency response function of a partial differential equation in the frequency domain is of particular interest. In this setting,…

Computational Engineering, Finance, and Science · Computer Science 2024-11-26 Julien Bect , Niklas Georg , Ulrich Römer , Sebastian Schöps

In this work, we study the affine-constrained $\ell_1$ regularizers, which frequently arise in statistical and machine learning problems across a variety of applications, including microbiome compositional data analysis and sparse subspace…

Optimization and Control · Mathematics 2025-10-09 Xudong Li , Meixia Lin , Kim-Chuan Toh
‹ Prev 1 3 4 5 6 7 10 Next ›