English
Related papers

Related papers: Localisation of Regularised and Multiview Support …

200 papers

We propose a localized approach to multiple kernel learning that can be formulated as a convex optimization problem over a given cluster structure. For which we obtain generalization error guarantees and derive an optimization algorithm…

Machine Learning · Computer Science 2016-10-14 Yunwen Lei , Alexander Binder , Ürün Dogan , Marius Kloft

We consider a high-probability non-asymptotic confidence estimation in the $\ell^2$-regularized non-linear least-squares setting with fixed design. In particular, we study confidence estimation for local minimizers of the regularized…

Machine Learning · Computer Science 2025-06-12 Ilja Kuzborskij , Yasin Abbasi Yadkori

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

Optimization and Control · Mathematics 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran

We present a systematic study on a class of nonlocal integral functionals for functions defined on a bounded domain and the naturally induced function spaces. The function spaces are equipped with a seminorm depending on finite differences…

Analysis of PDEs · Mathematics 2023-07-19 James M. Scott , Qiang Du

This paper considers the inversion of ill-posed linear operators. To regularise the problem the solution is enforced to lie in a non-convex subset. Theoretical properties for the stable inversion are derived and an iterative algorithm akin…

Numerical Analysis · Mathematics 2009-11-30 Thomas Blumensath

We consider the problem of metric learning for multi-view data and present a novel method for learning within-view as well as between-view metrics in vector-valued kernel spaces, as a way to capture multi-modal structure of the data. We…

Machine Learning · Computer Science 2018-03-22 Riikka Huusari , Hachem Kadri , Cécile Capponi

The support vector machine (SVM) is a popular machine learning classification method which produces a nonlinear decision boundary in a feature space by constructing linear boundaries in a transformed Hilbert space. It is well known that…

Quantum Physics · Physics 2017-10-31 Rupak Chatterjee , Ting Yu

Robot localization is an inverse problem of finding a robot's pose using a map and sensor measurements. In recent years, Invertible Neural Networks (INNs) have successfully solved ambiguous inverse problems in various fields. This paper…

Robotics · Computer Science 2022-09-27 Zirui Zang , Hongrui Zheng , Johannes Betz , Rahul Mangharam

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

We present a new method for minimizing the sum of a differentiable convex function and an $\ell_1$-norm regularizer. The main features of the new method include: $(i)$ an evolving set of indices corresponding to variables that are predicted…

Optimization and Control · Mathematics 2016-02-24 Tianyi Chen , Frank E. Curtis , Daniel P. Robinson

Metric and kernel learning are important in several machine learning applications. However, most existing metric learning algorithms are limited to learning metrics over low-dimensional data, while existing kernel learning algorithms are…

Machine Learning · Computer Science 2009-11-02 Prateek Jain , Brian Kulis , Jason V. Davis , Inderjit S. Dhillon

We provide an overview of recent progress in statistical inverse problems with random experimental design, covering both linear and nonlinear inverse problems. Different regularization schemes have been studied to produce robust and stable…

Statistics Theory · Mathematics 2023-12-27 Abhishake , Tapio Helin , Nicole Mücke

This article develops direct and inverse estimates for certain finite dimensional spaces arising in kernel approximation. Both the direct and inverse estimates are based on approximation spaces spanned by local Lagrange functions which are…

Numerical Analysis · Mathematics 2017-09-08 Thomas Hangelbroek , Francis J. Narcowich , Christian Rieger , Joseph D. Ward

We establish partial H\"older regularity for (local) generalised minimisers of variational problems involving strongly quasi-convex integrands of linear growth, where the full gradient is replaced by a first order homogeneous differential…

Analysis of PDEs · Mathematics 2022-03-02 Matthias Bärlin , Konrad Keßler

In this article, we propose a novel regularization method for a class of nonlinear inverse problems that is inspired by an application in quantitative magnetic resonance imaging (qMRI). The latter is a special instance of a general…

Optimization and Control · Mathematics 2025-06-16 Guozhi Dong , Michael Hintermüller , Clemens Sirotenko

In this paper we provide a finite-sample and an infinite-sample representer theorem for the concatenation of (linear combinations of) kernel functions of reproducing kernel Hilbert spaces. These results serve as mathematical foundation for…

Machine Learning · Computer Science 2018-06-08 Bastian Bohn , Michael Griebel , Christian Rieger

Matrix approximations are a key element in large-scale algebraic machine learning approaches. The recently proposed method MEKA (Si et al., 2014) effectively employs two common assumptions in Hilbert spaces: the low-rank property of an…

Machine Learning · Computer Science 2022-01-21 Simon Heilig , Maximilian Münch , Frank-Michael Schleif

Standard convolutions are prevalent in image processing and deep learning, but their fixed kernels limits adaptability. Several deformation strategies of the reference kernel grid have been proposed. Yet, they lack a unified theoretical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Thomas Dagès , Michael Lindenbaum , Alfred M. Bruckstein

Regularization-based approaches for injecting constraints in Machine Learning (ML) were introduced to improve a predictive model via expert knowledge. We tackle the issue of finding the right balance between the loss (the accuracy of the…

Machine Learning · Computer Science 2020-05-22 Michele Lombardi , Federico Baldo , Andrea Borghesi , Michela Milano

We review machine learning methods employing positive definite kernels. These methods formulate learning and estimation problems in a reproducing kernel Hilbert space (RKHS) of functions defined on the data domain, expanded in terms of a…

Statistics Theory · Mathematics 2009-09-29 Thomas Hofmann , Bernhard Schölkopf , Alexander J. Smola