English
Related papers

Related papers: Adaptive Robust Kernels for Non-Linear Least Squar…

200 papers

We present an algorithm for L1-norm kernel PCA and provide a convergence analysis for it. While an optimal solution of L2-norm kernel PCA can be obtained through matrix decomposition, finding that of L1-norm kernel PCA is not trivial due to…

Machine Learning · Statistics 2020-06-12 Cheolmin Kim , Diego Klabjan

This work developed a kernel-based residual learning framework for quadrupedal robotic locomotion. Initially, a kernel neural network is trained with data collected from an MPC controller. Alongside a frozen kernel network, a residual…

Robotics · Computer Science 2023-02-16 Milo Carroll , Zhaocheng Liu , Mohammadreza Kasaei , Zhibin Li

We consider supervised learning problems within the positive-definite kernel framework, such as kernel ridge regression, kernel logistic regression or the support vector machine. With kernels leading to infinite-dimensional feature spaces,…

Machine Learning · Computer Science 2013-05-23 Francis Bach

Randomized benchmarking and variants thereof, which we collectively call RB+, are widely used to characterize the performance of quantum computers because they are simple, scalable, and robust to state-preparation and measurement errors.…

Quantum Physics · Physics 2019-06-05 Robin Harper , Ian Hincks , Chris Ferrie , Steven T. Flammia , Joel J. Wallman

In this paper we propose a new non-linear classifier based on a combination of locally linear classifiers. A well known optimization formulation is given as we cast the problem in a $\ell_1$ Multiple Kernel Learning (MKL) problem using many…

Machine Learning · Computer Science 2024-01-19 David Picard

Multiple kernel learning (MKL) method is generally believed to perform better than single kernel method. However, some empirical studies show that this is not always true: the combination of multiple kernels may even yield an even worse…

Machine Learning · Statistics 2018-06-21 Zhao Kang , Xiao Lu , Jinfeng Yi , Zenglin Xu

Principal Component Analysis (PCA) finds a linear mapping and maximizes the variance of the data which makes PCA sensitive to outliers and may cause wrong eigendirection. In this paper, we propose techniques to solve this problem; we use…

Artificial Intelligence · Computer Science 2012-07-03 Peratham Wiriyathammabhum , Boonserm Kijsirikul

A scheme for locally adaptive bandwidth selection is proposed which sensitively shrinks the bandwidth of a kernel estimator at lowest density regions such as the support boundary which are unknown to the statistician. In case of a…

Statistics Theory · Mathematics 2016-01-25 Tim Patschkowski , Angelika Rohde

We propose a new formulation of robust regression by integrating all realizations of the uncertainty set and taking an averaged approach to obtain the optimal solution for the ordinary least squares regression problem. We show that this…

Machine Learning · Computer Science 2024-10-10 Dimitris Bertsimas , Yu Ma

Panel-based, kernel-split quadrature is currently one of the most efficient methods available for accurate evaluation of singular and nearly singular layer potentials in two dimensions. However, it can fail completely for the layer…

Numerical Analysis · Mathematics 2022-01-20 Fredrik Fryklund , Ludvig af Klinteberg , Anna-Karin Tornberg

The maximum correntropy criterion (MCC) has recently been successfully applied in robust regression, classification and adaptive filtering, where the correntropy is maximized instead of minimizing the well-known mean square error (MSE) to…

Machine Learning · Statistics 2017-11-27 Badong Chen , Lei Xing , Haiquan Zhao , Bin Xu , Jose C. Principe

Restricted kernel machines (RKMs) represent a versatile and powerful framework within the kernel machine family, leveraging conjugate feature duality to address a wide range of machine learning tasks, including classification, regression,…

Machine Learning · Computer Science 2025-04-17 Ritik Mishra , Mushir Akhtar , M. Tanveer

Medical image registration is crucial for various clinical and research applications including disease diagnosis or treatment planning which require alignment of images from different modalities, time points, or subjects. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Ahsan Raza Siyal , Markus Haltmeier , Ruth Steiger , Malik Galijasevic , Elke Ruth Gizewski , Astrid Ellen Grams

We explore why many recently proposed robust estimation problems are efficiently solvable, even though the underlying optimization problems are non-convex. We study the loss landscape of these robust estimation problems, and identify the…

Machine Learning · Statistics 2020-05-29 Banghua Zhu , Jiantao Jiao , Jacob Steinhardt

We consider the problem of high-dimensional non-linear variable selection for supervised learning. Our approach is based on performing linear selection among exponentially many appropriately defined positive definite kernels that…

Machine Learning · Computer Science 2009-09-08 Francis Bach

A robust adaptive model predictive control (MPC) algorithm is presented for linear, time invariant systems with unknown dynamics and subject to bounded measurement noise. The system is characterized by an impulse response model, which is…

Systems and Control · Electrical Eng. & Systems 2019-11-21 Anilkumar Parsi , Andrea Iannelli , Mingzhou Yin , Mohammad Khosravi , Roy S. Smith

Regularized least-squares approaches have been successfully applied to linear system identification. Recent approaches use quadratic penalty terms on the unknown impulse response defined by stable spline kernels, which control model space…

Machine Learning · Statistics 2018-07-27 Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto

We are interested in a framework of online learning with kernels for low-dimensional but large-scale and potentially adversarial datasets. We study the computational and theoretical performance of online variations of kernel Ridge…

Machine Learning · Statistics 2019-05-30 Rémi Jézéquel , Pierre Gaillard , Alessandro Rudi

We present a novel approach to learn a kernel-based regression function. It is based on the useof conical combinations of data-based parameterized kernels and on a new stochastic convex optimization procedure of which we establish…

Machine Learning · Computer Science 2012-01-13 Pierre Machart , Thomas Peel , Liva Ralaivola , Sandrine Anthoine , Hervé Glotin

Robust stability problem of integral delay systems with uncertain kernel matrix functions is addressed in this paper. On the basis of characteristic equation and the argument principle, an algorithm is generated which is shown to outperform…

Systems and Control · Electrical Eng. & Systems 2020-08-25 Hamed Taghavian
‹ Prev 1 8 9 10 Next ›