English
Related papers

Related papers: Extrinsic Kernel Ridge Regression Classifier for P…

200 papers

Kernel methods are an extremely popular set of techniques used for many important machine learning and data analysis applications. In addition to having good practical performances, these methods are supported by a well-developed theory.…

Machine Learning · Statistics 2015-04-23 Shiva Prasad Kasiviswanathan , Mark Rudelson

The importance of wild video based image set recognition is becoming monotonically increasing. However, the contents of these collected videos are often complicated, and how to efficiently perform set modeling and feature extraction is a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Rui Wang , XiaoJun Wu , Josef Kittler

The classical kernel ridge regression problem aims to find the best fit for the output $Y$ as a function of the input data $X\in \mathbb{R}^d$, with a fixed choice of regularization term imposed by a given choice of a reproducing kernel…

Machine Learning · Statistics 2025-06-10 Yang Li , Feng Ruan

In this paper we propose a novel Bayesian solution for nonlinear regression in complex fields. Previous solutions for kernels methods usually assume a complexification approach, where the real-valued kernel is replaced by a complex-valued…

Machine Learning · Computer Science 2018-03-02 Rafael Boloix-Tortosa , Eva Arias-de-Reyna , F. Javier Payan-Somet , Juan J. Murillo-Fuentes

It is proven that encoding images and videos through Symmetric Positive Definite (SPD) matrices, and considering the Riemannian geometry of the resulting space, can lead to increased classification performance. Taking into account manifold…

Computer Vision and Pattern Recognition · Computer Science 2016-03-16 Azadeh Alavi , Vishal M Patel , Rama Chellappa

Fisher's linear discriminant analysis is a classical method for classification, yet it is limited to capturing linear features only. Kernel discriminant analysis as an extension is known to successfully alleviate the limitation through a…

Machine Learning · Statistics 2022-07-29 Jiae Kim , Yoonkyung Lee , Zhiyu Liang

This paper carries out a large dimensional analysis of a variation of kernel ridge regression that we call \emph{centered kernel ridge regression} (CKRR), also known in the literature as kernel ridge regression with offset. This modified…

Machine Learning · Statistics 2020-04-22 Khalil Elkhalil , Abla Kammoun , Xiangliang Zhang , Mohamed-Slim Alouini , Tareq Al-Naffouri

General predictive models do not provide a measure of confidence in predictions without Bayesian assumptions. A way to circumvent potential restrictions is to use conformal methods for constructing non-parametric confidence regions, that…

Machine Learning · Statistics 2016-09-21 Evgeny Burnaev , Ivan Nazarov

We propose a novel class of Gaussian processes (GPs) whose spectra have compact support, meaning that their sample trajectories are almost-surely band limited. As a complement to the growing literature on spectral design of covariance…

Machine Learning · Statistics 2019-09-17 Felipe Tobar

In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to flexibly combine individual regression estimators $r_1, r_2, \ldots, r_M$ using a weighted average where the weights are defined…

Methodology · Statistics 2021-04-29 Sothea Has

Modern machine learning systems are increasingly trained on large amounts of data embedded in high-dimensional spaces. Often this is done without analyzing the structure of the dataset. In this work, we propose a framework to study the…

Machine Learning · Computer Science 2023-04-27 Carlos Hurtado , Sarath Shekkizhar , Javier Ruiz-Hidalgo , Antonio Ortega

This work incorporates the multi-modality of the data distribution into a Gaussian Process regression model. We approach the problem from a discriminative perspective by learning, jointly over the training data, the target space variance in…

Machine Learning · Computer Science 2018-03-20 Silvia L. Pintea , Jan C. van Gemert , Arnold W. M. Smeulders

We consider a class of (possibly strongly) geodesically convex optimization problems on Hadamard manifolds, where the objective function splits into the sum of a smooth and a possibly nonsmooth function. We introduce an intrinsic convex…

Optimization and Control · Mathematics 2025-07-23 Ronny Bergmann , Hajg Jasa , Paula John , Max Pfeffer

In this paper, we propose an outlier-robust regularized kernel-based method for linear system identification. The unknown impulse response is modeled as a zero-mean Gaussian process whose covariance (kernel) is given by the recently…

Machine Learning · Statistics 2013-12-25 Giulio Bottegal , Aleksandr Y. Aravkin , Hakan Hjalmarsson , Gianluigi Pillonetto

We propose a class of intrinsic Gaussian processes (in-GPs) for interpolation, regression and classification on manifolds with a primary focus on complex constrained domains or irregular shaped spaces arising as subsets or submanifolds of…

Machine Learning · Statistics 2018-01-05 Mu Niu , Pokman Cheung , Lizhen Lin , Zhenwen Dai , Neil Lawrence , David Dunson

In this paper, we analyze the spatial information of deep features, and propose two complementary regressions for robust visual tracking. First, we propose a kernelized ridge regression model wherein the kernel value is defined as the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Chong Sun , Dong Wang , Huchuan Lu , Ming-Hsuan Yang

Kernel methods are one of the mainstays of machine learning, but the problem of kernel learning remains challenging, with only a few heuristics and very little theory. This is of particular importance in methods based on estimation of…

Machine Learning · Statistics 2016-06-03 Seth Flaxman , Dino Sejdinovic , John P. Cunningham , Sarah Filippi

Gaussian processes are used in many machine learning applications that rely on uncertainty quantification. Recently, computational tools for working with these models in geometric settings, such as when inputs lie on a Riemannian manifold,…

Machine Learning · Statistics 2023-10-31 Paul Rosa , Viacheslav Borovitskiy , Alexander Terenin , Judith Rousseau

This paper introduces an efficient multi-linear nonparametric (kernel-based) approximation framework for data regression and imputation, and its application to dynamic magnetic-resonance imaging (dMRI). Data features are assumed to reside…

Signal Processing · Electrical Eng. & Systems 2023-04-07 Duc Thien Nguyen , Konstantinos Slavakis

Despite the increasing importance of stochastic processes on linear networks and graphs, current literature on multivariate (vector-valued) Gaussian random fields on metric graphs is elusive. This paper challenges several aspects related to…

Statistics Theory · Mathematics 2025-01-20 Tobia Filosi , Emilio Porcu , Xavier Emery , Claudio Agostinelli , Alfredo Alegrìa