English
Related papers

Related papers: Optimized Kernel-based Projection Space of Riemann…

200 papers

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations leading to various…

Machine Learning · Statistics 2019-05-15 Alberto Bietti , Grégoire Mialon , Dexiong Chen , Julien Mairal

In this paper, we introduce a new image representation based on a multilayer kernel machine. Unlike traditional kernel methods where data representation is decoupled from the prediction task, we learn how to shape the kernel with…

Machine Learning · Statistics 2016-10-26 Julien Mairal

Kernel methods are powerful tools in machine learning. Classical kernel methods are based on positive-definite kernels, which map data spaces into reproducing kernel Hilbert spaces (RKHS). For non-Euclidean data spaces, positive-definite…

Machine Learning · Computer Science 2024-07-31 Nathael Da Costa , Cyrus Mostajeran , Juan-Pablo Ortega , Salem Said

The kernel mean embedding of probability distributions is commonly used in machine learning as an injective mapping from distributions to functions in an infinite dimensional Hilbert space. It allows us, for example, to define a distance…

Quantum Physics · Physics 2019-12-24 Jonas M. Kübler , Krikamol Muandet , Bernhard Schölkopf

We investigate the problem of finding inner ap-proximations of positive semidefinite (PSD) cones. We developa novel decomposition framework of the PSD cone by meansof conical combinations of smaller dimensional sub-cones. Weshow that many…

Optimization and Control · Mathematics 2021-10-01 Tianqi Zheng , James Guthrie , Enrique Mallada

We focus on kernel methods for set-valued inputs and their application to Bayesian set optimization, notably combinatorial optimization. We investigate two classes of set kernels that both rely on Reproducing Kernel Hilbert Space…

Machine Learning · Statistics 2020-03-11 Poompol Buathong , David Ginsbourger , Tipaluck Krityakierne

Kernel methods are one of the cornerstones of learning-based control, modern system identification, surrogate modelling, and related fields. A key advantage of this class of learning and function approximation methods is the availability of…

Numerical Analysis · Mathematics 2026-05-20 Tizian Wenzel , Abdullah Tokmak , Christian Fiedler

The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

We propose an inexact optimization algorithm on Riemannian manifolds, motivated by quadratic discrimination tasks in high-dimensional, low-sample-size (HDLSS) imaging settings. In such applications, gradient evaluations are often biased due…

Optimization and Control · Mathematics 2025-07-08 Uday Talwar , Meredith K. Kupinski , Afrooz Jalilzadeh

In a general context of positive definite kernels $k$, we develop tools and algorithms for sampling in reproducing kernel Hilbert space $\mathscr{H}$ (RKHS). With reference to these RKHSs, our results allow inference from samples; more…

Functional Analysis · Mathematics 2016-01-28 Palle Jorgensen , Feng Tian

Representations that can compactly and effectively capture temporal evolution of semantic content are important to machine learning algorithms that operate on multi-variate time-series data. We investigate such representations motivated by…

Computer Vision and Pattern Recognition · Computer Science 2017-05-25 Anoop Cherian , Suvrit Sra , Richard Hartley

Optimization over the Stiefel manifold is a fundamental computational problem in many scientific and engineering applications. Despite considerable research effort, high-dimensional optimization problems over the Stiefel manifold remain…

Optimization and Control · Mathematics 2025-05-16 Andy Yat-Ming Cheung , Jinxin Wang , Man-Chung Yue , Anthony Man-Cho So

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

Machine Learning · Statistics 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

Learning the manifold structure of remote sensing images is of paramount relevance for modeling and understanding processes, as well as to encapsulate the high dimensionality in a reduced set of informative features for subsequent…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Gulsen Taskin , Gustau Camps-Valls

Deep neural networks for learning Symmetric Positive Definite (SPD) matrices are gaining increasing attention in machine learning. Despite the significant progress, most existing SPD networks use traditional Euclidean classifiers on an…

Machine Learning · Computer Science 2024-03-21 Ziheng Chen , Yue Song , Gaowen Liu , Ramana Rao Kompella , Xiaojun Wu , Nicu Sebe

We consider expected risk minimization problems when the range of the estimator is required to be nonnegative, motivated by the settings of maximum likelihood estimation (MLE) and trajectory optimization. To facilitate nonlinear…

Machine Learning · Statistics 2022-05-05 Abhishek Chakraborty , Ketan Rajawat , Alec Koppel

The Symmetric Positive Definite (SPD) matrices have received wide attention for data representation in many scientific areas. Although there are many different attempts to develop effective deep architectures for data processing on the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Ziheng Chen , Tianyang Xu , Xiao-Jun Wu , Rui Wang , Zhiwu Huang , Josef Kittler

Probabilistic predictions are probability distributions over the set of possible outcomes. Such predictions quantify the uncertainty in the outcome, making them essential for effective decision making. By combining multiple predictions, the…

Machine Learning · Statistics 2024-11-26 Sam Allen , David Ginsbourger , Johanna Ziegel

Traditional machine learning models, particularly neural networks, are rooted in finite-dimensional parameter spaces and nonlinear function approximations. This report explores an alternative formulation where learning tasks are expressed…

Machine Learning · Computer Science 2025-07-30 Andrew Kiruluta , Andreas Lemos , Priscilla Burity
‹ Prev 1 3 4 5 6 7 10 Next ›