English
Related papers

Related papers: Adaptive Learning in Cartesian Product of Reproduc…

200 papers

Modeling dynamical systems with ordinary differential equations implies a mechanistic view of the process underlying the dynamics. However in many cases, this knowledge is not available. To overcome this issue, we introduce a general…

Machine Learning · Computer Science 2014-11-20 Markus Heinonen , Florence d'Alché-Buc

The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

Nonlinearities in piezoelectric systems can arise from internal factors such as nonlinear constitutive laws or external factors like realizations of boundary conditions. It can be difficult or even impossible to derive detailed models from…

Optimization and Control · Mathematics 2020-04-14 Sai Tej Paruchuri , Jia Guo , Andrew J. Kurdila

In this paper, we introduce a new distribution regression model for probability distributions. This model is based on a Reproducing Kernel Hilbert Space (RKHS) regression framework, where universal kernels are built using Wasserstein…

Statistics Theory · Mathematics 2019-10-07 Thi Thien Trang Bui , J-M Loubes , Laurent Risser , Patricia Balaresque

In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their adaptive capability.…

Machine Learning · Computer Science 2015-08-31 Songlin Zhao

Reinforcement learning consists of finding policies that maximize an expected cumulative long-term reward in a Markov decision process with unknown transition probabilities and instantaneous rewards. In this paper, we consider the problem…

Systems and Control · Computer Science 2018-07-31 Santiago Paternain , Juan Andrés Bazerque , Austin Small , Alejandro Ribeiro

A framework for coherent pattern extraction and prediction of observables of measure-preserving, ergodic dynamical systems with both atomic and continuous spectral components is developed. It is based on an approximation of the generator of…

Dynamical Systems · Mathematics 2021-03-18 Dimitrios Giannakis , Suddhasattwa Das , Joanna Slawinska

Hierarchical data pervades diverse machine learning applications, including natural language processing, computer vision, and social network analysis. Hyperbolic space, characterized by its negative curvature, has demonstrated strong…

Artificial Intelligence · Computer Science 2026-03-13 Leping Si , Meimei Yang , Hui Xue , Shipeng Zhu , Pengfei Fang

Many machine learning approaches for decision making, such as reinforcement learning, rely on simulators or predictive models to forecast the time-evolution of quantities of interest, e.g., the state of an agent or the reward of a policy.…

Machine Learning · Computer Science 2024-01-17 Petar Bevanda , Max Beier , Armin Lederer , Stefan Sosnowski , Eyke Hüllermeier , Sandra Hirche

We propose a new data-driven approach for learning the fundamental solutions (Green's functions) of various linear partial differential equations (PDEs) given sample pairs of input-output functions. Building off the theory of functional…

Statistics Theory · Mathematics 2023-04-11 George Stepaniants

This work presents a nonparametric framework for dissipativity learning in reproducing kernel Hilbert spaces, which enables data-driven certification of stability and performance properties for unknown nonlinear systems without requiring an…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Xiuzhen Ye , Wentao Tang

We develop a mathematical framework to address a broad class of metric and preference learning problems within a Hilbert space. We obtain a novel representer theorem for the simultaneous task of metric and preference learning. Our key…

Machine Learning · Computer Science 2025-10-28 Peyman Morteza

Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…

Machine Learning · Computer Science 2024-06-04 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

In this work, we address optimization problems where the objective function is a nonlinear function of an expected value, i.e., compositional stochastic {strongly convex programs}. We consider the case where the decision variable is not…

Optimization and Control · Mathematics 2020-11-30 Amrit Singh Bedi , Alec Koppel , Ketan Rajawat , Panchajanya Sanyal

The performance of reproducing kernel Hilbert space-based methods is known to be sensitive to the choice of the reproducing kernel. Choosing an adequate reproducing kernel can be challenging and computationally demanding, especially in…

Machine Learning · Computer Science 2023-11-07 Emilio Ruiz-Moreno , Baltasar Beferull-Lozano

We propose a general framework for policy representation for reinforcement learning tasks. This framework involves finding a low-dimensional embedding of the policy on a reproducing kernel Hilbert space (RKHS). The usage of RKHS based…

Machine Learning · Computer Science 2020-10-16 Bogdan Mazoure , Thang Doan , Tianyu Li , Vladimir Makarenkov , Joelle Pineau , Doina Precup , Guillaume Rabusseau

Deep Gaussian Processes (DGPs) leverage a compositional structure to model non-stationary processes. DGPs typically rely on local inducing point approximations across intermediate GP layers. Recent advances in DGP inference have shown that…

Machine Learning · Computer Science 2025-04-29 Xinxing Shi , Thomas Baldwin-McDonald , Mauricio A. Álvarez

Compositional data, such as human gut microbiomes, consist of non-negative variables whose only the relative values to other variables are available. Analyzing compositional data such as human gut microbiomes needs a careful treatment of…

Machine Learning · Statistics 2022-05-04 Binglin Li , Jeongyoun Ahn

This paper designs novel nonparametric Bellman mappings in reproducing kernel Hilbert spaces (RKHSs) for reinforcement learning (RL). The proposed mappings benefit from the rich approximating properties of RKHSs, adopt no assumptions on the…

Signal Processing · Electrical Eng. & Systems 2024-04-01 Yuki Akiyama , Minh Vu , Konstantinos Slavakis

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations leading to various…

Machine Learning · Statistics 2019-05-15 Alberto Bietti , Grégoire Mialon , Dexiong Chen , Julien Mairal