English
Related papers

Related papers: Robust Nonlinear System Identification in Reproduc…

200 papers

This paper develops a novel mathematical framework for collaborative learning by means of geometrically inspired kernel machines which includes statements on the bounds of generalisation and approximation errors, and sample complexity. For…

In this paper, an adaptive non-parametric method is proposed to estimate the scalar-valued nonlinear function that appears in uncertain systems governed by ordinary differential equations (ODEs). By employing an infinite-dimensional…

Optimization and Control · Mathematics 2021-03-15 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

Learning with Reproducing Kernel Hilbert Spaces (RKHS) has been widely used in many scientific disciplines. Because a RKHS can be very flexible, it is common to impose a regularization term in the optimization to prevent overfitting.…

Methodology · Statistics 2017-06-06 Jingxiang Chen , Chong Zhang , Michael R. Kosorok , Yufeng Liu

This paper introduces a solution to the problem of selecting dynamically (online) the ``optimal'' p-norm to combat outliers in linear adaptive filtering without any knowledge on the probability density function of the outliers. The proposed…

Machine Learning · Computer Science 2022-10-24 Yuki Akiyama , Minh Vu , Konstantinos Slavakis

We present algorithms for performing data-driven stochastic reachability as an addition to SReachTools, an open-source stochastic reachability toolbox. Our method leverages a class of machine learning techniques known as kernel embeddings…

Optimization and Control · Mathematics 2021-03-24 Adam J. Thorpe , Kendric R. Ortiz , Meeko M. K. Oishi

In this paper, a steady axisymmetric MHD flow of two dimensional in- compressible fluids has been investigated. Reproducing Kernel Hilbert Space Method (RKHSM) is implemented to obtain solution of reduced fourth order nonlinear boundary…

Numerical Analysis · Mathematics 2013-09-23 Mustafa Inc , Ali Akgül

This is a tutorial and survey paper on kernels, kernel methods, and related fields. We start with reviewing the history of kernels in functional analysis and machine learning. Then, Mercer kernel, Hilbert and Banach spaces, Reproducing…

Machine Learning · Statistics 2021-06-17 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

The profusion of spectral bands generated by the acquisition process of hyperspectral images generally leads to high computational costs. Such difficulties arise in particular with nonlinear unmixing methods, which are naturally more…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 T. Imbiriba , J. C. M. Bermudez , C. Richard , J. -Y. Tourneret

This paper investigates a general regularization framework for unsupervised domain adaptation in vector-valued regression under the covariate shift assumption, utilizing vector-valued reproducing kernel Hilbert spaces (vRKHS). Covariate…

Statistics Theory · Mathematics 2026-01-30 Markus Holzleitner , Sergiy Pereverzyev , Sergei V. Pereverzyev , Vaibhav Silmana , S. Sivananthan

In this paper, we consider algorithm-independent lower bounds for the problem of black-box optimization of functions having a bounded norm is some Reproducing Kernel Hilbert Space (RKHS), which can be viewed as a non-Bayesian Gaussian…

Machine Learning · Statistics 2021-05-25 Xu Cai , Jonathan Scarlett

Learning models of dynamical systems characterized by specific stability properties is of crucial importance in applications. Existing results mainly focus on linear systems or some limited classes of nonlinear systems and stability…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Matteo Scandella , Michelangelo Bin , Thomas Parisini

Learning-based approaches for controlling safety-critical systems are rapidly growing in popularity; thus, it is important to assure their performance and safety. Hamilton-Jacobi (HJ) reachability analysis is a popular formal verification…

Robotics · Computer Science 2024-04-11 Albert Lin , Somil Bansal

We propose a new, nonparametric approach to learning and representing transition dynamics in Markov decision processes (MDPs), which can be combined easily with dynamic programming methods for policy optimisation and value estimation. This…

Machine Learning · Computer Science 2012-06-22 Steffen Grunewalder , Guy Lever , Luca Baldassarre , Massi Pontil , Arthur Gretton

Substring kernels are classical tools for representing biological sequences or text. However, when large amounts of annotated data are available, models that allow end-to-end training such as neural networks are often preferred. Links…

Machine Learning · Statistics 2019-10-18 Dexiong Chen , Laurent Jacob , Julien Mairal

We develop a mathematical framework to address a broad class of metric and preference learning problems within a Hilbert space. We obtain a novel representer theorem for the simultaneous task of metric and preference learning. Our key…

Machine Learning · Computer Science 2025-10-28 Peyman Morteza

Reinforcement learning consists of finding policies that maximize an expected cumulative long-term reward in a Markov decision process with unknown transition probabilities and instantaneous rewards. In this paper, we consider the problem…

Systems and Control · Computer Science 2018-07-31 Santiago Paternain , Juan Andrés Bazerque , Austin Small , Alejandro Ribeiro

We develop novel learning rates for conditional mean embeddings by applying the theory of interpolation for reproducing kernel Hilbert spaces (RKHS). We derive explicit, adaptive convergence rates for the sample estimator under the…

Machine Learning · Statistics 2026-04-09 Prem Talwai , Ali Shameli , David Simchi-Levi

In this work, we address optimization problems where the objective function is a nonlinear function of an expected value, i.e., compositional stochastic {strongly convex programs}. We consider the case where the decision variable is not…

Optimization and Control · Mathematics 2020-11-30 Amrit Singh Bedi , Alec Koppel , Ketan Rajawat , Panchajanya Sanyal

The recent developments of basis pursuit and compressed sensing seek to extract information from as few samples as possible. In such applications, since the number of samples is restricted, one should deploy the sampling points wisely. We…

Information Theory · Computer Science 2012-07-26 Rui Wang , Haizhang Zhang

This paper introduces algorithms to select/design kernels in Gaussian process regression/kriging surrogate modeling techniques. We adopt the setting of kernel method solutions in ad hoc functional spaces, namely Reproducing Kernel Hilbert…

Machine Learning · Statistics 2022-09-07 Jean-Luc Akian , Luc Bonnet , Houman Owhadi , Éric Savin