English
Related papers

Related papers: Learning Reconstructive Embeddings in Reproducing …

200 papers

Stochastic configuration networks (SCNs), as a class of randomized learner models, are featured by its way of random parameters assignment in the light of a supervisory mechanism, resulting in the universal approximation property at…

Machine Learning · Computer Science 2024-12-17 Yongxuan Chen , Dianhui Wang

We propose a framework for transfer learning of discount curves across different fixed-income product classes. Motivated by challenges in estimating discount curves from sparse or noisy data, we extend kernel ridge regression (KR) to a…

Machine Learning · Statistics 2026-01-14 Nicolas Camenzind , Damir Filipovic

In image set classification, a considerable advance has been made by modeling the original image sets by second order statistics or linear subspace, which typically lie on the Riemannian manifold. Specifically, they are Symmetric Positive…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Rui Wang , Xiao-Jun Wu , Kai-Xuan Chen , Josef Kittler

Reinforcement learning consists of finding policies that maximize an expected cumulative long-term reward in a Markov decision process with unknown transition probabilities and instantaneous rewards. In this paper, we consider the problem…

Systems and Control · Computer Science 2018-07-31 Santiago Paternain , Juan Andrés Bazerque , Austin Small , Alejandro Ribeiro

We introduce a functional gradient descent trajectory optimization algorithm for robot motion planning in Reproducing Kernel Hilbert Spaces (RKHSs). Functional gradient algorithms are a popular choice for motion planning in complex…

Robotics · Computer Science 2016-01-15 Zita Marinho , Anca Dragan , Arun Byravan , Byron Boots , Siddhartha Srinivasa , Geoffrey Gordon

We introduce a vector differential operator $\mathbf{P}$ and a vector boundary operator $\mathbf{B}$ to derive a reproducing kernel along with its associated Hilbert space which is shown to be embedded in a classical Sobolev space. This…

Numerical Analysis · Mathematics 2011-09-28 Gregory E. Fasshauer , Qi Ye

This paper focuses on the use of the theory of Reproducing Kernel Hilbert Spaces in the statistical analysis of replicated point processes. We show that spatial point processes can be observed as random variables in a Reproducing Kernel…

Methodology · Statistics 2023-01-06 Amelia Simó

In this paper, we study the problem of early stopping for iterative learning algorithms in a reproducing kernel Hilbert space (RKHS) in the nonparametric regression framework. In particular, we work with the gradient descent and (iterative)…

Machine Learning · Statistics 2024-11-26 Yaroslav Averyanov , Alain Celisse

Predictive State Representations (PSRs) are an expressive class of models for controlled stochastic processes. PSRs represent state as a set of predictions of future observable events. Because PSRs are defined entirely in terms of…

Machine Learning · Computer Science 2013-09-27 Byron Boots , Geoffrey Gordon , Arthur Gretton

We propose a novel online learning paradigm for nonlinear-function estimation tasks based on the iterative projections in the L2 space with probability measure reflecting the stochastic property of input signals. The proposed learning…

Signal Processing · Electrical Eng. & Systems 2018-09-13 Motoya Ohnishi , Masahiro Yukawa

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

In this article, the reproducing kernel Hilbert space [0, 1] is employed for solving a class of third-order periodic boundary value problem by using fitted reproducing kernel algorithm. The reproducing kernel function is built to get fast…

Numerical Analysis · Mathematics 2017-04-18 Asad Freihat , Radwan Abu-Gdairi , Hammad Khalil , Eman Abuteen , Mohammed Al-Smadi , Rahmat Ali Khan

In this paper we introduce the deep kernelized autoencoder, a neural network model that allows an explicit approximation of (i) the mapping from an input space to an arbitrary, user-specified kernel space and (ii) the back-projection from…

Machine Learning · Statistics 2017-02-09 Michael Kampffmeyer , Sigurd Løkse , Filippo Maria Bianchi , Robert Jenssen , Lorenzo Livi

We focus on kernel methods for set-valued inputs and their application to Bayesian set optimization, notably combinatorial optimization. We investigate two classes of set kernels that both rely on Reproducing Kernel Hilbert Space…

Machine Learning · Statistics 2020-03-11 Poompol Buathong , David Ginsbourger , Tipaluck Krityakierne

Obtaining reliable, adaptive confidence sets for prediction functions (hypotheses) is a central challenge in sequential decision-making tasks, such as bandits and model-based reinforcement learning. These confidence sets typically rely on…

Machine Learning · Statistics 2022-06-20 Parnian Kassraie , Jonas Rothfuss , Andreas Krause

A methodological framework for ensemble-based estimation and simulation of high dimensional dynamical systems such as the oceanic or atmospheric flows is proposed. To that end, the dynamical system is embedded in a family of reproducing…

Mathematical Physics · Physics 2024-01-02 Benjamin Dufée , Bérenger Hug , Etienne Mémin , Gilles Tissot

The role of kernels is central to machine learning. Motivated by the importance of power-law distributions in statistical modeling, in this paper, we propose the notion of power-law kernels to investigate power-laws in learning problem. We…

Machine Learning · Computer Science 2013-04-02 Debarghya Ghoshdastidar , Ambedkar Dukkipati

Kernel methods provide a theoretically grounded framework for non-linear and non-parametric learning, with strong analytic foundations and statistical guarantees. Yet, their scalability has long been limited by prohibitive time and memory…

Machine Learning · Computer Science 2025-10-01 Maedeh Zarvandi , Michael Timothy , Theresa Wasserer , Debarghya Ghoshdastidar

Recent advances in machine learning have led to increased interest in reproducing kernel Banach spaces (RKBS) as a more general framework that extends beyond reproducing kernel Hilbert spaces (RKHS). These works have resulted in the…

Machine Learning · Computer Science 2024-11-19 Akash Kumar , Mikhail Belkin , Parthe Pandit

This paper combines vector-valued reproducing kernel Hilbert space (vRKHS) embedding with robust adaptive observation, yielding an algorithm that is both non-parametric and robust. The main contribution of this paper lies in the ability of…

Systems and Control · Electrical Eng. & Systems 2025-10-28 Shengyuan Niu , Haoran Wang , Heejip Moon , Andrea L'Afflitto , Andrew Kurdila , Daniel Stilwell