English
Related papers

Related papers: A Generalized Representer Theorem for Hilbert Spac…

200 papers

We consider positive semidefinite kernels which have values given by bounded linear operators on certain bundles of Hilbert spaces and which are invariant under actions of $*$-semigroupoids. For these kernels, we prove that there exist…

Functional Analysis · Mathematics 2026-02-20 Aurelian Gheondea

A key question in reinforcement learning is how an intelligent agent can generalize knowledge across different inputs. By generalizing across different inputs, information learned for one input can be immediately reused for improving…

Machine Learning · Computer Science 2020-10-06 Lucas Lehnert , Michael L. Littman

We present some general theorems about operator algebras that are algebras of functions on sets, including theories of local algebras, residually finite dimensional operator algebras and algebras that can be represented as the scalar…

Operator Algebras · Mathematics 2009-07-30 Meghna Mittal , Vern Paulsen

Recent papers on the theory of representation learning has shown the importance of a quantity called diversity when generalizing from a set of source tasks to a target task. Most of these papers assume that the function mapping shared…

Machine Learning · Statistics 2021-06-01 Ziping Xu , Ambuj Tewari

A proof that minimum uncertainty states of the simplest periodic quantum system exist in a state space that is represented by a Colombeau algebra of generalised functions but not in Hilbert space or in the space of Schwartz distributions is…

Mathematical Physics · Physics 2014-06-16 Ian G Fuss , Alexei Filinkov

Traditional linear methods for forecasting multivariate time series are not able to satisfactorily model the non-linear dependencies that may exist in non-Gaussian series. We build on the theory of learning vector-valued functions in the…

Machine Learning · Computer Science 2017-06-28 Magda Gregorová , Alexandros Kalousis , Stéphane Marchand-Maillet

This work presents a nonparametric framework for dissipativity learning in reproducing kernel Hilbert spaces, which enables data-driven certification of stability and performance properties for unknown nonlinear systems without requiring an…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Xiuzhen Ye , Wentao Tang

We give two new global and algorithmic constructions of the reproducing kernel Hilbert space associated to a positive definite kernel. We further present ageneral positive definite kernel setting using bilinear forms, and we provide new…

Functional Analysis · Mathematics 2020-11-20 Daniel Alpay , Palle Jorgensen

The aim of the paper is to create a link between the theory of reproducing kernel Hilbert spaces (RKHS) and the notion of a unitary representation of a group or of a groupoid. More specifically, it is demonstrated on one hand, how to…

Functional Analysis · Mathematics 2021-02-22 Monika Drewnik , Tomasz Miller , Zbigniew Pasternak-Winiarski

Representation learning based on multi-task pretraining has become a powerful approach in many domains. In particular, task-aware representation learning aims to learn an optimal representation for a specific target task by sampling data…

Machine Learning · Computer Science 2023-06-16 Yifang Chen , Yingbing Huang , Simon S. Du , Kevin Jamieson , Guanya Shi

In this paper we analyze a greedy procedure to approximate a linear functional defined in a Reproducing Kernel Hilbert Space by nodal values. This procedure computes a quadrature rule which can be applied to general functionals, including…

Numerical Analysis · Mathematics 2021-05-19 Gabriele Santin , Toni Karvonen , Bernard Haasdonk

Linear algebra's main concerns are sets of vectors, linear functions, subspaces, linear systems, matrices and concepts about those, such as whether the solution of linear system exists or is unique; a set of vectors is linearly independent…

Symbolic Computation · Computer Science 2025-04-15 Iago Leal de Freitas , Júlia Mota , João Paixão , Lucas Rufino

Understanding how agents learn to generalize -- and, in particular, to extrapolate -- in high-dimensional, naturalistic environments remains a challenge for both machine learning and the study of biological agents. One approach to this has…

Machine Learning · Computer Science 2021-06-15 Simon N. Segert , Jonathan D. Cohen

Despite impressive performance as evaluated on i.i.d. holdout data, deep neural networks depend heavily on superficial statistics of the training data and are liable to break under distribution shift. For example, subtle changes to the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Haohan Wang , Zexue He , Zachary C. Lipton , Eric P. Xing

Successor-style representations have many advantages for reinforcement learning: for example, they can help an agent generalize from past experience to new goals, and they have been proposed as explanations of behavioral and neural data…

Machine Learning · Computer Science 2021-03-17 Kianté Brantley , Soroush Mehri , Geoffrey J. Gordon

This thesis addresses the challenge of understanding Neural Networks through the lens of their most fundamental component: the weights, which encapsulate the learned information and determine the model behavior. At the core of this thesis…

Machine Learning · Computer Science 2024-10-08 Konstantin Schürholt

Additive models play an important role in semiparametric statistics. This paper gives learning rates for regularized kernel based methods for additive models. These learning rates compare favourably in particular in high dimensions to…

Machine Learning · Statistics 2014-05-15 Andreas Christmann , Ding-Xuan Zhou

Sparsity of a learning solution is a desirable feature in machine learning. Certain reproducing kernel Banach spaces (RKBSs) are appropriate hypothesis spaces for sparse learning methods. The goal of this paper is to understand what kind of…

Functional Analysis · Mathematics 2024-03-08 Rui Wang , Yuesheng Xu , Mingsong Yan

We prove a few representer theorems for a localised version of the regularised and multiview support vector machine learning problem introduced by H.Q. Minh, L. Bazzani, and V. Murino, Journal of Machine Learning Research, 17(2016) 1-72,…

Functional Analysis · Mathematics 2025-11-04 Aurelian Gheondea , Cankat Tilki

Consider a Machine Learning Service Provider (MLSP) designed to rapidly create highly accurate learners for a never-ending stream of new tasks. The challenge is to produce task-specific learners that can be trained from few labeled samples,…

Machine Learning · Computer Science 2014-07-10 Ouais Alsharif , Philip Bachman , Joelle Pineau