Related papers: When is there a Representer Theorem? Reflexive Ban…
In the absence of explicit regularization, Kernel "Ridgeless" Regression with nonlinear kernels has the potential to fit the training data perfectly. It has been observed empirically, however, that such interpolated solutions can still…
Variational source conditions proved useful for deriving convergence rates for Tikhonov's regularization method and also for other methods. Up to now such conditions have been verified only for few examples or for situations which can be…
In this short paper we combine the representability theorem introduced in [17, 18] with the theory of derived formal models introduced in [2] to prove the existence representability of the derived Hilbert space RHilb(X) for a separated…
In this work, we show that neural networks can be represented via the mathematical theory of quiver representations. More specifically, we prove that a neural network is a quiver representation with activation functions, a mathematical…
Linear algebra's main concerns are sets of vectors, linear functions, subspaces, linear systems, matrices and concepts about those, such as whether the solution of linear system exists or is unique; a set of vectors is linearly independent…
Neural network models and deep models are one of the leading and state of the art models in machine learning. Most successful deep neural models are the ones with many layers which highly increases their number of parameters. Training such…
The Barankin bound is generalized to the vector case in the mean square error sense. Necessary and sufficient conditions are obtained to achieve the lower bound. To obtain the result, a simple finite dimensional real vector valued…
In several domains, data objects can be decomposed into sets of simpler objects. It is then natural to represent each object as the set of its components or parts. Many conventional machine learning algorithms are unable to process this…
A representation theorem relates different mathematical structures by providing an isomorphism between them: that is, a one-to-one correspondence preserving their original properties. Establishing that the two structures substantially…
We investigate integral representation of vector-valued function spaces, i.e., of subspaces $H\subset C(K,E)$, where $K$ is a compact space and $E$ is a (real or complex) Banach space. We point out that there are two possible ways of…
Knowledge Representation is important issue in reinforcement learning. In this paper, we bridge the gap between reinforcement learning and knowledge representation, by providing a rich knowledge representation framework, based on normal…
The lack of a $p$-adic Haar measure causes many methods of traditional representation theory to break down when applied to continuous representations of a compact $p$-adic Lie group $G$ in Banach spaces over a given $p$-adic field $K$. For…
This paper investigates a general regularization framework for unsupervised domain adaptation in vector-valued regression under the covariate shift assumption, utilizing vector-valued reproducing kernel Hilbert spaces (vRKHS). Covariate…
In this paper, we establish minimax optimal rates of convergence for prediction in a semi-functional linear model that consists of a functional component and a less smooth nonparametric component. Our results reveal that the smoother…
We present a completely new structure theoretic approach to the dilation theory of linear operators. Our main result is the following theorem: if $X$ is a super-reflexive Banach space and $T$ is contained in the weakly closed convex hull of…
For the solution of operator equations, Stevenson introduced a definition of frames, where a Hilbert space and its dual are {\em not} identified. This means that the Riesz isomorphism is not used as an identification, which, for example,…
Unsupervised and self-supervised learning approaches have become a crucial tool to learn representations for downstream prediction tasks. While these approaches are widely used in practice and achieve impressive empirical gains, their…
In this paper it will be shown that assuming the Continuum Hypothesis (CH) every nonreflexive Banach space ultrapower is isometrically isomorphic to the space of continuous, bounded and real-valued functions on the Parovicenko space. This…
We explore the norm attainment set and the minimum norm attainment set of a bounded linear operator between Hilbert spaces and Banach spaces. Indeed, we obtain a complete characterization of both the sets, separately for operators between…
The inverse problem for representation functions takes as input a triple (X,f,L), where X is a countable semigroup, f : X --> N_0 \cup {\infty} a function, L : a_1 x_1 + ... + a_h x_h an X-linear form and asks for a subset A \subseteq X…