Related papers: Discrepancy, chaining and subgaussian processes
We consider the problem of calculating learning curves (i.e., average generalization performance) of Gaussian processes used for regression. On the basis of a simple expression for the generalization error, in terms of the eigenvalue…
Gaussian Processes (GPs) are a generic modelling tool for supervised learning. While they have been successfully applied on large datasets, their use in safety-critical applications is hindered by the lack of good performance guarantees. To…
There is a result of Diaconis and Freedman which says that, in a limiting sense, for large collections of high-dimensional data most one-dimensional projections of the data are approximately Gaussian. This paper gives quantitative versions…
Gaussian process regression is widely used because of its ability to provide well-calibrated uncertainty estimates and handle small or sparse datasets. However, it struggles with high-dimensional data. One possible way to scale this…
A function $f=f_T$ is called least energy approximation to a function $B$ on the interval $[0,T]$ with penalty $Q$ if it solves the variational problem $$ \int_0^T \left[ f'(t)^2 + Q(f(t)-B(t)) \right] dt \searrow \min. $$ For quadratic…
This work establishes computable bounds between f-divergences for probability measures within a generalized quasi-$\varepsilon_{(M,m)}$-neighborhood framework. We make the following key contributions. (1) a unified characterization of local…
For every $k \in \mathbb{N}$ let $f_k:[\frac{1}{k+1}, \frac{1}{k}] \to [0,1]$ be decreasing, linear functions such that $f_k(\frac{1}{k+1}) = 1$ and $f_k(\frac{1}{k}) = 0$, $k = 1, 2, \dots$. We define iterated function system (IFS) $S_n$…
Consider estimation of the regression function based on a model with equidistant design and measurement errors generated from a fractional Gaussian noise process. In previous literature, this model has been heuristically linked to an…
Let $G$ be a nonempty bounded domain in a finite-dimensional Euclidean space. The main results are general estimates from below at points from $G$ for an arbitrary subharmonic function $u\not\equiv -\infty$ on the closure of the domain $G$…
Gaussian process modeling is a standard tool for building emulators for computer experiments, which are usually used to study deterministic functions, for example, a solution to a given system of partial differential equations. This work…
Let $X_{1},X_{2},...$ be a sequence of independent copies (s.i.c) of a real random variable (r.v.) $X\geq 1$, with distribution function $df$ $F(x)=\mathbb{P}% (X\leq x)$ and let $X_{1,n}\leq X_{2,n} \leq ... \leq X_{n,n}$ be the order…
We prove that every nonnegative continuous real-valued function on a given compact metric space is the uniform limit of some increasing sequence of nonnegative simple functions being linear combinations of indicators of open sets; here the…
Suppose that i.i.d. random variables $X_{1}, X_{2}, \ldots$ are chosen uniformly from $[0,1]$, and let $f: [0,1] \rightarrow [0,1]$ be an increasing bijection. Define $\mu_{f}$ to be the expected value of $f(X_{i})$ for each $i$. Define the…
In this thesis we show that the partial sums of the Maclaurin series for a certain class of entire functions possess scaling limits in various directions in the complex plane. In doing so we obtain information about the zeros of the partial…
We study estimation and prediction of Gaussian processes with covariance model belonging to the generalized Cauchy (GC) family, under fixed domain asymptotics. Gaussian processes with this kind of covariance function provide separate…
A subequation on an open subset $X\subset \mathbb R^n$ is a subset $F$ of the space of $2$-jets on $X$ with certain properties. A smooth function is said to be $F$-subharmonic if all of its $2$-jets lie in $F$, and using the viscosity…
Suprema of random processes appear naturally in a plethora of disciplines, and Talagrand's majorizing theorem yields a geometric interpretation for them: for a centered Gaussian random process $(X_t)_{t \in T},$ $\mathbb{E}[\sup_{t \in…
In this article, we propose two numerical methods, the Gaussian Process (GP) method and the Fourier Features (FF) algorithm, to solve mean field games (MFGs). The GP algorithm approximates the solution of a MFG with maximum a posteriori…
We study two empirical process of special structure: firstly, the centred multiplier process indexed by a class $F$, $f \to \left|\sum_{i=1}^N (\xi_i f(X_i) - \E \xi f)\right|$, where the i.i.d. multipliers $(\xi_i)_{i=1}^N$ need not be…
We generalize and improve the original characterization given by Valadier [20, Theorem 1] of the subdifferential of the pointwise supremum of convex functions, involving the subdifferentials of the data functions at nearby points. We remove…