English
Related papers

Related papers: Discrepancy, chaining and subgaussian processes

200 papers

We consider the problem of calculating learning curves (i.e., average generalization performance) of Gaussian processes used for regression. On the basis of a simple expression for the generalization error, in terms of the eigenvalue…

Disordered Systems and Neural Networks · Physics 2007-05-23 Peter Sollich , Anason Halees

Gaussian Processes (GPs) are a generic modelling tool for supervised learning. While they have been successfully applied on large datasets, their use in safety-critical applications is hindered by the lack of good performance guarantees. To…

Machine Learning · Statistics 2019-08-27 David Reeb , Andreas Doerr , Sebastian Gerwinn , Barbara Rakitsch

There is a result of Diaconis and Freedman which says that, in a limiting sense, for large collections of high-dimensional data most one-dimensional projections of the data are approximately Gaussian. This paper gives quantitative versions…

Probability · Mathematics 2010-05-18 Elizabeth Meckes

Gaussian process regression is widely used because of its ability to provide well-calibrated uncertainty estimates and handle small or sparse datasets. However, it struggles with high-dimensional data. One possible way to scale this…

Machine Learning · Statistics 2024-02-02 Bernardo Fichera , Viacheslav Borovitskiy , Andreas Krause , Aude Billard

A function $f=f_T$ is called least energy approximation to a function $B$ on the interval $[0,T]$ with penalty $Q$ if it solves the variational problem $$ \int_0^T \left[ f'(t)^2 + Q(f(t)-B(t)) \right] dt \searrow \min. $$ For quadratic…

Probability · Mathematics 2019-07-04 Zakhar Kabluchko , Mikhail Lifshits

This work establishes computable bounds between f-divergences for probability measures within a generalized quasi-$\varepsilon_{(M,m)}$-neighborhood framework. We make the following key contributions. (1) a unified characterization of local…

Information Theory · Computer Science 2025-08-12 Xinchun Yu , Shuangqing Wei , Xiao-Ping Zhang

For every $k \in \mathbb{N}$ let $f_k:[\frac{1}{k+1}, \frac{1}{k}] \to [0,1]$ be decreasing, linear functions such that $f_k(\frac{1}{k+1}) = 1$ and $f_k(\frac{1}{k}) = 0$, $k = 1, 2, \dots$. We define iterated function system (IFS) $S_n$…

Dynamical Systems · Mathematics 2024-04-19 Rafał Tryniecki

Consider estimation of the regression function based on a model with equidistant design and measurement errors generated from a fractional Gaussian noise process. In previous literature, this model has been heuristically linked to an…

Statistics Theory · Mathematics 2014-12-02 Johannes Schmidt-Hieber

Let $G$ be a nonempty bounded domain in a finite-dimensional Euclidean space. The main results are general estimates from below at points from $G$ for an arbitrary subharmonic function $u\not\equiv -\infty$ on the closure of the domain $G$…

Complex Variables · Mathematics 2021-10-26 B. N. Khabibullin , E. U. Taipova

Gaussian process modeling is a standard tool for building emulators for computer experiments, which are usually used to study deterministic functions, for example, a solution to a given system of partial differential equations. This work…

Statistics Theory · Mathematics 2021-10-01 Wenjia Wang

Let $X_{1},X_{2},...$ be a sequence of independent copies (s.i.c) of a real random variable (r.v.) $X\geq 1$, with distribution function $df$ $F(x)=\mathbb{P}% (X\leq x)$ and let $X_{1,n}\leq X_{2,n} \leq ... \leq X_{n,n}$ be the order…

Methodology · Statistics 2011-11-22 Gane Samb Lo , El Hadji Deme , Aliou Diop

We prove that every nonnegative continuous real-valued function on a given compact metric space is the uniform limit of some increasing sequence of nonnegative simple functions being linear combinations of indicators of open sets; here the…

General Mathematics · Mathematics 2020-10-21 Yu-Lin Chou

Suppose that i.i.d. random variables $X_{1}, X_{2}, \ldots$ are chosen uniformly from $[0,1]$, and let $f: [0,1] \rightarrow [0,1]$ be an increasing bijection. Define $\mu_{f}$ to be the expected value of $f(X_{i})$ for each $i$. Define the…

Probability · Mathematics 2016-08-23 Jesse Geneson

In this thesis we show that the partial sums of the Maclaurin series for a certain class of entire functions possess scaling limits in various directions in the complex plane. In doing so we obtain information about the zeros of the partial…

Complex Variables · Mathematics 2016-10-12 Antonio R. Vargas

We study estimation and prediction of Gaussian processes with covariance model belonging to the generalized Cauchy (GC) family, under fixed domain asymptotics. Gaussian processes with this kind of covariance function provide separate…

Methodology · Statistics 2019-07-23 Moreno Bevilacqua , Tarik Faouzi

A subequation on an open subset $X\subset \mathbb R^n$ is a subset $F$ of the space of $2$-jets on $X$ with certain properties. A smooth function is said to be $F$-subharmonic if all of its $2$-jets lie in $F$, and using the viscosity…

Analysis of PDEs · Mathematics 2021-05-13 Julius Ross , David Witt Nyström

Suprema of random processes appear naturally in a plethora of disciplines, and Talagrand's majorizing theorem yields a geometric interpretation for them: for a centered Gaussian random process $(X_t)_{t \in T},$ $\mathbb{E}[\sup_{t \in…

Probability · Mathematics 2025-11-04 Simona Diaconu

In this article, we propose two numerical methods, the Gaussian Process (GP) method and the Fourier Features (FF) algorithm, to solve mean field games (MFGs). The GP algorithm approximates the solution of a MFG with maximum a posteriori…

Numerical Analysis · Mathematics 2022-05-10 Chenchen Mou , Xianjin Yang , Chao Zhou

We study two empirical process of special structure: firstly, the centred multiplier process indexed by a class $F$, $f \to \left|\sum_{i=1}^N (\xi_i f(X_i) - \E \xi f)\right|$, where the i.i.d. multipliers $(\xi_i)_{i=1}^N$ need not be…

Probability · Mathematics 2015-10-05 Shahar Mendelson

We generalize and improve the original characterization given by Valadier [20, Theorem 1] of the subdifferential of the pointwise supremum of convex functions, involving the subdifferentials of the data functions at nearby points. We remove…

Optimization and Control · Mathematics 2017-07-13 R. Correa , A. Hantoute , M. A. López