Related papers: On a Vectorized Version of a Generalized Richardso…
Let $X$ be a complete variety of dimension $n$ over an algebraically closed field $\mathbf{K}$. Let $V_\bullet$ be a graded linear series associated to a line bundle $L$ on $X$, that is, a collection $\{V_m\}_{m\in\mathbb{N}}$ of vector…
The error function of real argument can be uniformly approximated to a given accuracy by a single closed-form expression for the whole variable range either in terms of addition, multiplication, division, and square root operations only, or…
A fundamental task in kernel methods is to pick nodes and weights, so as to approximate a given function from an RKHS by the weighted sum of kernel translates located at the nodes. This is the crux of kernel density estimation, kernel…
In our previous work \cite{PTA2} we calculated the overlap reduction function for the tensor polarization without employing the short wavelength approximation, this was done by obtaining a power series of nested sums which is valid for all…
Random reshuffling with momentum (RRM) corresponds to the SGD optimizer with momentum option enabled, as found in many machine learning libraries like PyTorch and TensorFlow. Despite its widespread use, the convergence properties of RRM do…
In the present paper, in order to fnd a singularity of a vector field defined on Riemannian manifolds, we present a new globalization strategy of Newton method and establish its global convergence with superlinear rate. In particular, this…
An efficient proximal-gradient-based method, called proximal extrapolated gradient method, is designed for solving monotone variational inequality in Hilbert space. The proposed method extends the acceptable range of parameters to obtain…
We present a new method for performing nonlinear approximation with redundant dictionaries. The method constructs an $m-$term approximation of the signal by thresholding with respect to a weighted version of its canonical expansion…
We describe a post-Minkowskii approximation of general relativity as a power series expansion in G, Newton's gravitational constant. Material sources are hidden behind boundaries, and only the vacuum Einstein equations are considered. An…
We propose a general yet simple theorem describing the convergence of SGD under the arbitrary sampling paradigm. Our theorem describes the convergence of an infinite array of variants of SGD, each of which is associated with a specific…
We use ergodic theoretic tools to solve a classical problem in geometric Ramsey theory. Let E be a measurable subset of R^m, with positive upper density. Let V={0,v_1,...,v_k} be a subset of R^m. We show that for r large enough, we can find…
It is well known that a regular diffusion on an interval $I$ without killing inside is uniquely determined by a canonical scale function $s$ and a canonical speed measure $m$. Note that $s$ is a strictly increasing and continuous function…
We consider the random field M(t)=\sup_{n\geq 1}\big\{-\log A_{n}+X_{n}(t)\big\}\,,\qquad t\in T\, for a set $T\subset \mathbb{R}^{m}$, where $(X_{n})$ is an iid sequence of centered Gaussian random fields on $T$ and $0<A_{1}<A_{2}<\cdots $…
We express the asymptotics of the remainders of the partial sums {s_n} of the generalized hypergeometric function q+1_F_q through an inverse power series z^n n^l \sum_k c_k/n^k, where the exponent l and the asymptotic coefficients {c_k} may…
For integers $n\geq r$, we treat the $r$th largest of a sample of size $n$ as an $\mathbb{R}^\infty$-valued stochastic process in $r$ which we denote $\mathbf{M}^{(r)}$. We show that the sequence regarded in this way satisfies the Markov…
Based on SGD, previous works have proposed many algorithms that have improved convergence speed and generalization in stochastic optimization, such as SGDm, AdaGrad, Adam, etc. However, their convergence analysis under non-convex conditions…
This paper proves almost-sharp asymptotics for small data solutions of the Vlasov-Nordstr\"om system in dimension three. This system consists of a wave equation coupled to a transport equation and describes an ensemble of relativistic,…
We study approximation properties of additive random fields $Y_d$, $d\in\mathbb{N}$, which are sums of zero-mean random processes with the same continuous covariance functions. The average case approximation complexity…
Generalized Linear Models (GLM) form a wide class of regression and classification models, where prediction is a function of a linear combination of the input variables. For statistical inference in high dimension, sparsity inducing…
We analyze the sample complexity of full-batch Gradient Descent (GD) in the setup of non-smooth Stochastic Convex Optimization. We show that the generalization error of GD, with common choice of hyper-parameters, can be $\tilde \Theta(d/m +…