English
Related papers

Related papers: Optimal approximation rate of certain stochastic i…

200 papers

We estimate the Hurst parameter $H \in (0,1)$ of a fractional Brownian motion from discrete noisy data, observed along a high frequency sampling scheme. When the intensity $\tau_n$ of the noise is smaller in order than $n^{-H}$ we establish…

Statistics Theory · Mathematics 2022-05-27 Grégoire Szymanski

For a matrix $T \in M_m(\mathbb{C})$, let $|T| : = \sqrt{T^*T}$. For $A \in M_m(\mathbb{C})$, we show that the matrix sequence $\big\{ |A^n|^{\frac{1}{n}} \big\}_{n \in \mathbb{N}}$ converges in norm to a positive-semidefinite matrix $H$…

Functional Analysis · Mathematics 2023-11-13 Soumyashant Nayak

Suppose that $\{a_j\}\in \ell^1$, and suppose that for any sequence $(t_n)$ of integers there exits a constant $C_1>0$ such that $$\sharp\left\{k\in\mathbb{Z}:\sup_{n\geq 1}\left|\sum_{i\in \mathcal{B}_n-t_n}…

Classical Analysis and ODEs · Mathematics 2022-08-04 Sakin Demir

As the default optimizer for training large language models, AdamW has achieved remarkable success in deep learning. However, its convergence behavior is not theoretically well-understood. This paper establishes the convergence rate…

Machine Learning · Computer Science 2025-10-06 Huan Li , Yiming Dong , Zhouchen Lin

Stochastic alternating algorithms for bi-objective optimization are considered when optimizing two conflicting functions for which optimization steps have to be applied separately for each function. Such algorithms consist of applying a…

Optimization and Control · Mathematics 2023-01-09 Suyun Liu , Luis Nunes Vicente

Stochastic approximation (SA) is a classical approach for stochastic convex optimization. Previous studies have demonstrated that the convergence rate of SA can be improved by introducing either smoothness or strong convexity condition. In…

Machine Learning · Computer Science 2019-01-29 Lijun Zhang , Zhi-Hua Zhou

We study approximate stochastic It\^o integration of processes belonging to a class of progressively measurable stochastic processes that are H\"older continuous in the $r$th mean. Inspired by increasingly popularity of computations with…

Numerical Analysis · Mathematics 2020-10-06 Andrzej Kałuża , Paweł M. Morkisz , Paweł Przybyłowicz

Let $f(n)$ be a Steinhaus random multiplicative function. Let $A\subset [1, N]$ be a finite set of integers. We show that \[\frac{1}{\sqrt{|A|}} \sum_{n\in A} f(n) \xrightarrow[]{d} \mathcal{CN}(0,1)\] forces that $|A|=o(N)$. We prove that…

Number Theory · Mathematics 2026-05-26 Max Wenqiang Xu

We consider the rate of piecewise constant approximation to a locally stationary process $X(t),t\in [0,1]$, having a variable smoothness index $\alpha(t)$. Assuming that $\alpha(\cdot)$ attains its unique minimum at zero and satisfies the…

Probability · Mathematics 2015-11-19 Enkelejd Hashorva , Mikhail Lifshits , Oleg Seleznjev

We study the convergence of the density of states and thermodynamic properties in three flat-histogram simulation methods, the Wang-Landau (WL) algorithm, the 1/t algorithm, and tomographic sampling (TS). In the first case the refinement…

We propose an optimal approximation formula for analytic functions that are defined on a complex region containing the real interval $(-1,1)$ and possibly have algebraic singularities at the endpoints of the interval. As a space of such…

Numerical Analysis · Mathematics 2018-08-31 Ken'ichiro Tanaka , Tomoaki Okayama , Masaaki Sugihara

Almost sure convergence rates for linear algorithms $h_{k+1} = h_k +\frac{1}{k^\chi} (b_k-A_kh_k)$ are studied, where $\chi\in(0,1)$, $\{A_{k}\}_{k=1}^\infty$ are symmetric, positive semidefinite random matrices and $\{b_{k}\}_{k=1}^\infty$…

Statistics Theory · Mathematics 2015-01-13 Michael A. Kouritzin , Samira Sadeghi

We study the $L_2$-approximation of functions from a Hilbert space and compare the sampling numbers with the approximation numbers. The sampling number $e_n$ is the minimal worst case error that can be achieved with $n$ function values,…

Numerical Analysis · Mathematics 2024-10-15 David Krieg , Mario Ullrich

Let $X_1, \ldots , X_n$ be i.i.d. random vectors in $\mathbb{R}^d$ with $\|X_1\| \le \beta$. Then, we show that $\frac{1}{\sqrt{n}}(X_1 + \ldots + X_n)$ converges to a Gaussian in quadratic transportation (also known as "Kantorovich" or…

Probability · Mathematics 2017-07-25 Alex Zhai

We prove that $\alpha$-dissipative solutions to the Cauchy problem of the Hunter-Saxton equation, where $\alpha \in W^{1, \infty}(\mathbb{R}, [0, 1))$, can be computed numerically with order $\mathcal{O}(\Delta x^{{1}/{8}}+\Delta…

Numerical Analysis · Mathematics 2025-10-16 Thomas Christiansen , Katrin Grunert

Fix an integer $h \geq 2$, and let $b_1, \ldots, b_h$ be (not necessarily distinct) positive integers with $\gcd(b_1, \ldots, b_h) = 1$. For any subset $A \subseteq \mathbb{N}$, let $r_A(n)$ denote the number of solutions $(k_1, \ldots,…

Number Theory · Mathematics 2026-05-06 Christian Táfula

We here adapt an extended version of the adaptive cubic regularisation method with dynamic inexact Hessian information for nonconvex optimisation in [3] to the stochastic optimisation setting. While exact function evaluations are still…

Numerical Analysis · Mathematics 2020-09-15 Stefania Bellavia , Gianmarco Gurioli

It is well known that the optimal convergence rate for stochastic optimization of smooth functions is $O(1/\sqrt{T})$, which is same as stochastic optimization of Lipschitz continuous convex functions. This is in contrast to optimizing…

Machine Learning · Computer Science 2013-07-30 Mehrdad Mahdavi , Rong Jin

We consider equidistant approximations of stochastic integrals driven by H\"older continuous Gaussian processes of order $H>\frac12$ with discontinuous integrands involving bounded variation functions. We give exact rate of convergence in…

Probability · Mathematics 2022-09-15 Ehsan Azmoodeh , Pauliina Ilmonen , Nourhan Shafik , Tommi Sottinen , Lauri Viitasaari

A function $f\colon\{0,1\}^n\to \{0,1\}$ is called an approximate AND-homomorphism if choosing ${\bf x},{\bf y}\in\{0,1\}^n$ randomly, we have that $f({\bf x}\land {\bf y}) = f({\bf x})\land f({\bf y})$ with probability at least…

Discrete Mathematics · Computer Science 2019-11-04 Yuval Filmus , Noam Lifshitz , Dor Minzer , Elchanan Mossel