English
Related papers

Related papers: Strong Gaussian approximation for cumulative proce…

200 papers

Recent studies have provided both empirical and theoretical evidence illustrating that heavy tails can emerge in stochastic gradient descent (SGD) in various scenarios. Such heavy tails potentially result in iterates with diverging…

Optimization and Control · Mathematics 2021-02-23 Hongjian Wang , Mert Gürbüzbalaban , Lingjiong Zhu , Umut Şimşekli , Murat A. Erdogdu

In this article we establish exponential moment bounds, moment bounds in fractional order smoothness spaces, a uniform H\"older continuity in time, and strong convergence rates for a class of fully discrete exponential Euler-type numerical…

Probability · Mathematics 2021-11-02 Arnulf Jentzen , Felix Lindner , Primož Pušnik

A method to reconstruct fields, source strengths and physical parameters based on Gaussian process regression is presented for the case where data are known to fulfill a given linear differential equation with localized sources. The…

Data Analysis, Statistics and Probability · Physics 2019-09-10 Christopher G. Albert

Constant-specified and exponential concentration inequalities play an essential role in the finite-sample theory of machine learning and high-dimensional statistics area. We obtain sharper and constants-specified concentration inequalities…

Statistics Theory · Mathematics 2022-07-04 Huiming Zhang , Haoyu Wei

A perturbative approach is used to derive approximations of arbitrary order to estimate high percentiles of sums of positive independent random variables that exhibit heavy tails. Closed-form expressions for the successive approximations…

Applications · Statistics 2015-03-20 Lorenzo Hernández , Jorge Tejero , Alberto Suárez , Santiago Carrillo-Menéndez

We introduce an alternative to the notion of `fast rate' in Learning Theory, which coincides with the optimal error rate when the given class happens to be convex and regular in some sense. While it is well known that such a rate cannot…

Statistics Theory · Mathematics 2015-02-26 Shahar Mendelson

In this paper, we show an approximation in law, in the space of the continuous functions on $[0,1]^2$, of two-parameter Gaussian processes that can be represented as a Wiener type integral by processes constructed from processes that…

Probability · Mathematics 2020-02-18 Xavier Bardina , Carles Rovira

We establish strong invariance principles for sums of stationary and ergodic processes with nearly optimal bounds. Applications to linear and some nonlinear processes are discussed. Strong laws of large numbers and laws of the iterated…

Probability · Mathematics 2011-11-10 Wei Biao Wu

We consider the energy saving approximation of a Wiener process under unilateral constraints. We show that, almost surely, on large time intervals the minimal energy necessary for the approximation logarithmically depends on the interval's…

Probability · Mathematics 2023-06-26 M. A. Lifshits , S. E. Nikitin

We provide posterior contraction rates for constrained deep Gaussian processes in non-parametric density estimation and classication. The constraints are in the form of bounds on the values and on the derivatives of the Gaussian processes…

Statistics Theory · Mathematics 2021-12-15 François Bachoc , Agnès Lagnoux

We consider Bayesian inference problems with computationally intensive likelihood functions. We propose a Gaussian process (GP) based method to approximate the joint distribution of the unknown parameters and the data. In particular, we…

Computation · Statistics 2018-03-15 Hongqiao Wang , Jinglai Li

Large-scale Gaussian process inference has long faced practical challenges due to time and space complexity that is superlinear in dataset size. While sparse variational Gaussian process models are capable of learning from large-scale data,…

Machine Learning · Statistics 2018-01-23 Ching-An Cheng , Byron Boots

Gaussian processes are a powerful class of non-linear models, but have limited applicability for larger datasets due to their high computational complexity. In such cases, approximate methods are required, for example, the recently…

Methodology · Statistics 2026-03-24 Soham Mukherjee , Manfred Claassen , Paul-Christian Bürkner

The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…

Probability · Mathematics 2025-02-05 Henrik Hult , Adam Lindhe , Pierre Nyquist , Guo-Jhen Wu

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

Statistics Theory · Mathematics 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

The paper deals with the fast-slow motions setups in the continuous time $\frac {dX^\ve(t)}{dt}=\frac 1\ve\sig(X^\ve(t))\xi(t/\ve^2)+b(X^\ve(t)),\, t\in [0,T]$ and the discrete time…

Probability · Mathematics 2024-05-14 Peter Friz , Yuri Kifer

We propose a novel group of Gaussian Process based algorithms for fast approximate optimal stopping of time series with specific applications to financial markets. We show that structural properties commonly exhibited by financial time…

Machine Learning · Statistics 2022-10-11 Kshama Dwarakanath , Danial Dervovic , Peyman Tavallali , Svitlana S Vyetrenko , Tucker Balch

Inspired by recent advances in singular SPDE theory, we use the Poincar\'e inequality on Wiener space to show that controlled complementary Young regularity is sufficient to obtain Gaussian rough paths lifts. This allows us to completely…

Probability · Mathematics 2024-12-09 Paul Gassiat , Tom Klose

Several strategies have been developed recently to ensure valid inference after model selection; some of these are easy to compute, while others fare better in terms of inferential power. In this paper, we consider a selective inference…

Methodology · Statistics 2022-07-13 Snigdha Panigrahi , Jonathan Taylor

We consider a utility maximization problem in a broad class of markets. Apart from traditional semimartingale markets, our class of markets includes processes with long memory, fractional Brownian motion and related processes, and, in…

Probability · Mathematics 2015-12-31 Elena Boguslavskaya , Yuliya Mishura