English
Related papers

Related papers: Large deviations and concentration inequalities fo…

200 papers

We present new algorithms for optimizing non-smooth, non-convex stochastic objectives based on a novel analysis technique. This improves the current best-known complexity for finding a $(\delta,\epsilon)$-stationary point from…

Machine Learning · Computer Science 2025-08-08 Ashok Cutkosky , Harsh Mehta , Francesco Orabona

We consider the Graph Ornstein-Uhlenbeck (GrOU) process observed on a non-uniform discrete time grid and introduce discretised maximum likelihood estimators with parameters specific to the whole graph or specific to each component, or node.…

Methodology · Statistics 2022-07-12 Valentin Courgeau , Almut E. D. Veraart

Discrete time analogues of ergodic stochastic differential equations (SDEs) are one of the most popular and flexible tools for sampling high-dimensional probability measures. Non-asymptotic analysis in the $L^2$ Wasserstein distance of…

Probability · Mathematics 2019-10-11 Mateusz B. Majka , Aleksandar Mijatović , Lukasz Szpruch

We study the complexity of producing $(\delta,\epsilon)$-stationary points of Lipschitz objectives which are possibly neither smooth nor convex, using only noisy function evaluations. Recent works proposed several stochastic zero-order…

Optimization and Control · Mathematics 2024-04-16 Guy Kornowski , Ohad Shamir

The goal of this paper is to construct ergodic estimators for the parameters in the double exponential Ornstein-Uhlenbeck process, observed at discrete time instants with time step size h. The existence and uniqueness, the strong…

Statistics Theory · Mathematics 2021-11-19 Yaozhong Hu , Neha Sharma

Let (X_n,Y_n) be i.i.d. random vectors. Let W(x) be the partial sum of Y_n just before that of X_n exceeds x>0. Motivated by stochastic models for neural activity, uniform convergence of the form $\sup_{c\in I}|a(c,x)\operatorname…

Probability · Mathematics 2009-09-29 Zhiyi Chi

We study the problem of parameter estimation using maximum likelihood for fast/slow systems of stochastic differential equations. Our aim is to shed light on the problem of model/data mismatch at small scales. We consider two classes of…

Statistics Theory · Mathematics 2008-06-20 A. Papavasiliou , G. A. Pavliotis , A. M. Stuart

This article develops the viscosity solution approach to the large deviation principle for the following two- and three-dimensional stochastic convective Brinkman-Forchheimer equations on the torus $\mathbb{T}^d,\ d\in\{2,3\}$ with small…

Probability · Mathematics 2025-10-02 Sagar Gautam , Manil T. Mohan

An integro-differential equation for the probability density of the generalized stochastic Ornstein-Uhlenbeck process with jump diffusion is considered. It is shown that for a certain ratio between the intensity of jumps and the speed of…

Mathematical Physics · Physics 2024-04-15 Olga S. Rozanova , Nikolai A. Krutov

Denoising diffusion probabilistic models (DDPMs) represent a recent advance in generative modelling that has delivered state-of-the-art results across many domains of applications. Despite their success, a rigorous theoretical understanding…

Statistics Theory · Mathematics 2025-08-21 Miha Brešar , Aleksandar Mijatović

Lognormality was found experimentally for coarse-grained squared turbulence velocity and velocity increment when the coarsening scale is comparable to the correlation scale of the velocity (Mouri et al. Phys. Fluids 21, 065107, 2009). We…

Chaotic Dynamics · Physics 2013-01-29 Takeshi Matsumoto , Masanori Takaoka

In this paper we propose a framework that enables the study of large deviations for point processes based on stationary sequences with regularly varying tails. This framework allows us to keep track not of the magnitude of the extreme…

Probability · Mathematics 2009-08-21 Henrik Hult , Gennady Samorodnitsky

We study the problem of estimating a sequence of evolving probability distributions from historical data, where the underlying distribution changes over time in a nonstationary and nonparametric manner. To capture gradual changes, we…

Optimization and Control · Mathematics 2025-12-16 Edward J. Anderson , Dominic S. T. Keehan

In this article we establish a large deviation principle for the family {\nu_{\epsilon}:\epsilon \in (0,1)} of distributions of the scaled stochastic processes {P_{-\log\sqrt{\epsilon}}Z_t}_{t\leq 1}, where (Z_t)_{t\in \lbrack 0,1]} is a…

Probability · Mathematics 2009-04-06 Z. Qian , C. Xu

The maximum likelihood approach is adapted to the problem of estimation of drift and diffusion functions of stochastic processes from measured time series. We reconcile a previously devised iterative procedure [Kleinhans et al., Physics…

Data Analysis, Statistics and Probability · Physics 2009-11-13 D. Kleinhans , R. Friedrich

We prove optimal convergence results of a stochastic particle method for computing the classical solution of a multivariate McKean-Vlasov equation, when the measure variable is in the drift, following the classical approach of [BT97,…

Probability · Mathematics 2025-11-05 Marc Hoffmann , Yating Liu

It is considered Ornstein-Uhlenbeck process $ x_t = x_0 e^{-\theta t} + \mu (1-e^{-\theta t}) + \sigma \int_0^t e^{-\theta (t-s)} dW_s$, where $x_0 \in R$, $\theta>0$, $ \mu \in R$ and $\sigma > 0$ are parameters. By use values $(z_k)_{k…

Statistics Theory · Mathematics 2016-08-30 Levan Labadze , Gogi Pantsulaia

The (global) Lipschitz smoothness condition is crucial in establishing the convergence theory for most optimization methods. Unfortunately, most machine learning and signal processing problems are not Lipschitz smooth. This motivates us to…

Optimization and Control · Mathematics 2019-04-23 Qiuwei Li , Zhihui Zhu , Gongguo Tang , Michael B. Wakin

We investigate the sharp large deviation properties of the energy and the maximum likelihood estimator for the Ornstein-Uhlenbeck process driven by a fractional Brownian motion with Hurst index greater than one half.

Probability · Mathematics 2008-12-19 Bernard Bercu , Laure Coutin , Nicolas Savy

This paper considers the problem for finding the $(\delta,\epsilon)$-Goldstein stationary point of Lipschitz continuous objective, which is a rich function class to cover a great number of important applications. We construct a zeroth-order…

Quantum Physics · Physics 2024-10-22 Chengchang Liu , Chaowen Guan , Jianhao He , John C. S. Lui
‹ Prev 1 3 4 5 6 7 10 Next ›