English
Related papers

Related papers: A Concentration Bound for Distributed Stochastic A…

200 papers

Consider a distributed detection problem in which the underlying distributions of the observations are unknown; instead of these distributions, noisy versions of empirically observed statistics are available to the fusion center. These…

Information Theory · Computer Science 2020-02-13 Haiyun He , Lin Zhou , Vincent Y. F. Tan

We consider a distributionally robust second-order stochastic dominance constrained optimization problem. We require the dominance constraints hold with respect to all probability distributions in a Wasserstein ball centered at the…

Optimization and Control · Mathematics 2021-10-20 Yu Mei , Jia Liu , Zhiping Chen

In this note we prove sharp lower error bounds for numerical methods for jump-diffusion stochastic differential equations (SDEs) with discontinuous drift. We study the approximation of jump-diffusion SDEs with non-adaptive as well as…

Numerical Analysis · Mathematics 2023-12-06 Paweł Przybyłowicz , Verena Schwarz , Michaela Szölgyenyi

We introduce a primal-dual stochastic gradient oracle method for distributed convex optimization problems over networks. We show that the proposed method is optimal in terms of communication steps. Additionally, we propose a new analysis…

Optimization and Control · Mathematics 2019-11-28 Darina Dvinskikh , Eduard Gorbunov , Alexander Gasnikov , Pavel Dvurechensky , Cesar A. Uribe

Polyak-Ruppert averaging is a widely used technique to achieve the optimal asymptotic variance of stochastic approximation (SA) algorithms, yet its high-probability performance guarantees remain underexplored in general settings. In this…

Machine Learning · Statistics 2025-05-29 Sajad Khodadadian , Martin Zubeldia

The rigorous linking of exact stochastic models to mean-field approximations is studied. Starting from the differential equation point of view the stochastic model is identified by its Kolmogorov equations, which is a system of linear ODEs…

Dynamical Systems · Mathematics 2011-09-19 András Bátkai , Istvan Z. Kiss , Eszter Sikolya , Péter L. Simon

We consider stochastic variational inequalities with monotone operators defined as the expected value of a random operator. We assume the feasible set is the intersection of a large family of convex sets. We propose a method that combines…

Optimization and Control · Mathematics 2017-03-03 Alfredo Iusem , Alejandro Jofré , Philip Thompson

Score-based diffusion models have emerged as one of the most promising frameworks for deep generative modelling, due to their state-of-the art performance in many generation tasks while relying on mathematical foundations such as stochastic…

Machine Learning · Computer Science 2023-11-28 Teo Deveney , Jan Stanczuk , Lisa Maria Kreusser , Chris Budd , Carola-Bibiane Schönlieb

Denoising diffusions are a powerful method to generate approximate samples from high-dimensional data distributions. Recent results provide polynomial bounds on their convergence rate, assuming $L^2$-accurate scores. Until now, the tightest…

Machine Learning · Statistics 2024-03-07 Joe Benton , Valentin De Bortoli , Arnaud Doucet , George Deligiannidis

This paper deals with the problem of quantifying the impact of model misspecification when computing general expected values of interest. The methodology that we propose is applicable in great generality, in particular, we provide examples…

Probability · Mathematics 2017-07-04 Jose Blanchet , Karthyek R. A. Murthy

A probabilistic approach for estimating sample qualities for stochastic differential equations is introduced in this paper. The aim is to provide a quantitative upper bound of the distance between the invariant probability measure of a…

Numerical Analysis · Mathematics 2019-12-24 Matthew Dobson , Jiayu Zhai , Yao Li

The paper studies asymptotic properties of estimators of multidimensional stochastic differential equations driven by Brownian motions from high-frequency discrete data. Consistency and central limit properties of a class of estimators of…

Statistics Theory · Mathematics 2024-11-07 Arnab Ganguly

In this paper, we propose a new, simplified high probability analysis of AdaGrad for smooth, non-convex problems. More specifically, we focus on a particular accelerated gradient (AGD) template (Lan, 2020), through which we recover the…

Optimization and Control · Mathematics 2022-04-07 Ali Kavis , Kfir Yehuda Levy , Volkan Cevher

We present a hybrid a-priori/a-posteriori goal oriented error estimator for a combination of dynamic iteration-based solution of ordinary differential equations discretized by finite elements. Our novel error estimator combines estimates…

Numerical Analysis · Mathematics 2026-02-13 Erik Weyl , Andreas Bartel , Manuel Schaller

Diffusion or score-based models recently showed high performance in image generation. They rely on a forward and a backward stochastic differential equations (SDE). The sampling of a data distribution is achieved by numerically solving the…

Machine Learning · Computer Science 2025-06-04 Emile Pierret , Bruno Galerne

This paper considers a stochastic approximation algorithm, with decreasing step size and martingale difference noise. Under very mild assumptions, we prove the non convergence of this process toward a certain class of repulsive sets for the…

Probability · Mathematics 2010-01-28 Michel Benaïm , Mathieu Faure

In this work we consider the regularization of a supervised learning problem by partial differential equations (PDEs) and derive error bounds for the obtained approximation in terms of a PDE error term and a data error term. Assuming that…

Numerical Analysis · Mathematics 2020-03-17 Carsten Gräser , Prem Anand Alathur Srinivasan

Recently, it has been shown in [Hairer, M., Hutzenthaler, M., Jentzen, A., Loss of regularity for Kolmogorov equations, Ann. Probab. 43, 2 (2015), 468--527] that there exists a system of stochastic differential equations (SDE) on the time…

Probability · Mathematics 2016-09-27 Larisa Yaroslavtseva

The Stochastic Block Model (Holland et al., 1983) is a mixture model for heterogeneous network data. Unlike the usual statistical framework, new nodes give additional information about the previous ones in this model. Thereby the…

Statistics Theory · Mathematics 2011-11-01 Antoine Channarond , Jean-Jacques Daudin , Stéphane Robin

As an alternative to the well-known methods of "chaining" and "bracketing" that have been developed in the study of random fields, a new method, which is based on a stochastic maximal inequality derived by using It\^o's formula and on a new…

Probability · Mathematics 2016-02-12 Yoichi Nishiyama