中文
相关论文

相关论文: A Concentration Bound for Distributed Stochastic A…

200 篇论文

Consider a distributed detection problem in which the underlying distributions of the observations are unknown; instead of these distributions, noisy versions of empirically observed statistics are available to the fusion center. These…

信息论 · 计算机科学 2020-02-13 Haiyun He , Lin Zhou , Vincent Y. F. Tan

We consider a distributionally robust second-order stochastic dominance constrained optimization problem. We require the dominance constraints hold with respect to all probability distributions in a Wasserstein ball centered at the…

最优化与控制 · 数学 2021-10-20 Yu Mei , Jia Liu , Zhiping Chen

In this note we prove sharp lower error bounds for numerical methods for jump-diffusion stochastic differential equations (SDEs) with discontinuous drift. We study the approximation of jump-diffusion SDEs with non-adaptive as well as…

数值分析 · 数学 2023-12-06 Paweł Przybyłowicz , Verena Schwarz , Michaela Szölgyenyi

We introduce a primal-dual stochastic gradient oracle method for distributed convex optimization problems over networks. We show that the proposed method is optimal in terms of communication steps. Additionally, we propose a new analysis…

最优化与控制 · 数学 2019-11-28 Darina Dvinskikh , Eduard Gorbunov , Alexander Gasnikov , Pavel Dvurechensky , Cesar A. Uribe

Polyak-Ruppert averaging is a widely used technique to achieve the optimal asymptotic variance of stochastic approximation (SA) algorithms, yet its high-probability performance guarantees remain underexplored in general settings. In this…

机器学习 · 统计学 2025-05-29 Sajad Khodadadian , Martin Zubeldia

The rigorous linking of exact stochastic models to mean-field approximations is studied. Starting from the differential equation point of view the stochastic model is identified by its Kolmogorov equations, which is a system of linear ODEs…

动力系统 · 数学 2011-09-19 András Bátkai , Istvan Z. Kiss , Eszter Sikolya , Péter L. Simon

We consider stochastic variational inequalities with monotone operators defined as the expected value of a random operator. We assume the feasible set is the intersection of a large family of convex sets. We propose a method that combines…

最优化与控制 · 数学 2017-03-03 Alfredo Iusem , Alejandro Jofré , Philip Thompson

Score-based diffusion models have emerged as one of the most promising frameworks for deep generative modelling, due to their state-of-the art performance in many generation tasks while relying on mathematical foundations such as stochastic…

机器学习 · 计算机科学 2023-11-28 Teo Deveney , Jan Stanczuk , Lisa Maria Kreusser , Chris Budd , Carola-Bibiane Schönlieb

Denoising diffusions are a powerful method to generate approximate samples from high-dimensional data distributions. Recent results provide polynomial bounds on their convergence rate, assuming $L^2$-accurate scores. Until now, the tightest…

机器学习 · 统计学 2024-03-07 Joe Benton , Valentin De Bortoli , Arnaud Doucet , George Deligiannidis

This paper deals with the problem of quantifying the impact of model misspecification when computing general expected values of interest. The methodology that we propose is applicable in great generality, in particular, we provide examples…

概率论 · 数学 2017-07-04 Jose Blanchet , Karthyek R. A. Murthy

A probabilistic approach for estimating sample qualities for stochastic differential equations is introduced in this paper. The aim is to provide a quantitative upper bound of the distance between the invariant probability measure of a…

数值分析 · 数学 2019-12-24 Matthew Dobson , Jiayu Zhai , Yao Li

The paper studies asymptotic properties of estimators of multidimensional stochastic differential equations driven by Brownian motions from high-frequency discrete data. Consistency and central limit properties of a class of estimators of…

统计理论 · 数学 2024-11-07 Arnab Ganguly

In this paper, we propose a new, simplified high probability analysis of AdaGrad for smooth, non-convex problems. More specifically, we focus on a particular accelerated gradient (AGD) template (Lan, 2020), through which we recover the…

最优化与控制 · 数学 2022-04-07 Ali Kavis , Kfir Yehuda Levy , Volkan Cevher

We present a hybrid a-priori/a-posteriori goal oriented error estimator for a combination of dynamic iteration-based solution of ordinary differential equations discretized by finite elements. Our novel error estimator combines estimates…

数值分析 · 数学 2026-02-13 Erik Weyl , Andreas Bartel , Manuel Schaller

Diffusion or score-based models recently showed high performance in image generation. They rely on a forward and a backward stochastic differential equations (SDE). The sampling of a data distribution is achieved by numerically solving the…

机器学习 · 计算机科学 2025-06-04 Emile Pierret , Bruno Galerne

This paper considers a stochastic approximation algorithm, with decreasing step size and martingale difference noise. Under very mild assumptions, we prove the non convergence of this process toward a certain class of repulsive sets for the…

概率论 · 数学 2010-01-28 Michel Benaïm , Mathieu Faure

In this work we consider the regularization of a supervised learning problem by partial differential equations (PDEs) and derive error bounds for the obtained approximation in terms of a PDE error term and a data error term. Assuming that…

数值分析 · 数学 2020-03-17 Carsten Gräser , Prem Anand Alathur Srinivasan

Recently, it has been shown in [Hairer, M., Hutzenthaler, M., Jentzen, A., Loss of regularity for Kolmogorov equations, Ann. Probab. 43, 2 (2015), 468--527] that there exists a system of stochastic differential equations (SDE) on the time…

概率论 · 数学 2016-09-27 Larisa Yaroslavtseva

The Stochastic Block Model (Holland et al., 1983) is a mixture model for heterogeneous network data. Unlike the usual statistical framework, new nodes give additional information about the previous ones in this model. Thereby the…

统计理论 · 数学 2011-11-01 Antoine Channarond , Jean-Jacques Daudin , Stéphane Robin

As an alternative to the well-known methods of "chaining" and "bracketing" that have been developed in the study of random fields, a new method, which is based on a stochastic maximal inequality derived by using It\^o's formula and on a new…

概率论 · 数学 2016-02-12 Yoichi Nishiyama