English
Related papers

Related papers: A Concentration Bound for Distributed Stochastic A…

200 papers

We study the problem of list-decodable mean estimation, where an adversary can corrupt a majority of the dataset. Specifically, we are given a set $T$ of $n$ points in $\mathbb{R}^d$ and a parameter $0< \alpha <\frac 1 2$ such that an…

Data Structures and Algorithms · Computer Science 2021-11-15 Ilias Diakonikolas , Daniel M. Kane , Daniel Kongsgaard , Jerry Li , Kevin Tian

This paper is concerned with estimating the intersection point of two densities, given a sample of both of the densities. This problem arises in classification theory. The main results provide lower bounds for the probability of the…

Statistics Theory · Mathematics 2007-12-18 Franz Merkl , Leila Mohammadi

In a Markovian framework, we consider the problem of finding the minimal initial value of a controlled process allowing to reach a stochastic target with a given level of expected loss. This question arises typically in approximate hedging…

Optimization and Control · Mathematics 2017-04-06 Géraldine Bouveret , Jean-François Chassagneux

This paper deals with bounding the error on the estimation of quantities of interest obtained by finite element and domain decomposition methods. The proposed bounds are written in order to separate the two errors involved in the resolution…

Computational Physics · Physics 2015-02-11 Valentine Rey , Pierre Gosselet , Christian Rey

Decentralized stochastic gradient descent (D-SGD) is an efficient method for large-scale distributed learning. Existing generalization studies mainly address expected results, achieving rates limited to $\mathcal{O}\left(\frac{1}{\delta…

Machine Learning · Computer Science 2026-05-12 Jiahuan Wang , Ping Luo , Ziqing Wen , Dongsheng Li , Tao Sun

Diffusion models have shown remarkable success in text-to-image generation, making preference alignment for these models increasingly important. The preference labels are typically available only at the terminal of denoising trajectories,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Dingyuan Shi , Yong Wang , Hangyu Li , Xiangxiang Chu

We develop a new continuous-time stochastic gradient descent method for optimizing over the stationary distribution of stochastic differential equation (SDE) models. The algorithm continuously updates the SDE model's parameters using an…

Machine Learning · Computer Science 2023-08-29 Ziheng Wang , Justin Sirignano

This paper establishes the first almost sure convergence rate and the first maximal concentration bound with exponential tails for general contractive stochastic approximation algorithms with Markovian noise. As a corollary, we also obtain…

Machine Learning · Computer Science 2024-11-22 Xiaochi Qian , Zixuan Xie , Xinyu Liu , Shangtong Zhang

In this work, we describe a generic approach to show convergence with high probability for both stochastic convex and non-convex optimization with sub-Gaussian noise. In previous works for convex optimization, either the convergence is only…

Optimization and Control · Mathematics 2023-03-01 Zijian Liu , Ta Duy Nguyen , Thien Hang Nguyen , Alina Ene , Huy Lê Nguyen

We consider an infinite-dimensional stochastic clustering model on $\mathbb{R}$. In discrete time, each point of a unit-intensity simple point process moves halfway toward either of its left or right neighbors, chosen uniformly at random.…

Probability · Mathematics 2026-03-10 Partha S. Dey , S. Rasoul Etesami , Aditya S. Gopalan

Cr\'epey, Frikha, and Louzi (2025) introduced a nested stochastic approximation algorithm and its multilevel acceleration to compute the value-at-risk and expected shortfall of a random financial loss. We hereby establish central limit…

Risk Management · Quantitative Finance 2026-04-14 Stéphane Crépey , Noufel Frikha , Azar Louzi , Gilles Pagès

The main contributions of this paper are three fold. First, our primary concern is to investigate a class of stochastic recursive delayed control problems which arise naturally with sound backgrounds but have not been well-studied yet. For…

Optimization and Control · Mathematics 2011-12-06 Li Chen , Jianhui Huang

In this paper, we propose a distributed Newton method for consensus optimization. Our approach outperforms state-of-the-art methods, including ADMM. The key idea is to exploit the sparsity of the dual Hessian and recast the computation of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-22 Rasul Tutunov , Haitham Bou Ammar , Ali Jadbabaie

In this paper we study the reachability problem for discrete-time nonlinear stochastic systems. Our goal is to present a unified framework for calculating the probabilistic reachable set of discrete-time systems in the presence of both…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Zishun Liu , Saber Jafarpour , Yongxin Chen

Statistical models can involve implicitly defined quantities, such as solutions to nonlinear ordinary differential equations (ODEs), that unavoidably need to be numerically approximated in order to evaluate the model. The approximation…

Computation · Statistics 2024-09-16 Juho Timonen , Nikolas Siccha , Ben Bales , Harri Lähdesmäki , Aki Vehtari

In this work, we study the stochastic optimal control problem (SOC) mainly from the probabilistic view point, i.e. via the Stochastic Maximum principle (SMP) \cite{Peng4}. We adopt the sample-wise backpropagation scheme proposed in…

Optimization and Control · Mathematics 2025-06-17 Hui Sun , Feng Bao

We generalize the Borkar-Meyn stability Theorem (BMT) to distributed stochastic approximations (SAs) with information delays that possess an arbitrary moment bound. To model the delays, we introduce Age of Information Processes (AoIPs):…

Optimization and Control · Mathematics 2023-05-15 Adrian Redder , Arunselvan Ramaswamy , Holger Karl

Stochastic regularization of neural networks (e.g. dropout) is a wide-spread technique in deep learning that allows for better generalization. Despite its success, continuous-time models, such as neural ordinary differential equation (ODE),…

Machine Learning · Computer Science 2020-06-29 Viktor Oganesyan , Alexandra Volokhova , Dmitry Vetrov

It is common to use a compartmental, fluid model described by a system of ordinary differential equations (ODEs) to model disease spread. In addition to their simplicity, these models are also the mean-field approximations of more accurate…

Probability · Mathematics 2016-04-15 Benjamin Armbruster , Ekkehard Beck

This paper investigates the approximation of stochastic delay differential equations (SDDEs) via the backward Euler-Maruyama (BEM) method under generalized monotonicity and Khasminskii-type conditions in the infinite horizon. First, by…

Numerical Analysis · Mathematics 2025-05-20 Yudong Wang , Hongjiong Tian