中文
相关论文

相关论文: A Concentration Bound for Distributed Stochastic A…

200 篇论文

We study the problem of list-decodable mean estimation, where an adversary can corrupt a majority of the dataset. Specifically, we are given a set $T$ of $n$ points in $\mathbb{R}^d$ and a parameter $0< \alpha <\frac 1 2$ such that an…

数据结构与算法 · 计算机科学 2021-11-15 Ilias Diakonikolas , Daniel M. Kane , Daniel Kongsgaard , Jerry Li , Kevin Tian

This paper is concerned with estimating the intersection point of two densities, given a sample of both of the densities. This problem arises in classification theory. The main results provide lower bounds for the probability of the…

统计理论 · 数学 2007-12-18 Franz Merkl , Leila Mohammadi

In a Markovian framework, we consider the problem of finding the minimal initial value of a controlled process allowing to reach a stochastic target with a given level of expected loss. This question arises typically in approximate hedging…

最优化与控制 · 数学 2017-04-06 Géraldine Bouveret , Jean-François Chassagneux

This paper deals with bounding the error on the estimation of quantities of interest obtained by finite element and domain decomposition methods. The proposed bounds are written in order to separate the two errors involved in the resolution…

计算物理 · 物理学 2015-02-11 Valentine Rey , Pierre Gosselet , Christian Rey

Decentralized stochastic gradient descent (D-SGD) is an efficient method for large-scale distributed learning. Existing generalization studies mainly address expected results, achieving rates limited to $\mathcal{O}\left(\frac{1}{\delta…

机器学习 · 计算机科学 2026-05-12 Jiahuan Wang , Ping Luo , Ziqing Wen , Dongsheng Li , Tao Sun

Diffusion models have shown remarkable success in text-to-image generation, making preference alignment for these models increasingly important. The preference labels are typically available only at the terminal of denoising trajectories,…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Dingyuan Shi , Yong Wang , Hangyu Li , Xiangxiang Chu

We develop a new continuous-time stochastic gradient descent method for optimizing over the stationary distribution of stochastic differential equation (SDE) models. The algorithm continuously updates the SDE model's parameters using an…

机器学习 · 计算机科学 2023-08-29 Ziheng Wang , Justin Sirignano

This paper establishes the first almost sure convergence rate and the first maximal concentration bound with exponential tails for general contractive stochastic approximation algorithms with Markovian noise. As a corollary, we also obtain…

机器学习 · 计算机科学 2024-11-22 Xiaochi Qian , Zixuan Xie , Xinyu Liu , Shangtong Zhang

In this work, we describe a generic approach to show convergence with high probability for both stochastic convex and non-convex optimization with sub-Gaussian noise. In previous works for convex optimization, either the convergence is only…

最优化与控制 · 数学 2023-03-01 Zijian Liu , Ta Duy Nguyen , Thien Hang Nguyen , Alina Ene , Huy Lê Nguyen

We consider an infinite-dimensional stochastic clustering model on $\mathbb{R}$. In discrete time, each point of a unit-intensity simple point process moves halfway toward either of its left or right neighbors, chosen uniformly at random.…

概率论 · 数学 2026-03-10 Partha S. Dey , S. Rasoul Etesami , Aditya S. Gopalan

Cr\'epey, Frikha, and Louzi (2025) introduced a nested stochastic approximation algorithm and its multilevel acceleration to compute the value-at-risk and expected shortfall of a random financial loss. We hereby establish central limit…

风险管理 · 定量金融 2026-04-14 Stéphane Crépey , Noufel Frikha , Azar Louzi , Gilles Pagès

The main contributions of this paper are three fold. First, our primary concern is to investigate a class of stochastic recursive delayed control problems which arise naturally with sound backgrounds but have not been well-studied yet. For…

最优化与控制 · 数学 2011-12-06 Li Chen , Jianhui Huang

In this paper, we propose a distributed Newton method for consensus optimization. Our approach outperforms state-of-the-art methods, including ADMM. The key idea is to exploit the sparsity of the dual Hessian and recast the computation of…

分布式、并行与集群计算 · 计算机科学 2016-06-22 Rasul Tutunov , Haitham Bou Ammar , Ali Jadbabaie

In this paper we study the reachability problem for discrete-time nonlinear stochastic systems. Our goal is to present a unified framework for calculating the probabilistic reachable set of discrete-time systems in the presence of both…

系统与控制 · 电气工程与系统科学 2024-09-17 Zishun Liu , Saber Jafarpour , Yongxin Chen

Statistical models can involve implicitly defined quantities, such as solutions to nonlinear ordinary differential equations (ODEs), that unavoidably need to be numerically approximated in order to evaluate the model. The approximation…

统计计算 · 统计学 2024-09-16 Juho Timonen , Nikolas Siccha , Ben Bales , Harri Lähdesmäki , Aki Vehtari

In this work, we study the stochastic optimal control problem (SOC) mainly from the probabilistic view point, i.e. via the Stochastic Maximum principle (SMP) \cite{Peng4}. We adopt the sample-wise backpropagation scheme proposed in…

最优化与控制 · 数学 2025-06-17 Hui Sun , Feng Bao

We generalize the Borkar-Meyn stability Theorem (BMT) to distributed stochastic approximations (SAs) with information delays that possess an arbitrary moment bound. To model the delays, we introduce Age of Information Processes (AoIPs):…

最优化与控制 · 数学 2023-05-15 Adrian Redder , Arunselvan Ramaswamy , Holger Karl

Stochastic regularization of neural networks (e.g. dropout) is a wide-spread technique in deep learning that allows for better generalization. Despite its success, continuous-time models, such as neural ordinary differential equation (ODE),…

机器学习 · 计算机科学 2020-06-29 Viktor Oganesyan , Alexandra Volokhova , Dmitry Vetrov

It is common to use a compartmental, fluid model described by a system of ordinary differential equations (ODEs) to model disease spread. In addition to their simplicity, these models are also the mean-field approximations of more accurate…

概率论 · 数学 2016-04-15 Benjamin Armbruster , Ekkehard Beck

This paper investigates the approximation of stochastic delay differential equations (SDDEs) via the backward Euler-Maruyama (BEM) method under generalized monotonicity and Khasminskii-type conditions in the infinite horizon. First, by…

数值分析 · 数学 2025-05-20 Yudong Wang , Hongjiong Tian