English
Related papers

Related papers: Epi-Consistent Approximation of Stochastic Dynamic…

200 papers

The Expectation Maximisation (EM) algorithm is widely used to optimise non-convex likelihood functions with latent variables. Many authors modified its simple design to fit more specific situations. For instance, the Expectation (E) step…

Statistics Theory · Mathematics 2022-05-03 Thomas Lartigue , Stanley Durrleman , Stéphanie Allassonnière

This paper studies a structured compound stochastic program (SP) involving multiple expectations coupled by nonconvex and nonsmooth functions. We present a successive convex-programming based sampling algorithm and establish its…

Optimization and Control · Mathematics 2021-05-25 Junyi Liu , Ying Cui , Jong-Shi Pang

Asynchronous stochastic approximations (SAs) are an important class of model-free algorithms, tools and techniques that are popular in multi-agent and distributed control scenarios. To counter Bellman's curse of dimensionality, such…

Optimization and Control · Mathematics 2019-05-03 Arunselvan Ramaswamy , Shalabh Bhatnagar , Daniel E. Quevedo

The convergence of expectation-maximization (EM)-based algorithms typically requires continuity of the likelihood function with respect to all the unknown parameters (optimization variables). The requirement is not met when parameters…

Signal Processing · Electrical Eng. & Systems 2024-04-18 Geethu Joseph

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

Optimization and Control · Mathematics 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

Chance-constrained problems involve stochastic components in the constraints which can be violated with a small probability. We investigate the impact of different types of chance constraints on the performance of iterative search…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Saba Sadeghi Ahouei , Jacob de Nobel , Aneta Neumann , Thomas Bäck , Frank Neumann

A solution of two-stage stochastic generalized equations is a pair: a first stage solution which is independent of realization of the random data and a second stage solution which is a function of random variables.This paper studies…

Optimization and Control · Mathematics 2018-01-15 Xiaojun Chen , Alexander Shapiro , Hailin Sun

We revisit the sample average approximation (SAA) approach for non-convex stochastic programming. We show that applying the SAA approach to problems with expected value equality constraints does not necessarily result in asymptotic…

Optimization and Control · Mathematics 2024-07-16 Thomas Lew , Riccardo Bonalli , Marco Pavone

Safe and economic operation of networked systems is often challenging. Optimization-based schemes are frequently considered, since they achieve near-optimality while ensuring safety via the explicit consideration of constraints. In…

Optimization and Control · Mathematics 2024-01-30 Alexander Engelmann , Maisa B. Bandeira , Timm Faulwasser

This paper studies the dynamic programming principle using the measurable selection method for stochastic control of continuous processes. The novelty of this work is to incorporate intermediate expectation constraints on the canonical…

Optimization and Control · Mathematics 2020-04-22 Yuk-Loong Chow , Xiang Yu , Chao Zhou

It is shown that under standard hypotheses, if stochastic approximation iterates remain tight, they converge with probability one to what their o.d.e. limit suggests. A simple test for tightness (and therefore a.s. convergence) is provided.…

Probability · Mathematics 2010-07-28 Sameer Kamal

In this paper we propose a novel semi-definite programming approach that solves reach-avoid problems over open (i.e., not bounded a priori) time horizons for dynamical systems modeled by polynomial stochastic differential equations. The…

Optimization and Control · Mathematics 2023-12-22 Bai Xue , Naijun Zhan , Martin Fränzle

We introduce and study a notion of Asymptotic Preserving schemes, related to convergence in distribution, for a class of slow-fast Stochastic Differential Equations. In some examples, crude schemes fail to capture the correct limiting…

Numerical Analysis · Mathematics 2020-11-05 Charles-Edouard Bréhier , Shmuel Rakotonirina-Ricquebourg

In this paper we study the strong convergence for the Euler-Maruyama approximation of a class of stochastic differential equations whose both drift and diffusion coefficients are possibly discontinuous.

Probability · Mathematics 2016-09-02 Hoang-Long Ngo , Dai Taguchi

We present improved approximation algorithms in stochastic optimization. We prove that the multi-stage stochastic versions of covering integer programs (such as set cover and vertex cover) admit essentially the same approximation algorithms…

Data Structures and Algorithms · Computer Science 2017-12-20 Jaroslaw Byrka , Aravind Srinivasan

We consider the stochastic variational inequality problem in which the map is expectation-valued in a component-wise sense. Much of the available convergence theory and rate statements for stochastic approximation schemes are limited to…

Optimization and Control · Mathematics 2019-11-25 Aswin Kannan , Uday V. Shanbhag

We analyze the tail behavior of solutions to sample average approximations (SAAs) of stochastic programs posed in Hilbert spaces. We require that the integrand be strongly convex with the same convexity parameter for each realization.…

Optimization and Control · Mathematics 2023-08-03 Johannes Milz

The smoothing distribution of dynamic probit models with Gaussian state dynamics was recently proved to belong to the unified skew-normal family. Although this is computationally tractable in small-to-moderate settings, it may become…

Computation · Statistics 2023-09-06 Niccolò Anceschi , Augusto Fasano , Giovanni Rebaudo

For stochastic approximation algorithms with discontinuous dynamics, it is shown that under suitable distributional assumptions, the interpolated iterates track a Fillipov solution of the limiting differential inclusion. In addition, we…

Probability · Mathematics 2023-09-04 Vivek Borkar , Dhruv Shah

This paper proposes an adaptive time-stepping mothods for stochastic diffusion systems whose drift and diffusion coefficients are locally Lipschitz continuous and may exhibit polynomial growth. By controlling the growth of both the drift…

Numerical Analysis · Mathematics 2026-02-09 Xueqi Wen , Guozhen Li , Yuanping Cui , Xiaoyue Li