English
Related papers

Related papers: Convergence Analysis of Sample Average Approximati…

200 papers

We investigate statistical properties of the optimal value of the Sample Average Approximation of stochastic programs, continuing the study in Kr\"atschmer (2023). Central Limit Theorem type results are derived for the optimal value. As a…

Optimization and Control · Mathematics 2023-12-12 Volker Krätschmer

This paper has two main goals: (a) establish several statistical properties---consistency, asymptotic distributions, and convergence rates---of stationary solutions and values of a class of coupled nonconvex and nonsmoothempirical risk…

Statistics Theory · Mathematics 2019-10-08 Zhengling Qi , Ying Cui , Yufeng Liu , Jong-Shi Pang

We prove convergence of a single time-scale stochastic subgradient method with subgradient averaging for constrained problems with a nonsmooth and nonconvex objective function having the property of generalized differentiability. As a tool…

Optimization and Control · Mathematics 2019-12-17 Andrzej Ruszczynski

This paper tackles the challenging problem of finding global optimal solutions for two-stage stochastic programs with continuous decision variables and nonconvex recourse functions. We introduce a two-phase approach. The first phase…

Optimization and Control · Mathematics 2024-05-29 Suhan Zhong , Ying Cui , Jiawang Nie

We study statistical properties of the optimal value of the Sample Average Approximation. The focus is on the tail function of the absolute error induced by the Sample Average Approximation, deriving upper estimates of its outcomes…

Probability · Mathematics 2023-12-12 Volker Krätschmer

This paper concerns the analysis of random second order linear differential equations. Usually, solving these equations consists of computing the first statistics of the response process, and that task has been an essential goal in the…

Probability · Mathematics 2020-02-14 Marc Jornet , Julia Calatayud , Olivier P. Le Ma^itre , Juan Carlos Cortés

In this paper, we discuss the problem of minimizing the sum of two convex functions: a smooth function plus a non-smooth function. Further, the smooth part can be expressed by the average of a large number of smooth component functions, and…

Machine Learning · Computer Science 2016-11-17 Luo Luo , Zihao Chen , Zhihua Zhang , Wu-Jun Li

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

Machine Learning · Statistics 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

Two-stage sampling designs are commonly used for household and health surveys. To produce reliable estimators with assorted confidence intervals, some basic statistical properties like consistency and asymptotic normality of the…

Methodology · Statistics 2019-01-07 Guillaume Chauvet , Audrey-Anne Vallée

In order to bring contraction analysis into the very fruitful and topical fields of stochastic and Bayesian systems, we extend here the theory describes in \cite{Lohmiller98} to random differential equations. We propose new definitions of…

Optimization and Control · Mathematics 2013-09-27 Nicolas Tabareau , Jean-Jacques Slotine

This paper concerns the convergence of an iterative scheme for 2D stochastic primitive equations on a bounded domain. The stochastic system is split into two equations: a deterministic 2D primitive equations with random initial value and a…

Probability · Mathematics 2019-07-09 Xuhui Peng , Rangrang Zhang

We consider a popular nonsmooth formulation of the real phase retrieval problem. We show that under standard statistical assumptions, a simple subgradient method converges linearly when initialized within a constant relative distance of an…

Optimization and Control · Mathematics 2018-01-09 Damek Davis , Dmitriy Drusvyatskiy , Courtney Paquette

In many scientific applications, the target probability distribution cannot be evaluated in closed form or sampled from directly. Instead, it can often be decomposed into multiple components, some of which are accessible only through…

Methodology · Statistics 2026-03-10 Roxana Darvishi , David C. Stenning , Ted von Hippel , Owen G. Ward

We consider the problem of minimizing the sum of two convex functions: one is the average of a large number of smooth component functions, and the other is a general convex function that admits a simple proximal mapping. We assume the whole…

Optimization and Control · Mathematics 2014-03-20 Lin Xiao , Tong Zhang

We consider a class of sampling-based decomposition methods to solve risk-averse multistage stochastic convex programs. We prove a formula for the computation of the cuts necessary to build the outer linearizations of the recourse…

Optimization and Control · Mathematics 2016-09-12 Vincent Guigues

An averaging result is proved for stochastic evolution equations with highly oscillating coefficients. This result applies in particular to equations with almost periodic coefficients. The convergence to the solution of the averaged…

Probability · Mathematics 2017-01-03 Mikhail Kamenski , Omar Mellah , Paul Raynaud de Fitte

We study the so-called two-time-scale stochastic approximation, a simulation-based approach for finding the roots of two coupled nonlinear operators. Our focus is to characterize its finite-time performance in a Markov setting, which often…

Optimization and Control · Mathematics 2021-04-06 Thinh T. Doan

A stochastic conjugate gradient method for approximation of a function is proposed. The proposed method avoids computing and storing the covariance matrix in the normal equations for the least squares solution. In addition, the method…

Numerical Analysis · Mathematics 2013-02-11 Hong Jiang , Paul Wilford

The asymptotic solution to the problem of comparing the means of two heteroscedastic populations, based on two random samples from the populations, hinges on the pivot underpinning the construction of the confidence interval and the test…

Statistics Theory · Mathematics 2017-10-30 Rajeshwari Majumdar , Suman Majumdar

We use the notion of stochastic two-scale convergence to solve the problem of stochastic homogenization of the elastic plate in the bending regime.

Analysis of PDEs · Mathematics 2016-12-13 Peter Hornung , Matthaus Pawelczyk , Igor Velcic