English
Related papers

Related papers: Consistency of sample-based stationary points for …

200 papers

Alternative iterative methods for a nonexpansive mapping in a Banach space are proposed and proved to be convergent to a common solution to a fixed point problem and a variational inequality. We give rates of asymptotic regularity for such…

Functional Analysis · Mathematics 2009-06-01 Vittorio Colao , Laurentiu Leustean , Genaro Lopez , Victoria Martin-Marquez

This paper presents an extension of stochastic gradient descent for the minimization of Lipschitz continuous loss functions. Our motivation is for use in non-smooth non-convex stochastic optimization problems, which are frequently…

Optimization and Control · Mathematics 2022-10-05 Michael R. Metel , Akiko Takeda

We consider the computation of an equilibrium of a stochastic Nash equilibrium problem, where the player objectives are assumed to be $L_0$-Lipschitz continuous and convex given rival decisions with convex and closed player-specific…

Optimization and Control · Mathematics 2025-10-29 Luke Marrinan , Farzad Yousefian , Uday V. Shanbhag

Models incorporating uncertain inputs, such as random forces or material parameters, have been of increasing interest in PDE-constrained optimization. In this paper, we focus on the efficient numerical minimization of a convex and smooth…

Optimization and Control · Mathematics 2021-06-18 Caroline Geiersbach , Winnifried Wollner

Sparse learning is a very important tool for mining useful information and patterns from high dimensional data. Non-convex non-smooth regularized learning problems play essential roles in sparse learning, and have drawn extensive attentions…

Machine Learning · Computer Science 2020-10-22 Guannan Liang , Qianqian Tong , Jiahao Ding , Miao Pan , Jinbo Bi

This paper considers data-driven chance-constrained stochastic optimization problems in a Bayesian framework. Bayesian posteriors afford a principled mechanism to incorporate data and prior knowledge into stochastic optimization problems.…

Statistics Theory · Mathematics 2023-08-07 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

Stochastic gradient methods have been a popular and powerful choice of optimization methods, aimed at minimizing functions. Their advantage lies in the fact that that one approximates the gradient as opposed to using the full Jacobian…

Numerical Analysis · Mathematics 2025-09-26 Neil K. Chada , Philip J. Herbert

We propose a method for the approximation of solutions of PDEs with stochastic coefficients based on the direct, i.e., non-adapted, sampling of solutions. This sampling can be done by using any legacy code for the deterministic problem as a…

Numerical Analysis · Mathematics 2015-05-19 Alireza Doostan , Houman Owhadi

We study statistical inference and distributionally robust solution methods for stochastic optimization problems, focusing on confidence intervals for optimal values and solutions that achieve exact coverage asymptotically. We develop a…

Machine Learning · Statistics 2018-07-03 John Duchi , Peter Glynn , Hongseok Namkoong

Numerical approximation of the long time behavior of a stochastic differential equation (SDE) is considered. Error estimates for time-averaging estimators are obtained and then used to show that the stationary behavior of the numerical…

Probability · Mathematics 2013-11-26 Jonathan C. Mattingly , Andrew M. Stuart , M. V. Tretyakov

We analyze convergence rates of stochastic optimization procedures for non-smooth convex optimization problems. By combining randomized smoothing techniques with accelerated gradient methods, we obtain convergence rates of stochastic…

Optimization and Control · Mathematics 2012-04-10 John C. Duchi , Peter L. Bartlett , Martin J. Wainwright

This paper aims to investigate the distributed stochastic optimization problems on compact embedded submanifolds (in the Euclidean space) for multi-agent network systems. To address the manifold structure, we propose a distributed…

Optimization and Control · Mathematics 2025-10-28 Jishu Zhao , Xi Wang , Jinlong Lei , Shixiang Chen

The paper examines questions of local asymptotic stability of random dynamical systems. Results concerning stochastic dynamics in general metric spaces, as well as in Banach spaces, are obtained. The results pertaining to Banach spaces are…

Dynamical Systems · Mathematics 2015-03-17 Igor V. Evstigneev , Sergey A. Pirogov , Klaus R. Schenk-Hoppé

This article presents a constrained policy optimization approach for the optimal control of systems under nonstationary uncertainties. We introduce an assumption that we call Markov embeddability that allows us to cast the stochastic…

Optimization and Control · Mathematics 2026-05-11 Sungho Shin , François Pacaud , Emil Contantinescu , Mihai Anitescu

Optimization under uncertainty and risk is indispensable in many practical situations. Our paper addresses stability of optimization problems using composite risk functionals which are subjected to measure perturbations. Our main focus is…

Optimization and Control · Mathematics 2022-01-06 Darinka Dentcheva , Yang Lin , Spiridon Penev

Stochastic evolution equations in Banach spaces with unbounded nonlinear drift and diffusion operators are considered. Under some regularity condition assumed for the solution, the rate of convergence of implicit Euler approximations is…

Probability · Mathematics 2008-02-20 Istvan Gyöngy , Annie Millet

The analysis of area-level aggregated summary data is common in many disciplines including epidemiology and the social sciences. Typically, Markov random field spatial models have been employed to acknowledge spatial dependence and allow…

Methodology · Statistics 2017-09-28 Katherine Wilson , Jon Wakefield

This work introduces a new general approach for the numerical analysis of stable equilibria to second order mean field games systems in cases where the uniqueness of solutions may fail. For the sake of simplicity, we focus on a simple…

Analysis of PDEs · Mathematics 2024-10-30 Jules Berry , Olivier Ley , Francisco J Silva

This paper presents approximate confidence intervals for each function of parameters in a Banach space based on a bootstrap algorithm. We apply kernel density approach to estimate the persistence landscape. In addition, we evaluate the…

Machine Learning · Statistics 2018-03-13 Soroush Pakniat , Farzad Eskandari

We present a nonlinear dynamical approximation method for time-dependent Partial Differential Equations (PDEs). The approach makes use of parametrized decoder functions, and provides a general, and principled way of understanding and…

Numerical Analysis · Mathematics 2025-05-20 Daan Bon , Benjamin Caris , Olga Mula