English
Related papers

Related papers: Consistency of sample-based stationary points for …

200 papers

This paper considers a stochastic optimization problem over the fixed point sets of quasinonexpansive mappings on Riemannian manifolds. The problem enables us to consider Riemannian hierarchical optimization problems over complicated sets,…

Optimization and Control · Mathematics 2020-12-18 Hideaki Iiduka , Hiroyuki Sakai

In this paper, we investigate a class of nonlinear impulsive stochastic differential evolution equations with infinite delay in Banach space. Based on the Krasnoselskii's fixed point theorem, sufficient conditions of the existence of the…

Dynamical Systems · Mathematics 2016-09-07 Shufen Zhao , Minghui Song

We study the performance of stochastic first-order methods for finding saddle points of convex-concave functions. A notorious challenge faced by such methods is that the gradients can grow arbitrarily large during optimization, which may…

Machine Learning · Computer Science 2024-06-10 Gergely Neu , Nneka Okolo

Geodesic contraction in vector-valued differential equations is readily verified by linearized operators which are uniformly negative-definite in the Riemannian metric. In the infinite-dimensional setting, however, such analysis is…

Dynamical Systems · Mathematics 2022-08-12 Anand Srinivasan , Jean-Jacques Slotine

In this paper, an abstract framework for the error analysis of discontinuous finite element method is developed for the distributed and Neumann boundary control problems governed by the stationary Stokes equation with control constraints.…

Numerical Analysis · Mathematics 2021-11-01 Asha K Dond , Thirupathi Gudi , Ramesh Ch. Sau

We study backward stochastic differential equations (BSDEs) in infinite horizon and design efficient numerical schemes for solving them. We establish a probabilistic representation of the solution of the BSDE using Malliavin derivative and…

Probability · Mathematics 2026-04-28 Emmanuel Gobet , Adrien Richou , Charu Shardul

In this paper, we analyze the Nitsche's method for the stationary Navier-Stokes equations on Lipschitz domains under minimal regularity assumptions. Our analysis provides a robust formulation for implementing slip (i.e. Navier) boundary…

Numerical Analysis · Mathematics 2023-07-19 Aparna Bansal , Nicolás Alejandro Barnafi , Dwijendra Narain Pandey

Monte Carlo approximations for random linear elliptic PDE constrained optimization problems are studied. We use empirical process theory to obtain best possible mean convergence rates $O(n^{-\frac{1}{2}})$ for optimal values and solutions,…

Optimization and Control · Mathematics 2021-06-14 Werner Römisch , Thomas M. Surowiec

In this paper, we analyze the finite sample complexity of stochastic system identification using modern tools from machine learning and statistics. An unknown discrete-time linear system evolves over time under Gaussian noise without…

Machine Learning · Computer Science 2019-03-22 Anastasios Tsiamis , George J. Pappas

In this paper, we consider stochastic monotone Nash games where each player's strategy set is characterized by possibly a large number of explicit convex constraint inequalities. Notably, the functional constraints of each player may depend…

Optimization and Control · Mathematics 2023-08-25 Zeinab Alizadeh , Afrooz Jalilzadeh , Farzad Yousefian

We deal with the approximate solution of initial value problems in infinite-dimensional Banach spaces with a Schauder basis. We only allow finite-dimensional algorithms acting in the spaces $\rr^N$, with varying $N$. The error of such…

Numerical Analysis · Mathematics 2018-11-09 Boleslaw Kacewicz , Pawel Przybylowicz

In this paper we address the convergence of stochastic approximation when the functions to be minimized are not convex and nonsmooth. We show that the "mean-limit" approach to the convergence which leads, for smooth problems, to the ODE…

Optimization and Control · Mathematics 2018-05-08 Szymon Majewski , Błażej Miasojedow , Eric Moulines

This paper presents smoothing schemes for obtaining approximate stationary points of unconstrained or linearly-constrained composite nonconvex-concave min-max (and hence nonsmooth) problems by applying well-known algorithms to composite…

Optimization and Control · Mathematics 2021-06-18 Weiwei Kong , Renato D. C. Monteiro

A framework previously introduced in [3] for solving a sequence of stochastic optimization problems with bounded changes in the minimizers is extended and applied to machine learning problems such as regression and classification. The…

Machine Learning · Computer Science 2019-04-08 Craig Wilson , Yuheng Bu , Venugopal Veeravalli

This paper focuses on the analysis of an optimal control problem governed by a nonsmooth quasilinear partial differential equation that models a stationary incompressible shear-thickening fluid. We start by studying the directional…

Optimization and Control · Mathematics 2023-03-07 Juan Carlos De los Reyes , Paola Quiloango

We extend the single-stage stellarator coil design approach for quasi-symmetry on axis from [Giuliani et al, 2020] to additionally take into account coil manufacturing errors. By modeling coil errors independently from the coil…

Optimization and Control · Mathematics 2022-05-18 Florian Wechsung , Andrew Giuliani , Matt Landreman , Antoine Cerfon , Georg Stadler

The stochastic subgradient method is a widely-used algorithm for solving large-scale optimization problems arising in machine learning. Often these problems are neither smooth nor convex. Recently, Davis et al. [1-2] characterized the…

Optimization and Control · Mathematics 2021-02-25 Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

This paper addresses the study of novel constructions of variational analysis and generalized differentiation that are appropriate for characterizing robust stability properties of constrained set-valued mappings/multifunctions between…

Optimization and Control · Mathematics 2024-01-11 Boris S. Mordukhovich , Pengcheng Wu , Xiaoqi Yang

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

In this paper, we introduce a new stochastic approximation (SA) type algorithm, namely the randomized stochastic gradient (RSG) method, for solving an important class of nonlinear (possibly nonconvex) stochastic programming (SP) problems.…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan