English
Related papers

Related papers: Stochastic Proximal Point Methods for Monotone Inc…

200 papers

Evaluating joint probabilities of potential outcomes and observed variables, and their linear combinations, is a fundamental challenge in causal inference. This paper addresses the bounding and identification of these probabilities in…

Machine Learning · Statistics 2026-02-24 Naoya Hashimoto , Yuta Kawakami , Jin Tian

We consider a bilevel problem involving two monotone equilibrium bifunctions and we show that this problem can be solved by a proximal point method with generalized proximal distances. We propose a framework for the convergence analysis of…

Optimization and Control · Mathematics 2014-07-09 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , P. A. Soares , A. Soubeyran

We introduce a penalty term-based splitting algorithm with inertial effects designed for solving monotone inclusion problems involving the sum of maximally monotone operators and the convex normal cone to the (nonempty) set of zeros of a…

Optimization and Control · Mathematics 2015-12-15 Radu Ioan Bot , Ernö Robert Csetnek

Proximal operators are now ubiquitous in non-smooth optimization. Since their introduction in the seminal work of Moreau, many papers have shown their effectiveness on a wide variety of problems, culminating in their use to construct…

Optimization and Control · Mathematics 2026-02-03 Guillaume Lauga , Samuel Vaiter

In this paper, we introduce a multilevel algorithm for approximating variational formulations of symmetric saddle point systems. The algorithm is based on availability of families of stable finite element pairs and on the availability of…

Numerical Analysis · Mathematics 2013-05-14 Constantin Bacuta

In this paper we consider iterative methods for stochastic variational inequalities (s.v.i.) with monotone operators. Our basic assumption is that the operator possesses both smooth and nonsmooth components. Further, only noisy observations…

Optimization and Control · Mathematics 2011-06-01 Anatoli Juditsky , Arkadii S. Nemirovskii , Claire Tauvel

In this paper we address the convergence of stochastic approximation when the functions to be minimized are not convex and nonsmooth. We show that the "mean-limit" approach to the convergence which leads, for smooth problems, to the ODE…

Optimization and Control · Mathematics 2018-05-08 Szymon Majewski , Błażej Miasojedow , Eric Moulines

We develop model-based methods for solving stochastic convex optimization problems, introducing the approximate-proximal point, or aProx, family, which includes stochastic subgradient, proximal point, and bundle methods. When the modeling…

Optimization and Control · Mathematics 2019-09-20 Hilal Asi , John C. Duchi

Motivated by applications to multi-antenna wireless networks, we propose a distributed and asynchronous algorithm for stochastic semidefinite programming. This algorithm is a stochastic approximation of a continous- time matrix exponential…

Optimization and Control · Mathematics 2016-06-15 Bruno Gaujal , Panayotis Mertikopoulos

This paper considers a stochastic optimization problem over the fixed point sets of quasinonexpansive mappings on Riemannian manifolds. The problem enables us to consider Riemannian hierarchical optimization problems over complicated sets,…

Optimization and Control · Mathematics 2020-12-18 Hideaki Iiduka , Hiroyuki Sakai

Since their introduction, anchoring methods in extragradient-type saddlepoint problems have inspired a flurry of research due to their ability to provide order-optimal rates of accelerated convergence in very general problem settings. Such…

Optimization and Control · Mathematics 2025-06-10 James Alcala , Yat Tin Chow , Mahesh Sunkula

Consider convex optimization problems subject to a large number of constraints. We focus on stochastic problems in which the objective takes the form of expected values and the feasible set is the intersection of a large number of convex…

Machine Learning · Statistics 2015-11-13 Mengdi Wang , Yichen Chen , Jialin Liu , Yuantao Gu

Pareto optimization via evolutionary multi-objective algorithms has been shown to efficiently solve constrained monotone submodular functions. Traditionally when solving multiple problems, the algorithm is run for each problem separately.…

Neural and Evolutionary Computing · Computer Science 2026-04-17 Liam Wigney , Frank Neumann

We introduce and analyze a parallel sequential Monte Carlo methodology for the numerical solution of optimization problems that involve the minimization of a cost function that consists of the sum of many individual components. The proposed…

Computation · Statistics 2022-01-04 Ömer Deniz Akyildiz , Dan Crisan , Joaquín Míguez

We consider the problem of makespan minimization on unrelated machines when job sizes are stochastic. The goal is to find a fixed assignment of jobs to machines, to minimize the expected value of the maximum load over all the machines. For…

Data Structures and Algorithms · Computer Science 2019-04-17 Anupam Gupta , Amit Kumar , Viswanath Nagarajan , Xiangkun Shen

We establish linear convergence of relocated fixed-point iterations as introduced by Atenas et al. (2025) assuming the algorithmic operator satisfies a linear error bound. In particular, this framework applies to the setting where the…

Optimization and Control · Mathematics 2025-12-16 Felipe Atenas , Farhana Ahmed Simi , Matthew K Tam

Stochastic approximation is a powerful class of algorithms with celebrated success. However, a large body of previous analysis focuses on stochastic approximations driven by contractive operators, which is not applicable in some important…

Machine Learning · Computer Science 2025-11-21 Ethan Blaser , Shangtong Zhang

The majority of machine learning methods can be regarded as the minimization of an unavailable risk function. To optimize the latter, given samples provided in a streaming fashion, we define a general stochastic Newton algorithm and its…

Statistics Theory · Mathematics 2023-06-30 Claire Boyer , Antoine Godichon-Baggioni

We propose a batchwise monotone algorithm for dictionary learning. Unlike the state-of-the-art dictionary learning algorithms which impose sparsity constraints on a sample-by-sample basis, we instead treat the samples as a batch, and impose…

Machine Learning · Computer Science 2015-02-03 Huan Wang , John Wright , Daniel Spielman

We consider variational inequalities coming from monotone operators, a setting that includes convex minimization and convex-concave saddle-point problems. We assume an access to potentially noisy unbiased values of the monotone operators…

Machine Learning · Computer Science 2019-02-06 Francis Bach , Kfir Y. Levy