English
Related papers

Related papers: Variance-Reduced Splitting Schemes for Monotone St…

200 papers

This work presents the convergence rate analysis of stochastic variants of the broad class of direct-search methods of directional type. It introduces an algorithm designed to optimize differentiable objective functions $f$ whose values can…

Optimization and Control · Mathematics 2020-03-09 Kwassi Joseph Dzahini

We develop a multilevel approach to compute approximate solutions to backward differential equations (BSDEs). The fully implementable algorithm of our multilevel scheme constructs sequential martingale control variates along a sequence of…

Probability · Mathematics 2014-12-11 Dirk Becherer , Plamen Turkedjiev

We present a family of distributed forward-backward methods with variable stepsizes to find a solution of structured monotone inclusion problems. The framework is constructed by means of relocated fixed-point iterations, extending the…

Optimization and Control · Mathematics 2026-01-23 Felipe Atenas , Minh N. Dao , Matthew K. Tam

We consider the stochastic generalized Nash equilibrium problem (SGNEP) with joint feasibility constraints and expected-value cost functions. We propose a distributed stochastic projected reflected gradient algorithm and show its almost…

Optimization and Control · Mathematics 2021-03-22 Barbara Franci , Sergio Grammatico

This work introduces and rigorously analyzes a novel operator-splitting finite element scheme for approximating viscosity solutions of a broad class of constrained second-order partial differential equations. By decoupling the primary PDE…

Numerical Analysis · Mathematics 2025-07-01 Po-Yi Wu

To model combinatorial decision problems involving uncertainty and probability, we introduce stochastic constraint programming. Stochastic constraint programs contain both decision variables (which we can set) and stochastic variables…

Artificial Intelligence · Computer Science 2009-03-09 Toby Walsh

The goal of this paper is to present two algorithms for solving systems of inclusion problems, with all component of the systems being a sum of two maximal monotone operators. The algorithms are variants of the forward-backward splitting…

Optimization and Control · Mathematics 2018-05-28 R. Díaz Millán

Many statistical learning problems can be posed as minimization of a sum of two convex functions, one typically a composition of non-smooth and linear functions. Examples include regression under structured sparsity assumptions. Popular…

Machine Learning · Statistics 2021-07-19 Seyoon Ko , Donghyeon Yu , Joong-Ho Won

We present a stochastic setting for optimization problems with nonsmooth convex separable objective functions over linear equality constraints. To solve such problems, we propose a stochastic Alternating Direction Method of Multipliers…

Machine Learning · Computer Science 2013-01-23 Hua Ouyang , Niao He , Alexander Gray

Nonlinear parabolic equations are frequently encountered in applications and efficient approximating techniques for their solution are of great importance. In order to provide an effective scheme for the temporal approximation of such…

Numerical Analysis · Mathematics 2020-02-28 Monika Eisenmann , Eskil Hansen

Various classes of stable finite difference schemes can be constructed to obtain a numerical solution. It is important to select among all stable schemes such a scheme that is optimal in terms of certain additional criteria. In this study,…

Numerical Analysis · Computer Science 2010-06-01 Petr N. Vabishchevich

The low-rank stochastic semidefinite optimization has attracted rising attention due to its wide range of applications. The nonconvex reformulation based on the low-rank factorization, significantly improves the computational efficiency but…

Optimization and Control · Mathematics 2021-01-05 Jinshan Zeng , Yixuan Zha , Ke Ma , Yuan Yao

Convex nonsmooth optimization problems, whose solutions live in very high dimensional spaces, have become ubiquitous. To solve them, the class of first-order algorithms known as proximal splitting algorithms is particularly adequate: they…

Optimization and Control · Mathematics 2023-02-27 Laurent Condat , Daichi Kitahara , Andrés Contreras , Akira Hirabayashi

Multidimensional population balance models (PBMs) describe chemical and biological processes having a distribution over two or more intrinsic properties (such as size and age, or two independent spatial variables). The incorporation of…

Computational Engineering, Finance, and Science · Computer Science 2025-04-29 Pavan Inguva , Richard D. Braatz

In this paper we consider iterative methods for stochastic variational inequalities (s.v.i.) with monotone operators. Our basic assumption is that the operator possesses both smooth and nonsmooth components. Further, only noisy observations…

Optimization and Control · Mathematics 2011-06-01 Anatoli Juditsky , Arkadii S. Nemirovskii , Claire Tauvel

We propose a novel approach to monotone operator splitting based on the notion of a saddle operator. Under investigation is a highly structured multivariate monotone inclusion problem involving a mix of set-valued, cocoercive, and…

Optimization and Control · Mathematics 2021-03-12 Minh N. Bùi , Patrick L. Combettes

Sampling methods (e.g., node-wise, layer-wise, or subgraph) has become an indispensable strategy to speed up training large-scale Graph Neural Networks (GNNs). However, existing sampling methods are mostly based on the graph structural…

Machine Learning · Computer Science 2021-09-07 Weilin Cong , Rana Forsati , Mahmut Kandemir , Mehrdad Mahdavi

Based on the stochastic maximum principle for the partially coupled forward-backward stochastic control system (FBSCS for short), a modified method of successive approximations (MSA for short) is established for stochastic recursive optimal…

Optimization and Control · Mathematics 2022-01-11 Shaolin Ji , Rundong Xu

Immersive video, such as virtual reality (VR) and multi-view videos, is growing in popularity. Its wireless streaming is an instance of general multicast, extending conventional unicast and multicast, whose effective design is still open.…

Information Theory · Computer Science 2022-06-17 Lingzhi Zhao , Ying Cui , Sheng Yang , Shlomo Shamai

In this paper, we propose a class of efficient, accurate, and general methods for solving state-estimation problems with equality and inequality constraints. The methods are based on recent developments in variable splitting and partially…

Optimization and Control · Mathematics 2020-12-02 Rui Gao , Filip Tronarp , Simo Särkkä