English
Related papers

Related papers: Iterative Splitting Methods for Stochastic Dynamic…

200 papers

This paper introduces a unified framework for accelerated gradient methods through the variable and operator splitting (VOS). The operator splitting decouples the optimization process into simpler subproblems, and more importantly, the…

Optimization and Control · Mathematics 2025-05-08 Long Chen , Luo Hao , Jingrong Wei

Stochastic sampling methods are arguably the most direct and least intrusive means of incorporating parametric uncertainty into numerical simulations of partial differential equations with random inputs. However, to achieve an overall error…

Numerical Analysis · Mathematics 2014-04-09 Hans-Werner van Wyk

Multistage stochastic optimization problems are, by essence, complex as their solutions are indexed both by stages and by uncertainties. Their large scale nature makes decomposition methods appealing, like dynamic programming which is a…

Optimization and Control · Mathematics 2023-05-01 Pierre Carpentier , Jean-Philippe Chancelier , Michel de Lara , Thomas Martin , Tristan Rigaut

We present a new path integral method to analyze stochastically perturbed ordinary differential equations with multiple time scales. The objective of this method is to derive from the original system a new stochastic differential equation…

Pattern Formation and Solitons · Physics 2007-08-20 Tobias Schaefer Richard O. Moore

Many stochastic optimization problems in multi-agent systems can be decomposed into smaller subproblems or reduced decision subspaces. The cyclic and distributed approaches are two widely used strategies for solving such problems. In this…

Optimization and Control · Mathematics 2024-09-10 Jiahao Shi , James C. Spall

Motivated by emerging applications in machine learning, we consider an optimization problem in a general form where the gradient of the objective function is available through a biased stochastic oracle. We assume a bias-control parameter…

Optimization and Control · Mathematics 2026-02-10 Yin Liu , Sam Davanloo Tajbakhsh

This work presents a new three-operator splitting method to handle monotone inclusion and convex optimization problems. The proposed splitting serves as another natural extension of the Douglas-Rachford splitting technique to problems…

Optimization and Control · Mathematics 2025-10-03 Anshika Anshika , Jiaxing Li , Debdas Ghosh , Xiangxiong Zhang

Optimization problems with continuous data appear in, e.g., robust machine learning, functional data analysis, and variational inference. Here, the target function is given as an integral over a family of (continuously) indexed target…

Machine Learning · Computer Science 2023-11-01 Kexin Jin , Jonas Latz , Chenguang Liu , Carola-Bibiane Schönlieb

In this paper, we develop a new general approach to the existence and uniqueness theory of infinite dimensional stochastic equations of the form dX+A(t)Xdt = XdW in (0;T)xH, where A(t) is a nonlinear monotone and demicontinuous operator…

Probability · Mathematics 2018-06-18 Viorel Barbu , Michael Röckner

We introduce a novel numerical approach for a class of stochastic dynamic programs which arise as discretizations of backward stochastic differential equations or semi-linear partial differential equations. Solving such dynamic programs…

Numerical Analysis · Mathematics 2016-06-24 Christian Bender , Christian Gaertner , Nikolaus Schweizer

Real-world networks often come with side information that can help to improve the performance of network analysis tasks such as clustering. Despite a large number of empirical and theoretical studies conducted on network clustering methods…

Machine Learning · Statistics 2022-07-29 Guillaume Braun , Hemant Tyagi , Christophe Biernacki

In this work we investigate the practicality of stochastic gradient descent and recently introduced variants with variance-reduction techniques in imaging inverse problems. Such algorithms have been shown in the machine learning literature…

Optimization and Control · Mathematics 2021-01-26 Junqi Tang , Karen Egiazarian , Mohammad Golbabaee , Mike Davies

Consider the problem of minimizing the expected value of a (possibly nonconvex) cost function parameterized by a random (vector) variable, when the expectation cannot be computed accurately (e.g., because the statistics of the random…

Multiagent Systems · Computer Science 2017-12-12 Yang Yang , Gesualdo Scutari , Daniel P. Palomar , Marius Pesavento

In this paper, we are concerned with a operator splitting scheme for linear fractional and fractional degenerate stochastic conservation laws driven by multiplicative Levy noise. More specifically, using a variant of classical Kruzkov's…

Numerical Analysis · Mathematics 2023-03-14 Soumya Ranjan Behera , Ananta K. Majee

We propose and analyze an adaptive step-size variant of the Davis-Yin three operator splitting. This method can solve optimization problems composed by a sum of a smooth term for which we have access to its gradient and an arbitrary number…

Optimization and Control · Mathematics 2018-08-02 Fabian Pedregosa , Gauthier Gidel

Stochastic computational models in the form of pure jump processes occur frequently in the description of chemical reactive processes, of ion channel dynamics, and of the spread of infections in populations. For spatially extended models,…

Numerical Analysis · Mathematics 2018-02-23 Augustin Chevallier , Stefan Engblom

In this paper we develop a novel, discrete-time optimal control framework for mechanical systems with uncertain model parameters. We consider finite-horizon problems where the performance index depends on the statistical moments of the…

Optimization and Control · Mathematics 2017-05-17 George I. Boutselis , Yunpeng Pan , Gerardo De La Tore , Evangelos A. Theodorou

This work considers the allocation problem for multivariate stratified random sampling as a problem of integer non-linear stochastic multiobjective mathematical programming. With this goal in mind the asymptotic distribution of the vector…

Methodology · Statistics 2011-06-07 Jose A. Diaz-Garcia , Rogelio Ramos-Quiroga

This paper investigates the asymptotic behavior of stochastic recursive inclusions in the presence of non-zero, non-diminishing bias, a setting that frequently arises in zeroth-order optimization, stochastic approximation with…

Optimization and Control · Mathematics 2026-01-19 Anik Kumar Paul , Karthik Shenoy , Arun D. Mahindrakar

Based on a preconditioned version of the randomized block-coordinate forward-backward algorithm recently proposed in [Combettes,Pesquet,2014], several variants of block-coordinate primal-dual algorithms are designed in order to solve a wide…

Optimization and Control · Mathematics 2014-10-28 Jean-Christophe Pesquet , Audrey Repetti