English
Related papers

Related papers: Numerical Methods for Convex Multistage Stochastic…

200 papers

In this paper we consider stochastic composite convex optimization problems with the objective function satisfying a stochastic bounded gradient condition, with or without a quadratic functional growth property. These models include the…

Optimization and Control · Mathematics 2020-03-10 Ion Necoara

Sequential decision problems in applications such as manipulation in warehouses, multi-step meal preparation, and routing in autonomous vehicle networks often involve reasoning about uncertainty, planning over discrete modes as well as…

Artificial Intelligence · Computer Science 2019-06-24 Shushman Choudhury , Mykel J. Kochenderfer

This paper addresses the question of whether it can be beneficial for an optimization algorithm to follow directions of negative curvature. Although prior work has established convergence results for algorithms that integrate both descent…

Optimization and Control · Mathematics 2018-04-05 Frank E. Curtis , Daniel P. Robinson

A framework based on iterative coordinate minimization (CM) is developed for stochastic convex optimization. Given that exact coordinate minimization is impossible due to the unknown stochastic nature of the objective function, the crux of…

Machine Learning · Statistics 2020-03-13 Sudeep Salgia , Qing Zhao , Sattar Vakili

Computing shortest paths is one of the most researched topics in algorithm engineering. Currently available algorithms compute shortest paths in mere fractions of a second on continental sized road networks. In the presence of…

Data Structures and Algorithms · Computer Science 2014-08-01 Moritz Kobitzsch , Samitha Samaranayake , Dennis Schieferdecker

This paper tackles the challenging problem of finding global optimal solutions for two-stage stochastic programs with continuous decision variables and nonconvex recourse functions. We introduce a two-phase approach. The first phase…

Optimization and Control · Mathematics 2024-05-29 Suhan Zhong , Ying Cui , Jiawang Nie

We introduce and analyze a parallel sequential Monte Carlo methodology for the numerical solution of optimization problems that involve the minimization of a cost function that consists of the sum of many individual components. The proposed…

Computation · Statistics 2022-01-04 Ömer Deniz Akyildiz , Dan Crisan , Joaquín Míguez

This paper considers a class of constrained stochastic composite optimization problems whose objective function is given by the summation of a differentiable (possibly nonconvex) component, together with a certain non-differentiable (but…

Optimization and Control · Mathematics 2013-09-06 Saeed Ghadimi , Guanghui Lan , Hongchao Zhang

Majorization-minimization schemes are a broad class of iterative methods targeting general optimization problems, including nonconvex, nonsmooth and stochastic. These algorithms minimize successively a sequence of upper bounds of the…

Optimization and Control · Mathematics 2024-01-11 Daniela Lupu , Ion Necoara

To model combinatorial decision problems involving uncertainty and probability, we introduce scenario based stochastic constraint programming. Stochastic constraint programs contain both decision variables, which we can set, and stochastic…

Artificial Intelligence · Computer Science 2009-03-09 S. Armagan Tarim , Suresh Manandhar , Toby Walsh

This paper proposes a neural stochastic optimization method for efficiently solving the two-stage stochastic unit commitment (2S-SUC) problem under high-dimensional uncertainty scenarios. The proposed method approximates the second-stage…

Systems and Control · Electrical Eng. & Systems 2026-04-16 Zhentong Shao , Jingtao Qin , Nanpeng Yu

We consider a broad class of dynamic programming (DP) problems that involve a partially linear structure and some positivity properties in their system equation and cost function. We address deterministic and stochastic problems, possibly…

Optimization and Control · Mathematics 2026-04-21 Yuchao Li , Dimitri Bertsekas

Optimal control problems can be solved via a one-shot (single) optimization or a sequence of optimization using dynamic programming (DP). However, the computation of their global optima often faces NP-hardness, and thus only locally optimal…

Optimization and Control · Mathematics 2024-09-04 Jihun Kim , Yuhao Ding , Yingjie Bi , Javad Lavaei

In this paper, we study a class of stochastic bilevel optimization problems, also known as stochastic simple bilevel optimization, where we minimize a smooth stochastic objective function over the optimal solution set of another stochastic…

Optimization and Control · Mathematics 2023-08-16 Jincheng Cao , Ruichen Jiang , Nazanin Abolfazli , Erfan Yazdandoost Hamedani , Aryan Mokhtari

Sequential Convex Programming (SCP) has recently gained significant popularity as an effective method for solving optimal control problems and has been successfully applied in several different domains. However, the theoretical analysis of…

Optimization and Control · Mathematics 2022-09-07 Riccardo Bonalli , Thomas Lew , Marco Pavone

We consider a class of finite time horizon nonlinear stochastic optimal control problem, where the control acts additively on the dynamics and the control cost is quadratic. This framework is flexible and has found applications in many…

Optimization and Control · Mathematics 2023-04-26 Ajay Jasra , Jeremy Heng , Yaxian Xu , Adrian N. Bishop

In this paper, we consider two sequential decision making problems with a convexity structure, namely an energy storage optimization task and a multi-product assembly example. We formulate these problems in the stochastic programming…

Optimization and Control · Mathematics 2016-09-22 Gábor Balázs , András György , Csaba Szepesvári

We derive novel algorithms for optimization problems constrained by partial differential equations describing multiscale particle dynamics, including non-local integral terms representing interactions between particles. In particular, we…

Numerical Analysis · Mathematics 2021-09-09 Mildred Aduamoah , Benjamin D. Goddard , John W. Pearson , Jonna C. Roden

Stochastic gradient descent (\textsc{Sgd}) methods are the most powerful optimization tools in training machine learning and deep learning models. Moreover, acceleration (a.k.a. momentum) methods and diagonal scaling (a.k.a. adaptive…

Machine Learning · Statistics 2018-10-02 Qi Deng , Yi Cheng , Guanghui Lan

We consider the problem of minimizing a convex function that is evolving according to unknown and possibly stochastic dynamics, which may depend jointly on time and on the decision variable itself. Such problems abound in the machine…

Optimization and Control · Mathematics 2023-05-30 Joshua Cutler , Dmitriy Drusvyatskiy , Zaid Harchaoui