English
Related papers

Related papers: Adaptive Benders decomposition and enhanced SDDP f…

200 papers

Recent studies have shown that multi-step optimization based on Model Predictive Control (MPC) can effectively coordinate the increasing number of distributed renewable energy and storage resources in the power system. However, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-02 Junyao Guo , Gabriela Hug , Ozan Tonguz

Many machine learning applications and tasks rely on the stochastic gradient descent (SGD) algorithm and its variants. Effective step length selection is crucial for the success of these algorithms, which has motivated the development of…

Machine Learning · Computer Science 2023-05-18 Shigeng Sun , Yuchen Xie

Trajectory optimization considers the problem of deciding how to control a dynamical system to move along a trajectory which minimizes some cost function. Differential Dynamic Programming (DDP) is an optimal control method which utilizes a…

Systems and Control · Computer Science 2017-01-10 David D. Fan , Evangelos A. Theodorou

Differential dynamic programming (DDP) is a popular technique for solving nonlinear optimal control problems with locally quadratic approximations. However, existing DDP methods are not designed for stochastic systems with unknown…

Systems and Control · Electrical Eng. & Systems 2023-05-18 Astghik Hakobyan , Insoon Yang

Modeling decision-dependent scenario probabilities in stochastic programs is difficult and typically leads to large and highly non-linear MINLPs that are very difficult to solve. In this paper, we develop a new approach to obtain a compact…

Optimization and Control · Mathematics 2017-01-18 Utz-Uwe Haus , Carla Michini , Marco Laumanns

This paper considers a distributed stochastic non-convex optimization problem, where the nodes in a network cooperatively minimize a sum of $L$-smooth local cost functions with sparse gradients. By adaptively adjusting the stepsizes…

Optimization and Control · Mathematics 2024-04-01 Dongyu Han , Kun Liu , Yeming Lin , Yuanqing Xia

Stochastic gradient algorithms are the main focus of large-scale optimization problems and led to important successes in the recent advancement of the deep learning algorithms. The convergence of SGD depends on the careful choice of…

Machine Learning · Computer Science 2017-03-03 Caglar Gulcehre , Jose Sotelo , Marcin Moczulski , Yoshua Bengio

In this paper we propose a corrected semi-proximal ADMM (alternating direction method of multipliers) for the general $p$-block $(p\!\ge 3)$ convex optimization problems with linear constraints, aiming to resolve the dilemma that almost all…

Optimization and Control · Mathematics 2015-02-12 Li Shen , Shaohua Pan

The increasing integration of intermittent distributed energy resources (DERs) has introduced significant variability in distribution networks, posing challenges to voltage regulation and reactive power management. This paper presents a…

Systems and Control · Electrical Eng. & Systems 2026-04-16 Zhentong Shao , Jingtao Qin , Nanpeng Yu

We consider a logistics planning problem of prepositioning relief items in preparation for an impending hurricane landfall. This problem is modeled as a multiperiod network flow problem where the objective is to minimize the logistics cost…

Optimization and Control · Mathematics 2022-01-27 Murwan Siddig , Yongjia Song

We study robust convex quadratic programs where the uncertain problem parameters can contain both continuous and integer components. Under the natural boundedness assumption on the uncertainty set, we show that the generic problems are…

Optimization and Control · Mathematics 2018-12-19 Areesh Mittal , Can Gokalp , Grani A. Hanasusanto

Stochastic gradient descent (SGD) is a widely adopted iterative method for optimizing differentiable objective functions. In this paper, we propose and discuss a novel approach to scale up SGD in applications involving non-convex functions…

Machine Learning · Statistics 2022-10-07 Saad Mohamad , Hamad Alamri , Abdelhamid Bouchachia

Robust optimization is a popular paradigm for modeling and solving two- and multi-stage decision-making problems affected by uncertainty. In many real-world applications, the time of information discovery is decision-dependent and the…

Optimization and Control · Mathematics 2022-08-24 Phebe Vayanos , Angelos Georghiou , Han Yu

Modern large-scale computing deployments consist of complex applications running over machine clusters. An important issue in these is the offering of elasticity, i.e., the dynamic allocation of resources to applications to meet fluctuating…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-13 Konstantinos Lolos , Ioannis Konstantinou , Verena Kantere , Nectarios Koziris

Mixed integer sets have a strong modeling capacity to describe practical systems. Nevertheless, incorporating a mixed integer set often renders an optimization formulation drastically more challenging to compute. In this paper, we study how…

Optimization and Control · Mathematics 2023-12-22 Wei Wang , Bo Zeng

We consider the joint design and control of discrete-time stochastic dynamical systems over a finite time horizon. We formulate the problem as a multi-step optimization problem under uncertainty seeking to identify a system design and a…

Machine Learning · Computer Science 2022-01-07 Adrien Bolland , Ioannis Boukas , Mathias Berger , Damien Ernst

Forecasting high-dimensional dynamical systems is a fundamental challenge in various fields, such as geosciences and engineering. Neural Ordinary Differential Equations (NODEs), which combine the power of neural networks and numerical…

Machine Learning · Computer Science 2024-10-16 Dibyajyoti Chakraborty , Seung Whan Chung , Troy Arcomano , Romit Maulik

Recoverable robust optimization is a multi-stage approach, where it is possible to adjust a first-stage solution after the uncertain cost scenario is revealed. We analyze this approach for a class of selection problems. The aim is to choose…

Optimization and Control · Mathematics 2021-02-22 Marc Goerigk , Stefan Lendl , Lasse Wulf

We propose a dual dynamic integer programming (DDIP) framework for solving multi-scale mixed-integer model predictive control (MPC) problems. Such problems arise in applications that involve long horizons and/or fine temporal…

Optimization and Control · Mathematics 2020-07-21 Ranjeet Kumar , Michael J. Wenzel , Mohammad N. ElBsat , Michael J. Risbeck , Kirk H. Drees , Victor M. Zavala

This paper proposes a new steepest gradient descent method for solving nonconvex finite minimax problems using non-monotone adaptive step sizes and providing proof of convergence results in cases of the nonconvex, quasiconvex, and…

Optimization and Control · Mathematics 2025-02-05 Nguyen Duc Anh , Tran Ngoc Thang