English
Related papers

Related papers: Adaptive Benders decomposition and enhanced SDDP f…

200 papers

Memory-Bounded Dynamic Programming (MBDP) has proved extremely effective in solving decentralized POMDPs with large horizons. We generalize the algorithm and improve its scalability by reducing the complexity with respect to the number of…

Artificial Intelligence · Computer Science 2012-06-26 Sven Seuken , Shlomo Zilberstein

Differential Dynamic Programming (DDP) is an efficient trajectory optimization algorithm relying on second-order approximations of a system's dynamics and cost function, and has recently been applied to optimize systems with time-invariant…

Optimization and Control · Mathematics 2022-04-11 Alex Oshin , Matthew D. Houghton , Michael J. Acheson , Irene M. Gregory , Evangelos A. Theodorou

Approximate dynamic programming is a popular method for solving large Markov decision processes. This paper describes a new class of approximate dynamic programming (ADP) methods- distributionally robust ADP-that address the curse of…

Machine Learning · Statistics 2012-05-22 Marek Petrik

Stochastic gradient descent is a canonical tool for addressing stochastic optimization problems, and forms the bedrock of modern machine learning and statistics. In this work, we seek to balance the fact that attenuating step-size is…

Signal Processing · Electrical Eng. & Systems 2020-07-10 Zhan Gao , Alec Koppel , Alejandro Ribeiro

The multistage robust unit commitment (UC) is of paramount importance for achieving reliable operations considering the uncertainty of renewable realizations. The typical affine decision rule method and the robust feasible region method may…

Optimization and Control · Mathematics 2023-03-07 Yu Lan , Qiaozhu Zhai , Xiaoming Liu , Xiaohong Guan

Benders decomposition (BD) is a widely used solution approach for solving two-stage stochastic programs arising in real-world decision-making under uncertainty. However, it often suffers from slow convergence as the master problem grows…

Optimization and Control · Mathematics 2026-05-08 Haochen Cai , Xian Yu

This paper introduces an adaptive time splitting technique for the solution of stiff evolutionary PDEs that guarantees an effective error control of the simulation, independent of the fastest physical time scale for highly unsteady…

Numerical Analysis · Mathematics 2012-04-10 Stéphane Descombes , Max Duarte , Thierry Dumont , Violaine Louvet , Marc Massot

A conventional way to handle model predictive control (MPC) problems distributedly is to solve them via dual decomposition and gradient ascent. However, at each time-step, it might not be feasible to wait for the dual algorithm to converge.…

Optimization and Control · Mathematics 2015-03-13 Farhad Farokhi , Iman Shames , Karl H. Johansson

We present a novel optimization-based decoding algorithm for LDPC codes that is suitable for hardware architectures specialized to feed-forward neural networks. The algorithm is based on the projected gradient descent algorithm with a…

Information Theory · Computer Science 2019-01-16 Tadashi Wadayama , Satoshi Takabe

Stochastic multi-level compositional optimization problems cover many new machine learning paradigms, e.g., multi-step model-agnostic meta-learning, which require efficient optimization algorithms for large-scale data. This paper studies…

Machine Learning · Computer Science 2024-06-03 Hongchang Gao

A multiscale numerical method is proposed for the solution of semi-linear elliptic stochastic partial differential equations with localized uncertainties and non-linearities, the uncertainties being modeled by a set of random parameters. It…

Numerical Analysis · Mathematics 2019-01-23 Anthony Nouy , Florent Pled

Block coordinate descent (BCD) methods are prevalent in large scale optimization problems due to the low memory and computational costs per iteration, the predisposition to parallelization, and the ability to exploit the structure of the…

Optimization and Control · Mathematics 2025-10-31 Luis Briceño-Arias , Paulo Gonçalves , Guillaume Lauga , Nelly Pustelnik , Elisa Riccietti

Stochastic gradient algorithms have been the main focus of large-scale learning problems and they led to important successes in machine learning. The convergence of SGD depends on the careful choice of learning rate and the amount of the…

Machine Learning · Computer Science 2015-11-03 Caglar Gulcehre , Marcin Moczulski , Yoshua Bengio

In this paper, we present decomposition techniques for solving large-scale instances of the security-constrained optimal power flow (SCOPF) problem with primary response. Specifically, under each contingency state, we require that the nodal…

Optimization and Control · Mathematics 2019-10-10 Alexandre Velloso , Pascal Van Hentenryck , Emma S. Johnson

We introduce a novel method for handling endpoint constraints in constrained differential dynamic programming (DDP). Unlike existing approaches, our method guarantees quadratic convergence and is exact, effectively managing rank…

Optimization and Control · Mathematics 2025-03-07 Maria Parilli , Sergi Martinez , Carlos Mastalli

Adaptive Computing is an application-agnostic outer loop framework to strategically deploy simulations and experiments to guide decision making for scale-up analysis. Resources are allocated over successive batches, which makes the…

This article introduces a novel distributionally robust model predictive control (DRMPC) algorithm for a specific class of controlled dynamical systems where the disturbance multiplies the state and control variables. These classes of…

Optimization and Control · Mathematics 2024-10-04 Souvik Das , Siddhartha Ganguly , Ashwin Aravind , Debasish Chatterjee

We express the optimization of entanglement witnesses for arbitrary bipartite states in terms of a class of convex optimization problems known as Robust Semidefinite Programs (RSDP). We propose, using well known properties of RSDP, several…

Quantum Physics · Physics 2007-05-23 Fernando. G. S. L. Brandao , Reinaldo O. Vianna

Spectral Deferred Correction (SDC) is an iterative method for the numerical solution of ordinary differential equations. It works by refining the numerical solution for an initial value problem by approximately solving differential…

Numerical Analysis · Mathematics 2025-09-09 Thomas Saupe , Sebastian Götschel , Thibaut Lunet , Daniel Ruprecht , Robert Speck

Power systems that need to integrate renewables at a large scale must account for the high levels of uncertainty introduced by these power sources. This can be accomplished with a system of many distributed grid-level storage devices.…

Optimization and Control · Mathematics 2020-02-04 Joseph L. Durante , Juliana Nascimento , Warren B. Powell