English
Related papers

Related papers: ADPBA: Efficiently generating Lagrangian cuts for …

200 papers

Hidden convexity is a powerful idea in optimization: under the right transformations, nonconvex problems that are seemingly intractable can be solved efficiently using convex optimization. We introduce the notion of a Lagrangian dual…

Optimization and Control · Mathematics 2025-11-07 Venkat Chandrasekaran , Timothy Duff , Jose Israel Rodriguez , Kevin Shu

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

In this paper we examine how Lagrangian techniques can be used to compute underapproximations and overapproximation of the finite-time horizon, stochastic reach-avoid level sets for discrete-time, nonlinear systems. This approach is…

Systems and Control · Computer Science 2018-10-17 Joseph D. Gleason , Abraham P. Vinod , Meeko M. K. Oishi

Sample-based Bayesian inference provides a route to uncertainty quantification in the geosciences, and inverse problems in general, though is very computationally demanding in the naive form that requires simulating an accurate computer…

Computation · Statistics 2019-04-12 Tiangang Cui , Colin Fox , Michael J O'Sullivan

We present adaptive sequential SAA (sample average approximation) algorithms to solve large-scale two-stage stochastic linear programs. The iterative algorithm framework we propose is organized into \emph{outer} and \emph{inner} iterations…

Optimization and Control · Mathematics 2020-12-08 Raghu Pasupathy , Yongjia Song

We introduce a stochastic version of the cutting-plane method for a large class of data-driven Mixed-Integer Nonlinear Optimization (MINLO) problems. We show that under very weak assumptions the stochastic algorithm is able to converge to…

Optimization and Control · Mathematics 2021-03-04 Dimitris Bertsimas , Michael Lingzhi Li

Differential Dynamic Programming (DDP) has become a well established method for unconstrained trajectory optimization. Despite its several applications in robotics and controls however, a widely successful constrained version of the…

Optimization and Control · Mathematics 2020-05-05 Yuichiro Aoyama , George Boutselis , Akash Patel , Evangelos A. Theodorou

We study the computational complexity certification of inexact gradient augmented Lagrangian methods for solving convex optimization problems with complicated constraints. We solve the augmented Lagrangian dual problem that arises from the…

Optimization and Control · Mathematics 2013-02-19 Valentin Nedelcu , Ion Necoara , Quoc Tran Dinh

We introduce a variant of Multicut Decomposition Algorithms (MuDA), called CuSMuDA (Cut Selection for Multicut Decomposition Algorithms), for solving multistage stochastic linear programs that incorporates strategies to select the most…

Optimization and Control · Mathematics 2019-07-23 Michelle Bandarra , Vincent Guigues

We introduce a novel approach addressing global analysis of a difficult class of nonconvex-nonsmooth optimization problems within the important framework of Lagrangian-based methods. This genuine nonlinear class captures many problems in…

Optimization and Control · Mathematics 2018-01-10 Jérôme Bolte , Shoham Sabach , Marc Teboulle

We study the multi-stage stochastic unit commitment problem in which commitment and generation decisions can be made and adjusted in each time period. We formulate this problem as a Markov decision process, which is "weakly-coupled" in the…

Optimization and Control · Mathematics 2018-06-25 Jagdish Ramakrishnan , James Luedtke

Gaussian process (GP) surrogate modeling for large computer experiments is limited by cubic runtimes, especially with data from stochastic simulations with input-dependent noise. A popular workaround to reduce computational complexity…

Methodology · Statistics 2022-06-01 D Austin Cole , Robert B Gramacy , Mike Ludkovski

First-order stochastic methods are the state-of-the-art in large-scale machine learning optimization owing to efficient per-iteration complexity. Second-order methods, while able to provide faster convergence, have been much less explored…

Machine Learning · Statistics 2017-12-01 Naman Agarwal , Brian Bullins , Elad Hazan

A new algorithm for solving large-scale convex optimization problems with a separable objective function is proposed. The basic idea is to combine three techniques: Lagrangian dual decomposition, excessive gap and smoothing. The main…

Optimization and Control · Mathematics 2011-12-01 Tran Dinh Quoc , Carlo Savorgnan , Moritz Diehl

Cutting plane methods are a fundamental approach for solving integer linear programs (ILPs). In each iteration of such methods, additional linear constraints (cuts) are introduced to the constraint set with the aim of excluding the previous…

Optimization and Control · Mathematics 2024-06-28 Pol Puigdemont , Stratis Skoulakis , Grigorios Chrysos , Volkan Cevher

Solving large-scale capacity expansion problems (CEPs) is central to cost-effective decarbonization of regional-scale energy systems. To ensure the intended outcomes of CEPs, modeling uncertainty due to weather-dependent variable renewable…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Aron Brenner , Rahman Khorramfar , Dharik Mallapragada , Saurabh Amin

Stochastic Optimization is a cornerstone of operations research, providing a framework to solve optimization problems under uncertainty. Despite the development of numerous algorithms to tackle these problems, several persistent challenges…

Optimization and Control · Mathematics 2025-03-28 Di Zhang , Suvrajeet Sen

Lagrangian relaxation stands among the most efficient approaches for solving a Mixed Integer Linear Programs (MILP) with difficult constraints. Given any duals for these constraints, called Lagrangian Multipliers (LMs), it returns a bound…

Machine Learning · Computer Science 2024-10-21 Francesco Demelas , Joseph Le Roux , Mathieu Lacroix , Axel Parmentier

This paper introduces an adaptive time splitting technique for the solution of stiff evolutionary PDEs that guarantees an effective error control of the simulation, independent of the fastest physical time scale for highly unsteady…

Numerical Analysis · Mathematics 2012-04-10 Stéphane Descombes , Max Duarte , Thierry Dumont , Violaine Louvet , Marc Massot

Recently, lower-level constrained bilevel optimization has attracted increasing attention. However, existing methods mostly focus on either deterministic cases or problems with linear constraints. The main challenge in stochastic cases with…

Optimization and Control · Mathematics 2025-10-13 Hantao Nie , Jiaxiang Li , Zaiwen Wen