English
Related papers

Related papers: On Generating Lagrangian Cuts for Two-Stage Stocha…

200 papers

We propose an enhancement to Benders decomposition (BD) that generates valid inequalities for the convex hull of the Benders reformulation, addressing the limitation that classical BD cuts are typically tight only for the continuous…

Optimization and Control · Mathematics 2026-05-19 Kaiwen Fang , Inho Sin , Geunyeong Byeon

We introduce a new form of Lagrangian and propose a simple first-order algorithm for nonconvex optimization with nonlinear equality constraints. We show the algorithm generates bounded dual iterates, and establish the convergence to KKT…

Optimization and Control · Mathematics 2023-05-10 Jong Gwang Kim

Mixed-integer rounding (MIR) cutting planes (cuts) are effective at improving the strength of a linear relaxation for mixed-integer linear programming (MIP) problems. The cuts in this family are derived by aggregating constraints then…

Optimization and Control · Mathematics 2024-12-16 Oscar Guaje , Arnaud Deza , Aleksandr M. Kazachkov , Elias B. Khalil

In the application of the Expectation Maximization algorithm to identification of dynamical systems, internal states are typically chosen as latent variables, for simplicity. In this work, we propose a different choice of latent variables,…

Computation · Statistics 2016-08-06 Jack Umenberger , Johan Wågberg , Ian R. Manchester , Thomas B. Schön

This paper tackles the challenging problem of finding global optimal solutions for two-stage stochastic programs with continuous decision variables and nonconvex recourse functions. We introduce a two-phase approach. The first phase…

Optimization and Control · Mathematics 2024-05-29 Suhan Zhong , Ying Cui , Jiawang Nie

We study a stochastic and distributed algorithm for nonconvex problems whose objective consists of a sum of $N$ nonconvex $L_i/N$-smooth functions, plus a nonsmooth regularizer. The proposed NonconvEx primal-dual SpliTTing (NESTT) algorithm…

Optimization and Control · Mathematics 2017-06-06 Davood Hajinezhad , Mingyi Hong , Tuo Zhao , Zhaoran Wang

We consider distributed learning in the presence of slow and unresponsive worker nodes, referred to as stragglers. In order to mitigate the effect of stragglers, gradient coding redundantly assigns partial computations to the worker such…

Information Theory · Computer Science 2022-12-19 Luis Maßny , Christoph Hofmeister , Maximilian Egger , Rawad Bitar , Antonia Wachter-Zeh

We consider Lagrangian duality based approaches to design and analyze algorithms for online energy-efficient scheduling. First, we present a primal-dual framework. Our approach makes use of the Lagrangian weak duality and convexity to…

Data Structures and Algorithms · Computer Science 2014-08-06 Nguyen Kim Thang

Stochastic Optimization is a cornerstone of operations research, providing a framework to solve optimization problems under uncertainty. Despite the development of numerous algorithms to tackle these problems, several persistent challenges…

Optimization and Control · Mathematics 2025-03-28 Di Zhang , Suvrajeet Sen

In distributed computing, slower nodes (stragglers) usually become a bottleneck. Gradient Coding (GC), introduced by Tandon et al., is an efficient technique that uses principles of error-correcting codes to distribute gradient computation…

Machine Learning · Computer Science 2023-06-29 M. Nikhil Krishnan , MohammadReza Ebrahimi , Ashish Khisti

Operations research practitioners frequently want to model complicated functions that are are difficult to encode in their underlying optimisation framework. A common approach is to solve an approximate model, and to use a simulation to…

Optimization and Control · Mathematics 2022-07-06 Michael Forbes , Mitchell Harris , Marijn Jansen , Femke van der Schoot , Thomas Taimre

This study presents a rapid multiple incremental and decremental mechanism based on Weight-Error Curves (WECs) for support-vector analysis. Recursion-free computation is proposed for predicting the Lagrangian multipliers of new samples.…

Machine Learning · Computer Science 2016-10-12 Bo-Wei Chen

Probabilistic relaxations of graph cuts offer a differentiable alternative to spectral clustering, enabling end-to-end and online learning without eigendecompositions, yet prior work centered on RatioCut and lacked general guarantees and…

Machine Learning · Computer Science 2026-04-02 Ayoub Ghriss

We study the problems of multi-person pose segmentation in natural images and instance segmentation in biological images with crowded cells. We formulate these distinct tasks as integer programs where variables correspond to poses/cells. To…

Computer Vision and Pattern Recognition · Computer Science 2016-12-02 Shaofei Wang , Chong Zhang , Miguel A. Gonzalez-Ballester , Julian Yarkony

The incorporation of cutting planes within the branch-and-bound algorithm, known as branch-and-cut, forms the backbone of modern integer programming solvers. These solvers are the foremost method for solving discrete optimization problems…

Optimization and Control · Mathematics 2022-04-18 Maria-Florina Balcan , Siddharth Prasad , Tuomas Sandholm , Ellen Vitercik

In this paper we will review recent advances in the application of the augmented Lagrange multiplier method as a general approach for generating multiplier--free stabilised methods. We first show how the method generates Galerkin/Least…

Numerical Analysis · Mathematics 2022-07-04 Erik Burman , Peter Hansbo , Mats G. Larson

Linear programming (LP) decoding approximates maximum-likelihood (ML) decoding of a linear block code by relaxing the equivalent ML integer programming (IP) problem into a more easily solved LP problem. The LP problem is defined by a set of…

Information Theory · Computer Science 2013-01-01 Xiaojie Zhang , Paul H. Siegel

We present a novel framework for dynamic cut aggregation in L-shaped algorithms. The aim is to improve the parallel performance of distributed L-shaped algorithms through reduced communication latency and load imbalance. We show how…

Optimization and Control · Mathematics 2020-10-06 Martin Biel , Mikael Johansson

We prove a general result demonstrating the power of Lagrangian relaxation in solving constrained maximization problems with arbitrary objective functions. This yields a unified approach for solving a wide class of {\em subset selection}…

Data Structures and Algorithms · Computer Science 2015-12-22 Ariel Kulik , Hadas Shachnai , Gal Tamir

In the context of augmented Lagrangian approaches for solving semidefinite programming problems, we investigate the possibility of eliminating the positive semidefinite constraint on the dual matrix by employing a factorization. Hints on…

Optimization and Control · Mathematics 2018-09-12 Marianna De Santis , Franz Rendl , Angelika Wiegele