English
Related papers

Related papers: A Framework for Generalized Benders' Decomposition…

200 papers

In this paper, we will present a generalization for a minimization problem from I. Daubechies, M. Defrise, and C. Demol [3]. This generalization is useful for solving many practical problems in which more than one constraint are involved.…

Optimization and Control · Mathematics 2019-12-20 Saman Khoramian

We tackle the problem of graph partitioning for image segmentation using correlation clustering (CC), which we treat as an integer linear program (ILP). We reformulate optimization in the ILP so as to admit efficient optimization via…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Margret Keuper , Jovita Lukasik , Maneesh Singh , Julian Yarkony

We study two-stage stochastic optimization models with mixed-integer decision variables appearing in both stages. For these models, dual decomposition enables parallel computing implementation and can quickly provide a lower bound for the…

Optimization and Control · Mathematics 2026-05-15 Pengyu Zhang , Ruiwei Jiang

While mixed-integer linear programming and convex programming solvers have advanced significantly over the past several decades, solution technologies for general mixed-integer nonlinear programs (MINLPs) have yet to reach the same level of…

Optimization and Control · Mathematics 2026-04-07 Danial Davarnia , Mohammadreza Kiaghadi , Junyuan Qiu

Bilevel optimization has been widely used in decision-making process. However, there still lacks an efficient algorithm to determine an optimal solution of a bilevel optimization problem, especially for a large-size problem. To bridge the…

Optimization and Control · Mathematics 2016-05-18 Xuan Liu , Zuyi Li

Bilevel learning refers to machine learning problems that can be formulated as bilevel optimization models, where decisions are organized in a hierarchical structure. This paradigm has recently gained considerable attention in machine…

Optimization and Control · Mathematics 2026-05-05 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo , Alain Zemkoho

Quantum computing is emerging as a new computing resource that could be superior to conventional computing for certain classes of optimization problems. However, in principle, most existing approaches to quantum optimization are intended to…

Optimization and Control · Mathematics 2022-01-21 Chin-Yao Chang , Eric Jones , Yiyun Yao , Peter Graf , Rishabh Jain

Scenario-based optimization problems can be solved via Benders decomposition, which separates first-stage (master problem) decisions from second-stage (subproblem) recourse actions and iteratively refines the master problem with Benders…

Optimization and Control · Mathematics 2026-04-13 Tim Donkiewicz

Energy systems planning models identify least-cost strategies for expansion and operation of energy systems and provide decision support for investment, planning, regulation, and policy. Most are formulated as linear programming (LP) or…

Optimization and Control · Mathematics 2025-01-08 Anna Jacobson , Filippo Pecci , Nestor Sepulveda , Qingyu Xu , Jesse Jenkins

Bilevel optimization has found successful applications in various machine learning problems, including hyper-parameter optimization, data cleaning, and meta-learning. However, its huge computational cost presents a significant challenge for…

Machine Learning · Computer Science 2024-11-05 Xiaoyu Wang , Rui Pan , Renjie Pi , Jipeng Zhang

Benders' decomposition (BD) is a framework for solving optimization problems by removing some variables and modeling their contribution to the original problem via so-called Benders cuts. While many advanced optimization techniques can be…

Optimization and Control · Mathematics 2025-12-18 Christopher Hojny , Cédric Roy

Inspired by multigrid methods for linear systems of equations, multilevel optimization methods have been proposed to solve structured optimization problems. Multilevel methods make more assumptions regarding the structure of the…

Optimization and Control · Mathematics 2019-11-27 Chin Pang Ho , Michal Kocvara , Panos Parpas

The ability to differentiate through optimization problems has unlocked numerous applications, from optimization-based layers in machine learning models to complex design problems formulated as bilevel programs. It has been shown that…

Optimization and Control · Mathematics 2024-03-05 Lucas Fuentes Valenzuela , Robin Brown , Marco Pavone

We consider a problem concerning a network and a set of maintenance requests to be undertaken. We wish to schedule the maintenance in such a way as to minimise the impact on the total throughput of the network. We apply disaggregated…

Optimization and Control · Mathematics 2017-03-17 Robin H. Pearce , Michael Forbes

Classification is a fundamental task in machine learning. While conventional methods-such as binary, multiclass, and multi-label classification-are effective for simpler problems, they may not adequately address the complexities of some…

Bilevel optimization, a hierarchical mathematical framework where one optimization problem is nested within another, has emerged as a powerful tool for modeling complex decision-making processes in various fields such as economics,…

Machine Learning · Computer Science 2024-12-25 Omer Ekmekcioglu , Nursen Aydin , Juergen Branke

In recent years, a variety of gradient-based methods have been developed to solve Bi-Level Optimization (BLO) problems in machine learning and computer vision areas. However, the theoretical correctness and practical effectiveness of these…

Machine Learning · Computer Science 2022-01-04 Risheng Liu , Pan Mu , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

In the present work, a multi-scale framework for neural network enhanced methods is proposed for approximation of function and solution of partial differential equations (PDEs). By introducing the multi-scale concept, the total solution of…

Numerical Analysis · Mathematics 2022-09-07 Xiaodan Ren

The purpose of this note is to survey a methodology to solve systems of polynomial equations and inequalities. The techniques we discuss use the algebra of multivariate polynomials with coefficients over a field to create large-scale linear…

Optimization and Control · Mathematics 2011-12-08 Jesus A. De Loera , Peter N. Malkin , Pablo A. Parrilo

Benders decomposition is one of the most applied methods to solve two-stage stochastic problems (TSSP) with a large number of scenarios. The main idea behind the Benders decomposition is to solve a large problem by replacing the values of…

Optimization and Control · Mathematics 2022-11-24 Cristian Ramírez-Pico , Ivana Ljubić , Eduardo Moreno