English
Related papers

Related papers: Scalable Mixed-Integer Optimization with Neural Co…

200 papers

Over the past decade, decision diagrams (DDs) have been used to model and solve integer programming and combinatorial optimization problems. Despite successful performance of DDs in solving various discrete optimization problems, their…

Optimization and Control · Mathematics 2024-03-27 Hosseinali Salemi , Danial Davarnia

We address the solution of Mixed Integer Linear Programming (MILP) models with strong relaxations that are derived from Dantzig-Wolfe decompositions and allow a pseudo-polynomial pricing algorithm. We exploit their network-flow…

Optimization and Control · Mathematics 2021-06-01 Vinícius L. de Lima , Manuel Iori , Flávio K. Miyazawa

We propose a dual dynamic integer programming (DDIP) framework for solving multi-scale mixed-integer model predictive control (MPC) problems. Such problems arise in applications that involve long horizons and/or fine temporal…

Optimization and Control · Mathematics 2020-07-21 Ranjeet Kumar , Michael J. Wenzel , Mohammad N. ElBsat , Michael J. Risbeck , Kirk H. Drees , Victor M. Zavala

We optimize pipeline parallelism for deep neural network (DNN) inference by partitioning model graphs into $k$ stages and minimizing the running time of the bottleneck stage, including communication. We give practical and effective…

Machine Learning · Computer Science 2024-06-05 Aaron Archer , Matthew Fahrbach , Kuikui Liu , Prakash Prabhu

Scaling model capacity has been vital in the success of deep learning. For a typical network, necessary compute resources and training time grow dramatically with model size. Conditional computation is a promising way to increase the number…

Machine Learning · Computer Science 2018-11-14 Louis Kirsch , Julius Kunze , David Barber

In this paper, we study multistage stochastic mixed-integer nonlinear programs (MS-MINLP). This general class of problems encompasses, as important special cases, multistage stochastic convex optimization with non-Lipschitzian value…

Optimization and Control · Mathematics 2022-05-23 Shixuan Zhang , Xu Andy Sun

We introduce a mixed integer program (MIP) for assigning importance scores to each neuron in deep neural network architectures which is guided by the impact of their simultaneous pruning on the main learning task of the network. By…

Machine Learning · Computer Science 2023-07-26 Mostafa ElAraby , Guy Wolf , Margarida Carvalho

Two-stage stochastic programming (2SP) offers a basic framework for modelling decision-making under uncertainty, yet scalability remains a challenge due to the computational complexity of recourse function evaluation. Existing…

Optimization and Control · Mathematics 2026-04-24 Yu Liu , Fabricio Oliveira , Jan Kronqvist

In this paper, we explore model-based approach to training robust and interpretable binarized regression models for multiclass classification tasks using Mixed-Integer Programming (MIP). Our MIP model balances the optimization of prediction…

Machine Learning · Computer Science 2022-03-22 Sanjana Tule , Nhi Ha Lan Le , Buser Say

In this paper, we describe a novel unsupervised learning scheme for accelerating the solution of a family of mixed integer programming (MIP) problems. Distinct substantially from existing learning-to-optimize methods, our proposal seeks to…

Optimization and Control · Mathematics 2024-12-25 Shiyuan Qu , Fenglian Dong , Zhiwei Wei , Chao Shang

Tight and efficient neural network bounding is crucial to the scaling of neural network verification systems. Many efficient bounding algorithms have been presented recently, but they are often too loose to verify more challenging…

Machine Learning · Computer Science 2024-02-27 Alessandro De Palma , Harkirat Singh Behl , Rudy Bunel , Philip H. S. Torr , M. Pawan Kumar

We address the optimal design of a large scale multi-agent system where each agent has discrete and/or continuous decision variables that need to be set so as to optimize the sum of linear local cost functions, in presence of linear local…

Optimization and Control · Mathematics 2017-06-28 Alessandro Falsone , Kostas Margellos , Maria Prandini

Conventional solvers are often computationally expensive for constrained optimization, particularly in large-scale and time-critical problems. While this leads to a growing interest in using neural networks (NNs) as fast optimal solution…

Optimization and Control · Mathematics 2024-09-24 Minsoo Kim , Hongseok Kim

While Mixed-integer linear programming (MILP) is NP-hard in general, practical MILP has received roughly 100--fold speedup in the past twenty years. Still, many classes of MILPs quickly become unsolvable as their sizes increase, motivating…

Machine Learning · Computer Science 2023-05-29 Ziang Chen , Jialin Liu , Xinshang Wang , Jianfeng Lu , Wotao Yin

An important problem in optimization is the construction of mixed-integer programming (MIP) formulations of disjunctive constraints that are both strong and small. Motivated by lower bounds on the number of integer variables that are…

Optimization and Control · Mathematics 2017-12-05 Joey Huchette , Juan Pablo Vielma

In many operational contexts, solutions to NP-hard combinatorial optimization problems, modeled by means of Mixed-Integer Linear Programming (MILP), may become infeasible due to unpredictable disruptions. Typically, reoptimizing by solving…

Optimization and Control · Mathematics 2026-05-27 Mathieu Lerouge , Andrea Lodi , Enrico Malaguti , Michele Monaci , Filippo Focacci

In this paper, we describe a comprehensive algorithmic framework for solving mixed integer bilevel linear optimization problems (MIBLPs) using a generalized branch-and-cut approach. The framework presented merges features from existing…

Optimization and Control · Mathematics 2021-04-20 Sahar Tahernejad , Ted K. Ralphs , Scott T. DeNegre

Many probabilistic inference tasks involve summations over exponentially large sets. Recently, it has been shown that these problems can be reduced to solving a polynomial number of MAP inference queries for a model augmented with randomly…

Artificial Intelligence · Computer Science 2013-09-27 Stefano Ermon , Carla P. Gomes , Ashish Sabharwal , Bart Selman

Large Neighborhood Search (LNS) is a combinatorial optimization heuristic that starts with an assignment of values for the variables to be optimized, and iteratively improves it by searching a large neighborhood around the current…

Optimization and Control · Mathematics 2022-05-23 Nicolas Sonnerat , Pengming Wang , Ira Ktena , Sergey Bartunov , Vinod Nair

Binary (0-1) integer programming (BIP) is pivotal in scientific domains requiring discrete decision-making. As the advance of AI computing, recent works explore neural network-based solvers for integer linear programming (ILP) problems.…

Machine Learning · Computer Science 2025-05-28 Sen Bai , Chunqi Yang , Xin Bai , Xin Zhang , Zhengang Jiang