English
Related papers

Related papers: A Mixed-Integer Programming Approach to Training D…

200 papers

We propose a supervised learning framework for computing solutions of multi-parametric Mixed Integer Linear Programs (MILPs) that arise in Model Predictive Control. Our approach also quantifies sub-optimality for the computed solutions.…

Systems and Control · Electrical Eng. & Systems 2023-03-24 Luigi Russo , Siddharth H. Nair , Luigi Glielmo , Francesco Borrelli

Artificial Neural Networks (ANNs) have received increasing attention in recent years with applications that span a wide range of disciplines including vital domains such as medicine, network security and autonomous transportation. However,…

Artificial Intelligence · Computer Science 2017-01-19 Ludvig Ericson , Rendani Mbuvha

Compared to classical deep neural networks its binarized versions can be useful for applications on resource-limited devices due to their reduction in memory consumption and computational demands. In this work we study deep neural networks…

Optimization and Control · Mathematics 2021-10-26 Jannis Kurtz , Bubacarr Bah

The process of training a deep neural network is characterized by significant time requirements and associated costs. Although researchers have made considerable progress in this area, further work is still required due to resource…

Machine Learning · Computer Science 2023-12-29 Sahil Nokhwal , Priyanka Chilakalapudi , Preeti Donekal , Suman Nokhwal , Saurabh Pahune , Ankit Chaudhary

Machine learning is increasingly used to improve decisions within branch-and-bound algorithms for mixed-integer programming. Many existing approaches rely on deep learning, which often requires very large training datasets and substantial…

Machine Learning · Computer Science 2026-04-02 Selin Bayramoğlu , George L Nemhauser , Nikolaos V Sahinidis

We present a novel deep learning-based algorithm to accelerate - through the use of Artificial Neural Networks (ANNs) - the convergence of Algebraic Multigrid (AMG) methods for the iterative solution of the linear systems of equations…

Numerical Analysis · Mathematics 2025-06-18 Paola F. Antonietti , Matteo Caldana , Luca Dede'

Many approaches for verifying input-output properties of neural networks have been proposed recently. However, existing algorithms do not scale well to large networks. Recent work in the field of model compression studied binarized neural…

Machine Learning · Computer Science 2022-03-15 Christopher Lazarus , Mykel J. Kochenderfer

In this paper, we describe a novel unsupervised learning scheme for accelerating the solution of a family of mixed integer programming (MIP) problems. Distinct substantially from existing learning-to-optimize methods, our proposal seeks to…

Optimization and Control · Mathematics 2024-12-25 Shiyuan Qu , Fenglian Dong , Zhiwei Wei , Chao Shang

Mixed Integer Linear Programming (MILP) is a pillar of mathematical optimization that offers a powerful modeling language for a wide range of applications. During the past decades, enormous algorithmic progress has been made in solving…

Optimization and Control · Mathematics 2024-02-09 Lara Scavuzzo , Karen Aardal , Andrea Lodi , Neil Yorke-Smith

Mixed Integer Linear Programming (MILP) is essential for modeling complex decision-making problems but faces challenges in computational tractability and requires expert formulation. Current deep learning approaches for MILP focus on…

Machine Learning · Computer Science 2025-02-24 Sirui Li , Janardhan Kulkarni , Ishai Menache , Cathy Wu , Beibin Li

Large Neighborhood Search (LNS) is a combinatorial optimization heuristic that starts with an assignment of values for the variables to be optimized, and iteratively improves it by searching a large neighborhood around the current…

Optimization and Control · Mathematics 2022-05-23 Nicolas Sonnerat , Pengming Wang , Ira Ktena , Sergey Bartunov , Vinod Nair

With the continued innovations of deep neural networks, spiking neural networks (SNNs) that more closely resemble biological brain synapses have attracted attention owing to their low power consumption.However, for continuous data values,…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Naoya Muramatsu , Hai-Tao Yu

Synthetic data has emerged as a cost-effective alternative to real data for training artificial neural networks (ANN). However, the disparity between synthetic and real data results in a domain gap. That gap leads to poor performance and…

Machine Learning · Computer Science 2025-09-03 Paul Wachter , Lukas Niehaus , Julius Schöning

Artificial neural networks (ANNs) are essential tools in machine learning that have drawn increasing attention in neuroscience. Besides offering powerful techniques for data analysis, ANNs provide a new approach for neuroscientists to build…

Neurons and Cognition · Quantitative Biology 2020-09-25 Guangyu Robert Yang , Xiao-Jing Wang

Mixed Integer Linear Programs (MILP) are well known to be NP-hard (Non-deterministic Polynomial-time hard) problems in general. Even though pure optimization-based methods, such as constraint generation, are guaranteed to provide an optimal…

Optimization and Control · Mathematics 2022-07-18 Asunción Jiménez-Cordero , Juan Miguel Morales , Salvador Pineda

Attentive Neural Process (ANP) improves the fitting ability of Neural Process (NP) and improves its prediction accuracy, but the higher time complexity of the model imposes a limitation on the length of the input sequence. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Xiaohan Yu , Shaochen Mao

Trained ML models are commonly embedded in optimization problems. In many cases, this leads to large-scale NLPs that are difficult to solve to global optimality. While ML models frequently lead to large problems, they also exhibit…

Optimization and Control · Mathematics 2024-01-17 Artur M. Schweidtmann , Dominik Bongartz , Alexander Mitsos

Mixed-Integer Linear Programs (MIPs) are powerful and flexible tools for modeling a wide range of real-world combinatorial optimization problems. Predict-and-Search methods operate by using a predictive model to estimate promising variable…

Artificial Intelligence · Computer Science 2026-04-21 Junyang Cai , El Mehdi Er Raqabi , Pascal Van Hentenryck , Bistra Dilkina

Neural networks have proven practical for a synergistic combination of advanced control techniques. This work analyzes the implementation of rectified linear unit neural networks to achieve constrained control in differentially flat…

Systems and Control · Electrical Eng. & Systems 2026-04-06 Huu-Thinh Do , Ionela Prodan , Florin Stoican

Mixed Integer Programming (MIP) is one of the most widely used modeling techniques for combinatorial optimization problems. In many applications, a similar MIP model is solved on a regular basis, maintaining remarkable similarities in model…

Artificial Intelligence · Computer Science 2019-09-10 Jian-Ya Ding , Chao Zhang , Lei Shen , Shengyin Li , Bing Wang , Yinghui Xu , Le Song