English
Related papers

Related papers: Optimal training of integer-valued neural networks…

200 papers

We consider the problem of learning optimal binary classification trees. Literature on the topic has burgeoned in recent years, motivated both by the empirical suboptimality of heuristic approaches and the tremendous improvements in…

Machine Learning · Statistics 2020-05-14 Sina Aghaei , Andres Gomez , Phebe Vayanos

Mixed Integer programs (MIPs) are typically solved by the Branch-and-Bound algorithm. Recently, Learning to imitate fast approximations of the expert strong branching heuristic has gained attention due to its success in reducing the running…

Optimization and Control · Mathematics 2023-07-03 Sahil Manchanda , Sayan Ranu

Mixed Integer Linear Programming (MILP) is a fundamental class of NP-hard problems that has garnered significant attention from both academia and industry. The Branch-and-Bound (B\&B) method is the dominant approach for solving MILPs and…

Machine Learning · Computer Science 2025-11-27 Tongkai Lu , Shuai Ma , Chongyang Tao

Designing faster algorithms for solving Mixed-Integer Linear Programming (MILP) problems is highly desired across numerous practical domains, as a vast array of complex real-world challenges can be effectively modeled as MILP formulations.…

Artificial Intelligence · Computer Science 2026-01-23 Ruizhi Liu , Liming Xu , Xulin Huang , Jingyan Sui , Shizhe Ding , Boyang Xia , Chungong Yu , Dongbo Bu

While Mixed-integer linear programming (MILP) is NP-hard in general, practical MILP has received roughly 100--fold speedup in the past twenty years. Still, many classes of MILPs quickly become unsolvable as their sizes increase, motivating…

Machine Learning · Computer Science 2023-05-29 Ziang Chen , Jialin Liu , Xinshang Wang , Jianfeng Lu , Wotao Yin

Finding a high-quality feasible solution to a combinatorial optimization (CO) problem in a limited time is challenging due to its discrete nature. Recently, there has been an increasing number of machine learning (ML) methods for addressing…

Optimization and Control · Mathematics 2023-08-02 Taehyun Yoon , Jinwon Choi , Hyokun Yun , Sungbin Lim

We present an ideal mixed-integer programming (MIP) formulation for a rectified linear unit (ReLU) appearing in a trained neural network. Our formulation requires a single binary variable and no additional continuous variables beyond the…

Optimization and Control · Mathematics 2019-03-04 Ross Anderson , Joey Huchette , Christian Tjandraatmadja , Juan Pablo Vielma

Physics-Informed Neural Networks (PINNs) are a powerful deep learning method capable of providing solutions and parameter estimations of physical systems. Given the complexity of their neural network structure, the convergence speed is…

Machine Learning · Computer Science 2025-01-28 Sirui Li , Federica Bragone , Matthieu Barreau , Kateryna Morozovska

Modern Mixed Integer Linear Programming (MILP) solvers use the Branch-and-Bound algorithm together with a plethora of auxiliary components that speed up the search. In recent years, there has been an explosive development in the use of…

Optimization and Control · Mathematics 2024-11-28 Lara Scavuzzo , Karen Aardal , Neil Yorke-Smith

Augmentation methods for mixed-integer (linear) programs are a class of primal solution approaches in which a current iterate is augmented to a better solution or proved optimal. It is well known that the performance of these methods, i.e.,…

Optimization and Control · Mathematics 2015-10-20 Pierre Le Bodic , Jeffrey W. Pavelka , Marc E. Pfetsch , Sebastian Pokutta

This paper proposes a Heaviside composite optimization approach and presents a progressive (mixed) integer programming (PIP) method for solving multi-class classification and multi-action treatment problems with constraints. A Heaviside…

Optimization and Control · Mathematics 2024-01-08 Yue Fang , Junyi Liu , Jong-Shi Pang

Inspection planning is concerned with computing the shortest robot path to inspect a given set of points of interest (POIs) using the robot's sensors. This problem arises in a wide range of applications from manufacturing to medical…

Robotics · Computer Science 2026-05-12 Adir Morgan , Kiril Solovey , Oren Salzman

Machine-learning interatomic potentials (MLIPs) such as neuroevolution potentials (NEP) combine quantum-mechanical accuracy with computational efficiency significantly accelerate atomistic dynamic simulations. Trained by derivative-free…

Disordered Systems and Neural Networks · Physics 2026-04-14 Hongfu Huang , Junhao Peng , Kaiqi Li , Jian Zhou , Zhimei Sun

In this study, we introduce an innovative deep learning framework that employs a transformer model to address the challenges of mixed-integer programs, specifically focusing on the Capacitated Lot Sizing Problem (CLSP). Our approach, to our…

Artificial Intelligence · Computer Science 2024-05-27 Joshua F. Cooper , Seung Jin Choi , I. Esra Buyuktahtakin

On-chip edge intelligence has necessitated the exploration of algorithmic techniques to reduce the compute requirements of current machine learning frameworks. This work aims to bridge the recent algorithmic progress in training Binary…

Machine Learning · Computer Science 2020-10-28 Sen Lu , Abhronil Sengupta

Making neural networks robust against adversarial inputs has resulted in an arms race between new defenses and attacks. The most promising defenses, adversarially robust training and verifiably robust training, have limitations that…

Machine Learning · Computer Science 2018-12-04 Shiqi Wang , Yizheng Chen , Ahmed Abdou , Suman Jana

This paper introduces scalable, sampling-based algorithms that optimize trained neural networks with ReLU activations. We first propose an iterative algorithm that takes advantage of the piecewise linear structure of ReLU neural networks…

Optimization and Control · Mathematics 2022-06-07 Georgia Perakis , Asterios Tsiourvas

Mixed-signal artificial neural networks (ANNs) that employ analog matrix-multiplication accelerators can achieve higher speed and improved power efficiency. Though analog computing is known to be susceptible to noise and device…

Signal Processing · Electrical Eng. & Systems 2021-07-01 Joseph Ulseth , Zheyuan Zhu , Guifang Li , Shuo Pang

Large Neighborhood Search (LNS) is a combinatorial optimization heuristic that starts with an assignment of values for the variables to be optimized, and iteratively improves it by searching a large neighborhood around the current…

Optimization and Control · Mathematics 2022-05-23 Nicolas Sonnerat , Pengming Wang , Ira Ktena , Sergey Bartunov , Vinod Nair

Binarized neural networks (BNNs) are feedforward neural networks with binary weights and activation functions. In the context of using a BNN for classification, the verification problem seeks to determine whether a small perturbation of a…

Machine Learning · Computer Science 2025-10-03 Woojin Kim , James R. Luedtke