English
Related papers

Related papers: Optimal training of integer-valued neural networks…

200 papers

Efficiently training a multi-task neural solver for various combinatorial optimization problems (COPs) has been less studied so far. Naive application of conventional multi-task learning approaches often falls short in delivering a…

Machine Learning · Computer Science 2025-05-27 Chenguang Wang , Zhang-Hua Fu , Pinyan Lu , Tianshu Yu

Today's fast linear algebra and numerical optimization tools have pushed the frontier of model predictive control (MPC) forward, to the efficient control of highly nonlinear and hybrid systems. The field of hybrid MPC has demonstrated that…

Optimization and Control · Mathematics 2020-05-11 Jia-Jie Zhu , Georg Martius

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time and when computing the parameters' gradient at train-time. We conduct two sets of experiments, each based on a…

Machine Learning · Computer Science 2016-03-11 Itay Hubara , Daniel Soudry , Ran El Yaniv

Solving constrained nonlinear optimization problems (CNLPs) is a longstanding problem that arises in various fields, e.g., economics, computer science, and engineering. We propose optimization-informed neural networks (OINN), a deep…

Optimization and Control · Mathematics 2023-06-27 Dawen Wu , Abdel Lisser

Mixed-integer linear programs (MILPs) are extensively used to model practical problems such as planning and scheduling. A prominent method for solving MILPs is large neighborhood search (LNS), which iteratively seeks improved solutions…

Optimization and Control · Mathematics 2024-12-12 Wenbo Liu , Akang Wang , Wenguo Yang , Qingjiang Shi

Deriving a good variable selection strategy in branch-and-bound is essential for the efficiency of modern mixed-integer programming (MIP) solvers. With MIP branching data collected during the previous solution process, learning to branch…

Machine Learning · Computer Science 2022-07-29 Zeren Huang , Wenhao Chen , Weinan Zhang , Chuhan Shi , Furui Liu , Hui-Ling Zhen , Mingxuan Yuan , Jianye Hao , Yong Yu , Jun Wang

Mixed Integer Linear Programs (MILP) are well known to be NP-hard (Non-deterministic Polynomial-time hard) problems in general. Even though pure optimization-based methods, such as constraint generation, are guaranteed to provide an optimal…

Optimization and Control · Mathematics 2022-07-18 Asunción Jiménez-Cordero , Juan Miguel Morales , Salvador Pineda

Conflict learning algorithms are an important component of modern MIP and CP solvers. But strong conflict information is typically gained by depth-first search. While this is the natural mode for CP solving, it is not for MIP solving. Rapid…

Optimization and Control · Mathematics 2019-02-08 Timo Berthold , Peter J. Stuckey , Jakob Witzig

Mixed-Integer Linear Programming (MILP) is a foundational tool for complex decision-making problems. However, the NP-hard nature of MILP presents a significant computational challenge, motivating the development of machine learning-based…

Optimization and Control · Mathematics 2026-03-03 Hongpei Li , Hui Yuan , Han Zhang , Jianghao Lin , Dongdong Ge , Mengdi Wang , Yinyu Ye

Integer and mixed-integer nonlinear programming (INLP, MINLP) are central to logistics, energy, and scheduling, but remain computationally challenging. This survey examines how machine learning and reinforcement learning can enhance exact…

Optimization and Control · Mathematics 2025-11-04 Morteza Kimiaei , Vyacheslav Kungurtsev , Brian Olimba

Mixup~\cite{zhang2017mixup} is a recently proposed method for training deep neural networks where additional samples are generated during training by convexly combining random pairs of images and their associated labels. While simple to…

Machine Learning · Statistics 2020-01-08 Sunil Thulasidasan , Gopinath Chennupati , Jeff Bilmes , Tanmoy Bhattacharya , Sarah Michalak

Piecewise regression is a versatile approach used in various disciplines to approximate complex functions from limited, potentially noisy data points. In control, piecewise regression is, e.g., used to approximate the optimal control law of…

Optimization and Control · Mathematics 2024-07-10 Dieter Teichrib , Moritz Schulze Darup

Physics-informed neural networks (PINNs) provide a flexible and effective alternative for estimating seismic wavefield solutions due to their typical mesh-free and unsupervised features. However, their accuracy and training cost restrict…

Geophysics · Physics 2024-01-23 Shijun Cheng , Tariq Alkhalifah

Embedding deep neural networks (NNs) into mixed-integer programs (MIPs) is attractive for decision making with learned constraints, yet state-of-the-art monolithic linearisations blow up in size and quickly become intractable. In this…

Optimization and Control · Mathematics 2025-11-13 Shuli Zeng , Sijia Zhang , Feng Wu , Shaojie Tang , Xiang-Yang Li

Mixed-integer programming (MIP) is a powerful paradigm for modeling and solving various important combinatorial optimization problems. Recently, learning-based approaches have shown a potential to speed up MIP solving via offline training…

Artificial Intelligence · Computer Science 2025-07-24 Junyang Cai , Serdar Kadioglu , Bistra Dilkina

This paper investigates multilevel initialization strategies for training very deep neural networks with a layer-parallel multigrid solver. The scheme is based on the continuous interpretation of the training problem as a problem of optimal…

Machine Learning · Computer Science 2019-12-20 Eric C. Cyr , Stefanie Günther , Jacob B. Schroder

In this paper, we investigate a neural network-based learning approach towards solving an integer-constrained programming problem using very limited training. To be specific, we introduce a symmetric and decomposed neural network structure,…

Machine Learning · Computer Science 2020-11-30 Zhou Zhou , Shashank Jere , Lizhong Zheng , Lingjia Liu

This paper presents a novel approach to the joint optimization of job scheduling and data allocation in grid computing environments. We formulate this joint optimization problem as a mixed integer quadratically constrained program. To…

Decision trees are a popular machine learning model which are traditionally trained by heuristic methods. Massive improvements in computing power and optimisation techniques has led to renewed interest in learning globally optimal decision…

Optimization and Control · Mathematics 2025-11-25 Mitchell Keegan , Michael Forbes , Paul Corry , Mahdi Abolghasemi

Over the past few decades, neuroscience experiments have become increasingly complex and naturalistic. Experimental design has in turn become more challenging, as experiments must conform to an ever-increasing diversity of design…

Neurons and Cognition · Quantitative Biology 2020-12-07 Storm Slivkoff , Jack L. Gallant