English
Related papers

Related papers: Optimal training of integer-valued neural networks…

200 papers

In this paper, we propose a Bi-layer Predictionbased Reduction Branch (BP-RB) framework to speed up the process of finding a high-quality feasible solution for Mixed Integer Programming (MIP) problems. A graph convolutional network (GCN) is…

Optimization and Control · Mathematics 2022-09-28 Lingying Huang , Xiaomeng Chen , Wei Huo , Jiazheng Wang , Fan Zhang , Bo Bai , Ling Shi

There is a recent focus on designing architectures that have an Integer Linear Programming (ILP) layer within a neural model (referred to as Neural ILP in this paper). Neural ILP architectures are suitable for pure reasoning tasks that…

Machine Learning · Computer Science 2023-01-16 Yatin Nandwani , Rishabh Ranjan , Mausam , Parag Singla

This paper proposes a novel primal heuristic for Mixed Integer Programs, by employing machine learning techniques. Mixed Integer Programming is a general technique for formulating combinatorial optimization problems. Inside a solver, primal…

Artificial Intelligence · Computer Science 2021-07-05 Yunzhuang Shen , Yuan Sun , Andrew Eberhard , Xiaodong Li

Spiking neural networks (SNNs) have achieved orders of magnitude improvement in terms of energy consumption and latency when performing inference with deep learning workloads. Error backpropagation is presently regarded as the most…

Machine learning interatomic potentials (MLIPs) enable efficient molecular dynamics (MD) simulations with ab initio accuracy and have been applied across various domains in physical science. However, their performance often relies on…

Computational Physics · Physics 2025-07-29 Taoyong Cui , Zhongyao Wang , Dongzhan Zhou , Yuqiang Li , Lei Bai , Wanli Ouyang , Mao Su , Shufei Zhang

The process of training a deep neural network is characterized by significant time requirements and associated costs. Although researchers have made considerable progress in this area, further work is still required due to resource…

Machine Learning · Computer Science 2023-12-29 Sahil Nokhwal , Priyanka Chilakalapudi , Preeti Donekal , Suman Nokhwal , Saurabh Pahune , Ankit Chaudhary

Interpretation of Deep Neural Networks (DNNs) training as an optimal control problem with nonlinear dynamical systems has received considerable attention recently, yet the algorithmic development remains relatively limited. In this work, we…

Machine Learning · Computer Science 2021-06-14 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

In line with the growing trend of using machine learning to help solve combinatorial optimisation problems, one promising idea is to improve node selection within a mixed integer programming (MIP) branch-and-bound tree by using a learned…

Neural and Evolutionary Computing · Computer Science 2022-01-05 Kaan Yilmaz , Neil Yorke-Smith

Mixed Integer Linear Programming (MILP) is essential for modeling complex decision-making problems but faces challenges in computational tractability and requires expert formulation. Current deep learning approaches for MILP focus on…

Machine Learning · Computer Science 2025-02-24 Sirui Li , Janardhan Kulkarni , Ishai Menache , Cathy Wu , Beibin Li

This applied research article explores the application of Mixed-Integer Linear Programming (MILP) to address line-balancing challenges in the garment industry, focusing on optimizing production processes under multiple constraints. By…

Optimization and Control · Mathematics 2025-04-10 Ray Wai Man Kong , Ding Ning , Theodore Ho Tin Kong

In recent years, deep learning methods have been extensively developed for inverse imaging problems (IIPs), encompassing supervised, self-supervised, and generative approaches. Most of these methods require large amounts of labeled or…

Image and Video Processing · Electrical Eng. & Systems 2025-12-04 Ismail Alkhouri , Evan Bell , Avrajit Ghosh , Shijun Liang , Rongrong Wang , Saiprasad Ravishankar

Neural networks have demonstrated considerable success on a wide variety of real-world problems. However, networks trained only to optimize for training accuracy can often be fooled by adversarial examples - slightly perturbed inputs that…

Machine Learning · Computer Science 2019-02-19 Vincent Tjeng , Kai Xiao , Russ Tedrake

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

Machine Learning · Computer Science 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister

GPUs have been favored for training deep learning models due to their highly parallelized architecture. As a result, most studies on training optimization focus on GPUs. There is often a trade-off, however, between cost and efficiency when…

We propose a hierarchical architecture for efficiently computing high-quality solutions to structured mixed-integer programs (MIPs). To reduce computational effort, our approach decouples the original problem into a higher level problem and…

Optimization and Control · Mathematics 2025-12-04 Stefan Clarke , Bartolomeo Stellato

The trade-off between computation time and path optimality is a key consideration in motion planning algorithms. While classical sampling based algorithms fall short of computational efficiency in high dimensional planning, learning based…

Robotics · Computer Science 2023-09-21 Yinghan Wang , Xiaoming Duan , Jianping He

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time. At training-time the binary weights and activations are used for computing the parameters gradients. During…

Machine Learning · Computer Science 2016-03-18 Matthieu Courbariaux , Itay Hubara , Daniel Soudry , Ran El-Yaniv , Yoshua Bengio

Like masked language modeling (MLM) in natural language processing, masked image modeling (MIM) aims to extract valuable insights from image patches to enhance the feature extraction capabilities of the underlying deep neural network (DNN).…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yixuan Luo , Mengye Ren , Sai Qian Zhang

Standard decoding approaches rely on model-based channel estimation methods to compensate for varying channel effects, which degrade in performance whenever there is a model mismatch. Recently proposed Deep learning based neural decoders…

Signal Processing · Electrical Eng. & Systems 2019-03-07 Yihan Jiang , Hyeji Kim , Himanshu Asnani , Sreeram Kannan

Optimal planning with respect to learned neural network (NN) models in continuous action and state spaces using mixed-integer linear programming (MILP) is a challenging task for branch-and-bound solvers due to the poor linear relaxation of…

Artificial Intelligence · Computer Science 2019-07-29 Buser Say , Scott Sanner , Sylvie Thiébaux
‹ Prev 1 3 4 5 6 7 10 Next ›