English
Related papers

Related papers: Identifying Critical Neurons in ANN Architectures …

200 papers

The Critical Node Problem (CNP) is to identify a subset of nodes in a graph whose removal maximally degrades pairwise connectivity. The CNP is an important variant of the Critical Node Detection Problem (CNDP) with wide applications. Due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Biqing Fang , Hai Wan , Shaowei Cai , Zejie Cai

Modern deep learning involves training costly, highly overparameterized networks, thus motivating the search for sparser networks that can still be trained to the same accuracy as the full network (i.e. matching). Iterative magnitude…

Machine Learning · Computer Science 2022-10-07 Mansheej Paul , Feng Chen , Brett W. Larsen , Jonathan Frankle , Surya Ganguli , Gintare Karolina Dziugaite

Neural architecture search (NAS) remains a challenging problem, which is attributed to the indispensable and time-consuming component of performance estimation (PE). In this paper, we provide a novel yet systematic rethinking of PE in a…

Computer Vision and Pattern Recognition · Computer Science 2020-05-21 Xiawu Zheng , Rongrong Ji , Qiang Wang , Qixiang Ye , Zhenguo Li , Yonghong Tian , Qi Tian

Risk assessment tools in healthcare commonly employ point-based scoring systems that map patients to ordinal risk categories via thresholds. While electronic health record (EHR) data presents opportunities for data-driven optimization of…

Machine Learning · Computer Science 2026-04-20 Fardin Ganjkhanloo , Emmett Springer , Erik H. Hoyer , Daniel L. Young , Kimia Ghobadi

Mixed Integer programs (MIPs) are typically solved by the Branch-and-Bound algorithm. Recently, Learning to imitate fast approximations of the expert strong branching heuristic has gained attention due to its success in reducing the running…

Optimization and Control · Mathematics 2023-07-03 Sahil Manchanda , Sayan Ranu

We propose a hierarchical architecture for efficiently computing high-quality solutions to structured mixed-integer programs (MIPs). To reduce computational effort, our approach decouples the original problem into a higher level problem and…

Optimization and Control · Mathematics 2025-12-04 Stefan Clarke , Bartolomeo Stellato

We consider a discrete optimization formulation for learning sparse classifiers, where the outcome depends upon a linear combination of a small subset of features. Recent work has shown that mixed integer programming (MIP) can be used to…

Machine Learning · Statistics 2021-06-08 Antoine Dedieu , Hussein Hazimeh , Rahul Mazumder

Although 3D Convolutional Neural Networks (CNNs) are essential for most learning based applications involving dense 3D data, their applicability is limited due to excessive memory and computational requirements. Compressing such networks by…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Zhiwei Xu , Thalaiyasingam Ajanthan , Vibhav Vineet , Richard Hartley

While Mixed-integer linear programming (MILP) is NP-hard in general, practical MILP has received roughly 100--fold speedup in the past twenty years. Still, many classes of MILPs quickly become unsolvable as their sizes increase, motivating…

Machine Learning · Computer Science 2023-05-29 Ziang Chen , Jialin Liu , Xinshang Wang , Jianfeng Lu , Wotao Yin

Deep neural networks (DNNs) offer significant flexibility and robust performance. This makes them ideal for building not only system models but also advanced neural network controllers (NNCs). However, their high complexity and…

Machine Learning · Computer Science 2025-11-14 Ganesh Sundaram , Jonas Ulmen , Amjad Haider , Daniel Görges

Mixed Integer Linear Programs (MILPs) are essential tools for solving planning and scheduling problems across critical industries such as construction, manufacturing, and logistics. However, their widespread adoption is limited by long…

Machine Learning · Computer Science 2025-06-10 Xiaoke Wang , Batuhan Altundas , Zhaoxin Li , Aaron Zhao , Matthew Gombolay

In this paper, we explore model-based approach to training robust and interpretable binarized regression models for multiclass classification tasks using Mixed-Integer Programming (MIP). Our MIP model balances the optimization of prediction…

Machine Learning · Computer Science 2022-03-22 Sanjana Tule , Nhi Ha Lan Le , Buser Say

Deriving a good variable selection strategy in branch-and-bound is essential for the efficiency of modern mixed-integer programming (MIP) solvers. With MIP branching data collected during the previous solution process, learning to branch…

Machine Learning · Computer Science 2022-07-29 Zeren Huang , Wenhao Chen , Weinan Zhang , Chuhan Shi , Furui Liu , Hui-Ling Zhen , Mingxuan Yuan , Jianye Hao , Yong Yu , Jun Wang

Although 3D Convolutional Neural Networks are essential for most learning based applications involving dense 3D data, their applicability is limited due to excessive memory and computational requirements. Compressing such networks by…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Zhiwei Xu , Thalaiyasingam Ajanthan , Vibhav Vineet , Richard Hartley

Test Input Prioritizers (TIP) for Deep Neural Networks (DNN) are an important technique to handle the typically very large test datasets efficiently, saving computation and labeling costs. This is particularly true for large-scale, deployed…

Machine Learning · Computer Science 2022-05-25 Michael Weiss , Paolo Tonella

Binary (0-1) integer programming (BIP) is pivotal in scientific domains requiring discrete decision-making. As the advance of AI computing, recent works explore neural network-based solvers for integer linear programming (ILP) problems.…

Machine Learning · Computer Science 2025-05-28 Sen Bai , Chunqi Yang , Xin Bai , Xin Zhang , Zhengang Jiang

Mixed-integer rounding (MIR) cutting planes (cuts) are effective at improving the strength of a linear relaxation for mixed-integer linear programming (MIP) problems. The cuts in this family are derived by aggregating constraints then…

Optimization and Control · Mathematics 2024-12-16 Oscar Guaje , Arnaud Deza , Aleksandr M. Kazachkov , Elias B. Khalil

Current deep neural networks (DNNs) are overparameterized and use most of their neuronal connections during inference for each task. The human brain, however, developed specialized regions for different tasks and performs inference with a…

Machine Learning · Computer Science 2024-03-06 Aleksandr Dekhovich , David M. J. Tax , Marcel H. F. Sluiter , Miguel A. Bessa

The deployment of Artificial Neural Networks (ANNs) in safety-critical applications poses a number of new verification and certification challenges. In particular, for ANN-enabled self-driving vehicles it is important to establish…

Machine Learning · Computer Science 2017-07-06 Chih-Hong Cheng , Georg Nührenberg , Harald Ruess

Iterative magnitude pruning methods (IMPs), proven to be successful in reducing the number of insignificant nodes in over-parameterized deep neural networks (DNNs), have been getting an enormous amount of attention with the rapid deployment…

Machine Learning · Computer Science 2025-01-28 Soheil Gharatappeh , Salimeh Yasaei Sekeh