English
Related papers

Related papers: Pruning Early Exit Networks

200 papers

Pruning is a well-established technique for removing unnecessary structure from neural networks after training to improve the performance of inference. Several recent results have explored the possibility of pruning at initialization time…

Machine Learning · Computer Science 2020-09-29 Jonathan Frankle , Gintare Karolina Dziugaite , Daniel M. Roy , Michael Carbin

We propose a new formulation for pruning convolutional kernels in neural networks to enable efficient inference. We interleave greedy criteria-based pruning with fine-tuning by backpropagation - a computationally efficient procedure that…

Machine Learning · Computer Science 2017-06-12 Pavlo Molchanov , Stephen Tyree , Tero Karras , Timo Aila , Jan Kautz

We develop a fast end-to-end method for training lightweight neural networks using multiple classifier heads. By allowing the model to determine the importance of each head and rewarding the choice of a single shallow classifier, we are…

Machine Learning · Computer Science 2020-04-20 Bartosz Wójcik , Maciej Wołczyk , Klaudia Bałazy , Jacek Tabor

Deep neural networks have become larger over the years with increasing demand of computational resources for inference; incurring exacerbate costs and leaving little room for deployment on devices with limited battery and other resources…

Machine Learning · Computer Science 2021-09-28 Aaqib Saeed

Real time application of deep learning algorithms is often hindered by high computational complexity and frequent memory accesses. Network pruning is a promising technique to solve this problem. However, pruning usually results in irregular…

Neural and Evolutionary Computing · Computer Science 2015-12-31 Sajid Anwar , Kyuyeon Hwang , Wonyong Sung

Training advanced machine learning models demands massive datasets, resulting in prohibitive computational costs. To address this challenge, data pruning techniques identify and remove redundant training samples while preserving model…

Machine Learning · Computer Science 2025-06-23 Sebastian Schmidt , Prasanga Dhungel , Christoffer Löffler , Björn Nieth , Stephan Günnemann , Leo Schwinn

Structured pruning is a popular method to reduce the cost of convolutional neural networks, that are the state of the art in many computer vision tasks. However, depending on the architecture, pruning introduces dimensional discrepancies…

Neural and Evolutionary Computing · Computer Science 2022-12-13 Hugo Tessier , Vincent Gripon , Mathieu Léonardon , Matthieu Arzel , David Bertrand , Thomas Hannagan

The increasing complexity of advanced machine learning models requires innovative approaches to manage computational resources effectively. One such method is the Early Exit strategy, which allows for adaptive computation by providing a…

Machine Learning · Statistics 2025-11-07 Florian Valade , Mohamed Hebiri , Paul Gay

This paper presents a method for adding multiple tasks to a single deep neural network while avoiding catastrophic forgetting. Inspired by network pruning techniques, we exploit redundancies in large deep networks to free up parameters that…

Computer Vision and Pattern Recognition · Computer Science 2018-05-15 Arun Mallya , Svetlana Lazebnik

We propose a simultaneous learning and pruning algorithm capable of identifying and eliminating irrelevant structures in a neural network during the early stages of training. Thus, the computational cost of subsequent training iterations,…

Machine Learning · Computer Science 2023-01-16 Valentin Frank Ingmar Guenter , Athanasios Sideris

Deep neural networks are typically too computationally expensive to run in real-time on consumer-grade hardware and low-powered devices. In this paper, we investigate reducing the computational and memory requirements of neural networks…

Machine Learning · Computer Science 2020-01-15 Kimessha Paupamah , Steven James , Richard Klein

Deep neural networks have been the predominant paradigm in machine learning for solving cognitive tasks. Such models, however, are restricted by a high computational overhead, limiting their applicability and hindering advancements in the…

Machine Learning · Computer Science 2024-11-05 Ian Pons , Bruno Yamamoto , Anna H. Reali Costa , Artur Jordao

Deep learning models have been widely used during the last decade due to their outstanding learning and abstraction capacities. However, one of the main challenges any scientist has to face using deep learning models is to establish the…

Machine Learning · Computer Science 2025-04-22 Luis Balderas , Miguel Lastra , José M. Benítez

The over-parametrized nature of Deep Neural Networks leads to considerable hindrances during deployment on low-end devices with time and space constraints. Network pruning strategies that sparsify DNNs using iterative prune-train schemes…

Machine Learning · Computer Science 2022-08-09 Arvind Subramaniam , Avinash Sharma

The learning capability of a neural network improves with increasing depth at higher computational costs. Wider layers with dense kernel connectivity patterns furhter increase this cost and may hinder real-time inference. We propose feature…

Machine Learning · Computer Science 2016-11-01 Sajid Anwar , Wonyong Sung

We propose Cluster Pruning (CUP) for compressing and accelerating deep neural networks. Our approach prunes similar filters by clustering them based on features derived from both the incoming and outgoing weight connections. With CUP, we…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Rahul Duggal , Cao Xiao , Richard Vuduc , Jimeng Sun

Many Neural Network Pruning approaches consist of several iterative training and pruning steps, seemingly losing a significant amount of their performance after pruning and then recovering it in the subsequent retraining phase. Recent works…

Machine Learning · Computer Science 2023-03-14 Max Zimmer , Christoph Spiegel , Sebastian Pokutta

Recent advancements have scaled neural networks to unprecedented sizes, achieving remarkable performance across a wide range of tasks. However, deploying these large-scale models on resource-constrained devices poses significant challenges…

Machine Learning · Computer Science 2024-10-22 Mostafa Hussien , Mahmoud Afifi , Kim Khoa Nguyen , Mohamed Cheriet

With the successful application of deep learning in communications systems, deep neural networks are becoming the preferred method for signal classification. Although these models yield impressive results, they often come with high…

Machine Learning · Computer Science 2024-06-13 Yao Lu , Yutao Zhu , Yuqi Li , Dongwei Xu , Yun Lin , Qi Xuan , Xiaoniu Yang

Recent work has explored the possibility of pruning neural networks at initialization. We assess proposals for doing so: SNIP (Lee et al., 2019), GraSP (Wang et al., 2020), SynFlow (Tanaka et al., 2020), and magnitude pruning. Although…

Machine Learning · Computer Science 2021-03-23 Jonathan Frankle , Gintare Karolina Dziugaite , Daniel M. Roy , Michael Carbin