English
Related papers

Related papers: SIMD-size aware weight regularization for fast neu…

200 papers

Regularization has long been utilized to learn sparsity in deep neural network pruning. However, its role is mainly explored in the small penalty strength regime. In this work, we extend its application to a new scenario where the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Huan Wang , Can Qin , Yulun Zhang , Yun Fu

Network pruning can reduce the high computation cost of deep neural network (DNN) models. However, to maintain their accuracies, sparse models often carry randomly-distributed weights, leading to irregular computations. Consequently, sparse…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-01 Cong Guo , Bo Yang Hsueh , Jingwen Leng , Yuxian Qiu , Yue Guan , Zehuan Wang , Xiaoying Jia , Xipeng Li , Minyi Guo , Yuhao Zhu

Compressing Deep Neural Network (DNN) models to alleviate the storage and computation requirements is essential for practical applications, especially for resource limited devices. Although capable of reducing a reasonable amount of model…

Machine Learning · Computer Science 2021-06-17 Sheng Lin , Wei Jiang , Wei Wang , Kaidi Xu , Yanzhi Wang , Shan Liu , Songnan Li

Neural networks achieve state-of-the-art performance in image classification, speech recognition, scientific analysis and many more application areas. Due to the high computational complexity and memory footprint of neural networks, various…

Hardware Architecture · Computer Science 2025-04-21 Benjamin Ramhorst , Vladimir Loncar , George A. Constantinides

We propose and evaluate new techniques for compressing and speeding up dense matrix multiplications as found in the fully connected and recurrent layers of neural networks for embedded large vocabulary continuous speech recognition (LVCSR).…

Machine Learning · Computer Science 2018-02-07 Markus Kliegl , Siddharth Goyal , Kexin Zhao , Kavya Srinet , Mohammad Shoeybi

Modern deep neural networks (DNNs) often require high memory consumption and large computational loads. In order to deploy DNN algorithms efficiently on edge or mobile devices, a series of DNN compression algorithms have been explored,…

Machine Learning · Computer Science 2020-04-21 Huanrui Yang , Minxue Tang , Wei Wen , Feng Yan , Daniel Hu , Ang Li , Hai Li , Yiran Chen

Introduced in the late 1980s for generalization purposes, pruning has now become a staple for compressing deep neural networks. Despite many innovations in recent decades, pruning approaches still face core issues that hinder their…

Neural and Evolutionary Computing · Computer Science 2022-03-10 Hugo Tessier , Vincent Gripon , Mathieu Léonardon , Matthieu Arzel , Thomas Hannagan , David Bertrand

The rapidly growing parameter volume of deep neural networks (DNNs) hinders the artificial intelligence applications on resource constrained devices, such as mobile and wearable devices. Neural network pruning, as one of the mainstream…

Machine Learning · Computer Science 2019-11-21 Ao Ren , Tao Zhang , Yuhao Wang , Sheng Lin , Peiyan Dong , Yen-kuang Chen , Yuan Xie , Yanzhi Wang

Accelerating DNN execution on various resource-limited computing platforms has been a long-standing problem. Prior works utilize l1-based group lasso or dynamic regularization such as ADMM to perform structured pruning on DNN models to…

Machine Learning · Computer Science 2020-02-25 Xiaolong Ma , Zhengang Li , Yifan Gong , Tianyun Zhang , Wei Niu , Zheng Zhan , Pu Zhao , Jian Tang , Xue Lin , Bin Ren , Yanzhi Wang

We study channel number reduction in combination with weight binarization (1-bit weight precision) to trim a convolutional neural network for a keyword spotting (classification) task. We adopt a group-wise splitting method based on the…

Machine Learning · Computer Science 2019-09-13 Jiancheng Lyu , Spencer Sheen

Deep Neural Network (DNN) is powerful but computationally expensive and memory intensive, thus impeding its practical usage on resource-constrained front-end devices. DNN pruning is an approach for deep model compression, which aims at…

Machine Learning · Computer Science 2019-10-28 Xiaohan Ding , Guiguang Ding , Xiangxin Zhou , Yuchen Guo , Jungong Han , Ji Liu

Artificial neural networks (ANNs) may not be worth their computational/memory costs when used in mobile phones or embedded devices. Parameter-pruning algorithms combat these costs, with some algorithms capable of removing over 90% of an…

Machine Learning · Statistics 2018-05-08 Brian Bartoldson , Adrian Barbu , Gordon Erlebacher

With the rapid scaling up of deep neural networks (DNNs), extensive research studies on network model compression such as weight pruning have been performed for improving deployment efficiency. This work aims to advance the compression…

Machine Learning · Computer Science 2019-09-16 Qing Yang , Wei Wen , Zuoguan Wang , Hai Li

Structural neural network pruning aims to remove the redundant channels in the deep convolutional neural networks (CNNs) by pruning the filters of less importance to the final output accuracy. To reduce the degradation of performance after…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Nanfei Jiang , Xu Zhao , Chaoyang Zhao , Yongqi An , Ming Tang , Jinqiao Wang

We propose a novel regularization method, called \textit{volumization}, for neural networks. Inspired by physics, we define a physical volume for the weight parameters in neural networks, and we show that this method is an effective way of…

Machine Learning · Computer Science 2020-04-02 Liu Ziyin , Zihao Wang , Makoto Yamada , Masahito Ueda

While deep neural networks (DNNs) have proven to be efficient for numerous tasks, they come at a high memory and computation cost, thus making them impractical on resource-limited devices. However, these networks are known to contain a…

Neural and Evolutionary Computing · Computer Science 2020-07-21 Anthony Berthelier , Yongzhe Yan , Thierry Chateau , Christophe Blanc , Stefan Duffner , Christophe Garcia

Towards fast, hardware-efficient, and low-complexity receivers, we propose a compression-aware learning approach and examine it on free-space optical (FSO) receivers for turbulence mitigation. The learning approach jointly quantize, prune,…

Signal Processing · Electrical Eng. & Systems 2026-01-13 Mohanad Obeed , Ming Jian

Pruning methods have shown to be effective at reducing the size of deep neural networks while keeping accuracy almost intact. Among the most effective methods are those that prune a network while training it with a sparsity prior loss and…

Neural and Evolutionary Computing · Computer Science 2019-12-20 Carl Lemaire , Andrew Achkar , Pierre-Marc Jodoin

This work is focused on the pruning of some convolutional neural networks (CNNs) and improving theirs efficiency on graphic processing units (GPU) by using a direct sparse algorithm. The Nvidia deep neural network (cuDnn) library is the…

Machine Learning · Computer Science 2022-08-30 Marcin Pietroń , Dominik Żurek

Synaptic pruning in biological brains removes weak connections to improve efficiency. In contrast, dropout regularization in artificial neural networks randomly deactivates neurons without considering activity-dependent pruning. We propose…

Machine Learning · Computer Science 2025-10-07 Gideon Vos , Liza van Eijk , Zoltan Sarnyai , Mostafa Rahimi Azghadi