English
Related papers

Related papers: Block-Sparse Recurrent Neural Networks

200 papers

The increasing complexity of modern deep neural network models and the expanding sizes of datasets necessitate the development of optimized and scalable training methods. In this white paper, we addressed the challenge of efficiently…

Machine Learning · Computer Science 2024-04-29 Raphael Ruschel , A. S. M. Iftekhar , B. S. Manjunath , Suya You

Deepening and widening convolutional neural networks (CNNs) significantly increases the number of trainable weight parameters by adding more convolutional layers and feature maps per layer, respectively. By imposing inter- and intra-group…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Kevin Bui , Fredrick Park , Shuai Zhang , Yingyong Qi , Jack Xin

Large language models (LLMs) often struggle with strict memory, latency, and power demands. To meet these demands, various forms of dynamic sparsity have been proposed that reduce compute on an input-by-input basis. These methods improve…

Computation and Language · Computer Science 2024-04-09 Jordan Dotzel , Yash Akhauri , Ahmed S. AbouElhamayed , Carly Jiang , Mohamed Abdelfattah , Zhiru Zhang

Recurrent neural networks (RNNs) achieve cutting-edge performance on a variety of problems. However, due to their high computational and memory demands, deploying RNNs on resource constrained mobile devices is a challenging task. To…

Machine Learning · Computer Science 2018-06-12 Jie Zhang , Xiaolong Wang , Dawei Li , Yalin Wang

Artificial neural networks open up unprecedented machine learning capabilities at the cost of ever growing computational requirements. Sparsifying the parameters, often achieved through weight pruning, has been identified as a powerful…

Machine Learning · Computer Science 2024-11-28 Rishav Mukherji , Mark Schöne , Khaleelulla Khan Nazeer , Christian Mayr , Anand Subramoney

Sparse training has received an upsurging interest in machine learning due to its tantalizing saving potential for the entire training process as well as inference. Dynamic sparse training (DST), as a leading sparse training approach, can…

Machine Learning · Computer Science 2023-11-13 Lu Yin , Gen Li , Meng Fang , Li Shen , Tianjin Huang , Zhangyang Wang , Vlado Menkovski , Xiaolong Ma , Mykola Pechenizkiy , Shiwei Liu

Overparameterized Neural Networks (NN) display state-of-the-art performance. However, there is a growing need for smaller, energy-efficient, neural networks tobe able to use machine learning applications on devices with limited…

Machine Learning · Statistics 2021-05-21 Soufiane Hayou , Jean-Francois Ton , Arnaud Doucet , Yee Whye Teh

Efficient time series forecasting has become critical for real-world applications, particularly with deep neural networks (DNNs). Efficiency in DNNs can be achieved through sparse connectivity and reducing the model size. However, finding…

Machine Learning · Computer Science 2024-06-13 Zahra Atashgahi , Mykola Pechenizkiy , Raymond Veldhuis , Decebal Constantin Mocanu

Neural networks have achieved state of the art performance across a wide variety of machine learning tasks, often with large and computation-heavy models. Inducing sparseness as a way to reduce the memory and computation footprint of these…

Machine Learning · Computer Science 2022-10-21 Amir Hadifar , Johannes Deleu , Chris Develder , Thomas Demeester

Recurrent neural networks (RNNs) are central to sequence modeling tasks, yet their high computational complexity poses challenges for scalability and real-time deployment. Traditional pruning techniques, predominantly based on weight…

Neurons and Cognition · Quantitative Biology 2025-02-26 Rakesh Sengupta

Over-parameterization of deep neural networks (DNNs) has shown high prediction accuracy for many applications. Although effective, the large number of parameters hinders its popularity on resource-limited devices and has an outsize…

Machine Learning · Computer Science 2023-04-25 Shaoyi Huang , Bowen Lei , Dongkuan Xu , Hongwu Peng , Yue Sun , Mimi Xie , Caiwen Ding

Modern deep neural networks have a large number of parameters, making them very hard to train. We propose DSD, a dense-sparse-dense training flow, for regularizing deep neural networks and achieving better optimization performance. In the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-23 Song Han , Jeff Pool , Sharan Narang , Huizi Mao , Enhao Gong , Shijian Tang , Erich Elsen , Peter Vajda , Manohar Paluri , John Tran , Bryan Catanzaro , William J. Dally

We study two factors in neural network training: data parallelism and sparsity; here, data parallelism means processing training data in parallel using distributed systems (or equivalently increasing batch size), so that training can be…

Machine Learning · Computer Science 2021-04-05 Namhoon Lee , Thalaiyasingam Ajanthan , Philip H. S. Torr , Martin Jaggi

High demand for computation resources severely hinders deployment of large-scale Deep Neural Networks (DNN) in resource constrained devices. In this work, we propose a Structured Sparsity Learning (SSL) method to regularize the structures…

Neural and Evolutionary Computing · Computer Science 2016-10-19 Wei Wen , Chunpeng Wu , Yandan Wang , Yiran Chen , Hai Li

Artificial Neural Networks (NNWs) are appealing functions to substitute high dimensional and non-linear history-dependent problems in computational mechanics since they offer the possibility to drastically reduce the computational time.…

Computational Engineering, Finance, and Science · Computer Science 2023-10-11 Ling Wu , Ludovic Noels

Bayesian neural Networks (BNNs) are a promising method of obtaining statistical uncertainties for neural network predictions but with a higher computational overhead which can limit their practical usage. This work explores the use of high…

Machine Learning · Computer Science 2020-09-09 Himanshu Sharma , Elise Jennings

The human brain utilizes spikes for information transmission and dynamically reorganizes its network structure to boost energy efficiency and cognitive capabilities throughout its lifespan. Drawing inspiration from this spike-based…

Human-Computer Interaction · Computer Science 2025-02-20 Jiangrong Shen , Qi Xu , Gang Pan , Badong Chen

Sequence modeling tasks across domains such as natural language processing, time series forecasting, and control require learning complex input-output mappings. Nonlinear recurrence is theoretically required for universal approximation of…

Machine Learning · Computer Science 2026-01-13 Manuel Brenner , Georgia Koppe

Convolutional Neural Networks (CNNs) have emerged as a fundamental technology for machine learning. High performance and extreme energy efficiency are critical for deployments of CNNs in a wide range of situations, especially mobile…

Sparse training is a natural idea to accelerate the training speed of deep neural networks and save the memory usage, especially since large modern neural networks are significantly over-parameterized. However, most of the existing methods…

Machine Learning · Computer Science 2021-11-11 Xiao Zhou , Weizhong Zhang , Zonghao Chen , Shizhe Diao , Tong Zhang