English
Related papers

Related papers: DeepRebirth: Accelerating Deep Neural Network Exec…

200 papers

This paper presents a comprehensive evaluation of lightweight deep learning models for image classification, emphasizing their suitability for deployment in resource-constrained environments such as low-memory devices. Five state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Tasnim Shahriar

Besides accuracy, the model size of convolutional neural networks (CNN) models is another important factor considering limited hardware resources in practical applications. For example, employing deep neural networks on mobile systems…

Machine Learning · Computer Science 2021-07-05 Huixin Zhan , Wei-Ming Lin , Yongcan Cao

Recent breakthroughs in deep learning and artificial intelligence technologies have enabled numerous mobile applications. While traditional computation paradigms rely on mobile sensing and cloud computing, deep learning implemented on…

Machine Learning · Computer Science 2019-04-22 Yunbin Deng

Though recent years have witnessed remarkable progress in single image super-resolution (SISR) tasks with the prosperous development of deep neural networks (DNNs), the deep learning methods are confronted with the computation and memory…

Image and Video Processing · Electrical Eng. & Systems 2023-02-15 Zheng Zhan , Yifan Gong , Pu Zhao , Geng Yuan , Wei Niu , Yushu Wu , Tianyun Zhang , Malith Jayaweera , David Kaeli , Bin Ren , Xue Lin , Yanzhi Wang

While deep neural networks have been shown in recent years to outperform other machine learning methods in a wide range of applications, one of the biggest challenges with enabling deep neural networks for widespread deployment on edge…

Neural and Evolutionary Computing · Computer Science 2017-11-21 Mohammad Javad Shafiee , Francis Li , Brendan Chwyl , Alexander Wong

Neural networks are both computationally intensive and memory intensive, making them difficult to deploy on embedded systems with limited hardware resources. To address this limitation, we introduce "deep compression", a three stage…

Computer Vision and Pattern Recognition · Computer Science 2016-02-16 Song Han , Huizi Mao , William J. Dally

Deep neural networks (DNNs) have recently achieved great success in many visual recognition tasks. However, existing deep neural network models are computationally expensive and memory intensive, hindering their deployment in devices with…

Machine Learning · Computer Science 2020-06-16 Yu Cheng , Duo Wang , Pan Zhou , Tao Zhang

To address the challenge of increasing network size, researchers have developed sparse models through network pruning. However, maintaining model accuracy while achieving significant speedups on general computing devices remains an open…

Artificial Intelligence · Computer Science 2023-10-31 Haitao Xu , Songwei Liu , Yuyang Xu , Shuai Wang , Jiashi Li , Chenqian Yan , Liangqiang Li , Lean Fu , Xin Pan , Fangmin Chen

In the wake of the success of convolutional neural networks in image classification, object recognition, speech recognition, etc., the demand for deploying these compute-intensive ML models on embedded and mobile systems with tight power…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Lukas Cavigelli , Georg Rutishauser , Luca Benini

Convolutional neural networks show outstanding results in a variety of computer vision tasks. However, a neural network architecture design usually faces a trade-off between model performance and computational/memory complexity. For some…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Pavel Kaloshin

Machine learning at the edge offers great benefits such as increased privacy and security, low latency, and more autonomy. However, a major challenge is that many devices, in particular edge devices, have very limited memory, weak…

Machine Learning · Computer Science 2019-09-05 Yang Li , Thomas Strohmer

Deploying trained convolutional neural networks (CNNs) to mobile devices is a challenging task because of the simultaneous requirements of the deployed model to be fast, lightweight and accurate. Designing and training a CNN architecture…

Machine Learning · Computer Science 2019-12-02 Ramit Pahwa , Manoj Ghuhan Arivazhagan , Ankur Garg , Siddarth Krishnamoorthy , Rohit Saxena , Sunav Choudhary

As the industry deploys increasingly large and complex neural networks to mobile devices, more pressure is put on the memory and compute resources of those devices. Deep compression, or compression of deep neural network weight matrices, is…

Machine Learning · Computer Science 2018-02-21 Matthew Sotoudeh , Sara S. Baghsorkhi

Despite the success of deep neural networks (DNNs), state-of-the-art models are too large to deploy on low-resource devices or common server configurations in which multiple models are held in memory. Model compression methods address this…

Recent breakthroughs in Deep Neural Networks (DNNs) have fueled a tremendously growing demand for bringing DNN-powered intelligence into mobile platforms. While the potential of deploying DNNs on resource-constrained platforms has been…

Machine Learning · Computer Science 2020-06-09 Sicong Liu , Junzhao Du , Kaiming Nan , ZimuZhou , Atlas Wang , Yingyan Lin

We demonstrate the possibility of what we call sparse learning: accelerated training of deep neural networks that maintain sparse weights throughout training while achieving dense performance levels. We accomplish this by developing sparse…

Machine Learning · Computer Science 2019-08-27 Tim Dettmers , Luke Zettlemoyer

We present novel techniques to accelerate the convergence of Deep Learning algorithms by conducting low overhead removal of redundant neurons -- apoptosis of neurons -- which do not contribute to model learning, during the training phase…

Neural and Evolutionary Computing · Computer Science 2016-10-05 Charles Siegel , Jeff Daily , Abhinav Vishnu

Model compression is a critical technique to efficiently deploy neural network models on mobile devices which have limited computation resources and tight power budgets. Conventional model compression techniques rely on hand-crafted…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yihui He , Ji Lin , Zhijian Liu , Hanrui Wang , Li-Jia Li , Song Han

With the rapid emergence of a spectrum of high-end mobile devices, many applications that required desktop-level computation capability formerly can now run on these devices without any problem. However, without a careful optimization,…

Machine Learning · Computer Science 2019-05-03 Wei Niu , Xiaolong Ma , Yanzhi Wang , Bin Ren

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in terms of energy and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yoshitomo Matsubara , Ruihan Yang , Marco Levorato , Stephan Mandt