English
Related papers

Related papers: Designing Extremely Memory-Efficient CNNs for On-d…

200 papers

We introduce an extremely computation-efficient CNN architecture named ShuffleNet, which is designed specially for mobile devices with very limited computing power (e.g., 10-150 MFLOPs). The new architecture utilizes two new operations,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-08 Xiangyu Zhang , Xinyu Zhou , Mengxiao Lin , Jian Sun

Leveraging large data sets, deep Convolutional Neural Networks (CNNs) achieve state-of-the-art recognition accuracy. Due to the substantial compute and memory operations, however, they require significant execution time. The massive…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-13 Chao Li , Yi Yang , Min Feng , Srimat Chakradhar , Huiyang Zhou

Deep learning, e.g., convolutional neural networks (CNNs), has achieved great success in image processing and computer vision especially in high level vision applications such as recognition and understanding. However, it is rarely used to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Feng Jiang , Wen Tao , Shaohui Liu , Jie Ren , Xun Guo , Debin Zhao

Convolutional Neural Networks (CNNs) have been successful in solving tasks in computer vision including medical image segmentation due to their ability to automatically extract features from unstructured data. However, CNNs are sensitive to…

Image and Video Processing · Electrical Eng. & Systems 2022-03-18 Minh Tran , Viet-Khoa Vo-Ho , Kyle Quinn , Hien Nguyen , Khoa Luu , Ngan Le

Convolutional neural networks (CNNs) demand huge DRAM bandwidth for computational imaging tasks, and block-based processing has recently been applied to greatly reduce the bandwidth. However, the induced additional computation for feature…

Machine Learning · Computer Science 2020-01-31 Chao-Tsung Huang

Convolutional neural networks (CNNs) achieve state-of-the-art accuracy in a variety of tasks in computer vision and beyond. One of the major obstacles hindering the ubiquitous use of CNNs for inference on low-power edge devices is their…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Brian Chmiel , Chaim Baskin , Ron Banner , Evgenii Zheltonozhskii , Yevgeny Yermolin , Alex Karbachevsky , Alex M. Bronstein , Avi Mendelson

Deep-neural-network-based image reconstruction has demonstrated promising performance in medical imaging for under-sampled and low-dose scenarios. However, it requires large amount of memory and extensive time for the training. It is…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Dufan Wu , Kyungsang Kim , Quanzheng Li

Convolutional neural networks (CNNs) require both intensive computation and frequent memory access, which lead to a low processing speed and large power dissipation. Although the characteristics of the different layers in a CNN are…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Duy Thanh Nguyen , Hyun Kim , Hyuk-Jae Lee

Deep convolutional neural networks (CNN) have achieved astonishing results in a large variety of applications. However, using these models on mobile or embedded devices is difficult due to the limited memory and computation resources.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Haojin Yang , Zhen Shen , Yucheng Zhao

Convolutional neural networks (CNNs) are used in many embedded applications, from industrial robotics and automation systems to biometric identification on mobile devices. State-of-the-art classification is typically achieved by large…

Machine Learning · Computer Science 2020-05-22 Yuan Wen , Andrew Anderson , Valentin Radu , Michael F. P. O'Boyle , David Gregg

This work presents and analyzes three convolutional neural network (CNN) models for efficient pixelwise classification of images. When using convolutional neural networks to classify single pixels in patches of a whole image, a lot of…

Computer Vision and Pattern Recognition · Computer Science 2015-09-14 Fabian Tschopp

The convolutional neural network (CNN) is one of the most commonly used architectures for computer vision tasks. The key building block of a CNN is the convolutional kernel that aggregates information from the pixel neighborhood and shares…

Image and Video Processing · Electrical Eng. & Systems 2022-02-08 Tianyu Ma , Alan Q. Wang , Adrian V. Dalca , Mert R. Sabuncu

Convolutional neural network (CNN) has been widely used for vision-based tasks. Due to the high computational complexity and memory storage requirement, it is hard to directly deploy a full-precision CNN on embedded devices. The…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Yixing Li , Fengbo Ren

Convolutional neural networks (CNNs) have recently demonstrated superior quality for computational imaging applications. Therefore, they have great potential to revolutionize the image pipelines on cameras and displays. However, it is…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-15 Chao-Tsung Huang , Yu-Chun Ding , Huan-Ching Wang , Chi-Wen Weng , Kai-Ping Lin , Li-Wei Wang , Li-De Chen

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Filip Badan , Lukas Sekanina

Convolutional Neural Networks (CNNs) have become indispensable for solving machine learning tasks in speech recognition, computer vision, and other areas that involve high-dimensional data. A CNN filters the input feature using a network…

Machine Learning · Computer Science 2020-02-13 Jonathan Ephrath , Moshe Eliasof , Lars Ruthotto , Eldad Haber , Eran Treister

Convolutional neural networks (CNNs) for biomedical image analysis are often of very large size, resulting in high memory requirement and high latency of operations. Searching for an acceptable compressed representation of the base CNN for…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Suraj Mishra , Peixian Liang , Adam Czajka , Danny Z. Chen , X. Sharon Hu

We study performance characteristics of convolutional neural networks (CNN) for mobile computer vision systems. CNNs have proven to be a powerful and efficient approach to implement such systems. However, the system performance depends…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jussi Hanhirova , Teemu Kämäräinen , Sipi Seppälä , Matti Siekkinen , Vesa Hirvisalo , Antti Ylä-Jääski

The memory consumption of most Convolutional Neural Network (CNN) architectures grows rapidly with increasing depth of the network, which is a major constraint for efficient network training on modern GPUs with limited memory, embedded…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Bochen Guan , Jinnian Zhang , William A. Sethares , Richard Kijowski , Fang Liu

Modern efficient Convolutional Neural Networks(CNNs) always use Depthwise Separable Convolutions(DSCs) and Neural Architecture Search(NAS) to reduce the number of parameters and the computational complexity. But some inherent…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Liangqi Zhang , Haibo Shen , Yihao Luo , Xiang Cao , Leixilan Pan , Tianjiang Wang , Qi Feng