中文
相关论文

相关论文: GhostShiftAddNet: More Features from Energy-Effici…

200 篇论文

Convolutional neural network (CNN) is an important deep learning method. The convolution operation takes a large proportion of the total execution time for CNN. Feature maps for convolution operation are usually sparse. Multiplications and…

分布式、并行与集群计算 · 计算机科学 2023-08-01 Weizhi Xu , Yintai Sun , fhengyu Fan , Hui Yu , Xin Fu

Deep convolutional neural networks (CNNs) are indispensable to state-of-the-art computer vision algorithms. However, they are still rarely deployed on battery-powered mobile devices, such as smartphones and wearable gadgets, where vision…

计算机视觉与模式识别 · 计算机科学 2017-04-20 Tien-Ju Yang , Yu-Hsin Chen , Vivienne Sze

Deep convolutional neural networks (DCNNs) are a class of artificial neural networks, primarily for computer vision tasks such as segmentation and classification. Many nonlinear operations, such as activation functions and pooling…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Zuocheng Wen , Lingzhong Guo

Convolutional neural network (CNN) inference on mobile devices demands efficient hardware acceleration of low-precision (INT8) general matrix multiplication (GEMM). Exploiting data sparsity is a common approach to further accelerate GEMM…

硬件体系结构 · 计算机科学 2020-10-14 Zhi-Gang Liu , Paul N. Whatmough , Matthew Mattina

Convolutional neural networks (CNNs) with deep architectures have substantially advanced the state-of-the-art in computer vision tasks. However, deep networks are typically resource-intensive and thus difficult to be deployed on mobile…

神经与进化计算 · 计算机科学 2017-06-08 Yiwen Guo , Anbang Yao , Hao Zhao , Yurong Chen

Deep Separable Convolutional Neural Networks (DSCNNs) have become the emerging paradigm by offering modular networks with structural sparsity in order to achieve higher accuracy with relatively lower operations and parameters. However,…

硬件体系结构 · 计算机科学 2020-07-21 Mohammadreza Baharani , Ushma Sunil , Kaustubh Manohar , Steven Furgurson , Hamed Tabkhi

Although mission-critical applications require the use of deep neural networks (DNNs), their continuous execution at mobile devices results in a significant increase in energy consumption. While edge offloading can decrease energy…

机器学习 · 计算机科学 2022-09-07 Yoshitomo Matsubara , Davide Callegaro , Sameer Singh , Marco Levorato , Francesco Restuccia

Successful training of convolutional neural networks is often associated with sufficiently deep architectures composed of high amounts of features. These networks typically rely on a variety of regularization and pruning techniques to…

计算机视觉与模式识别 · 计算机科学 2017-10-23 Martin Mundt , Tobias Weis , Kishore Konda , Visvanathan Ramesh

Depthwise and pointwise convolutions have fewer parameters and perform fewer operations than standard convolutions. As a result, they have become increasingly used in various compact DNNs, including convolutional neural networks (CNNs) and…

性能 · 计算机科学 2024-08-06 Fareed Qararyah , Muhammad Waqar Azhar , Mohammad Ali Maleki , Pedro Trancoso

Deep convolution Neural Network (DCNN) has been widely used in computer vision tasks. However, for edge devices even inference has too large computational complexity and data access amount. The inference latency of state-of-the-art models…

硬件体系结构 · 计算机科学 2025-09-09 Kuan-Ting Lin , Ching-Te Chiu , Jheng-Yi Chang , Shi-Zong Huang , Yu-Ting Li

Shift operation is an efficient alternative over depthwise separable convolution. However, it is still bottlenecked by its implementation manner, namely memory movement. To put this direction forward, a new and novel basic component named…

计算机视觉与模式识别 · 计算机科学 2019-03-14 Weijie Chen , Di Xie , Yuan Zhang , Shiliang Pu

Very deep convolutional neural networks offer excellent recognition results, yet their computational expense limits their impact for many real-world applications. We introduce BlockDrop, an approach that learns to dynamically choose which…

计算机视觉与模式识别 · 计算机科学 2019-01-29 Zuxuan Wu , Tushar Nagarajan , Abhishek Kumar , Steven Rennie , Larry S. Davis , Kristen Grauman , Rogerio Feris

This paper analyzes the effects of approximate multiplication when performing inferences on deep convolutional neural networks (CNNs). The approximate multiplication can reduce the cost of the underlying circuits so that CNN inferences can…

机器学习 · 计算机科学 2021-01-12 Min Soo Kim , Alberto A. Del Barrio , HyunJin Kim , Nader Bagherzadeh

The accuracy of deep convolutional neural networks (CNNs) generally improves when fueled with high resolution images. However, this often comes at a high computational cost and high memory footprint. Inspired by the fact that not all…

计算机视觉与模式识别 · 计算机科学 2020-10-13 Yulin Wang , Kangchen Lv , Rui Huang , Shiji Song , Le Yang , Gao Huang

Major winning Convolutional Neural Networks (CNNs), such as VGGNet, ResNet, DenseNet, \etc, include tens to hundreds of millions of parameters, which impose considerable computation and memory overheads. This limits their practical usage in…

计算机视觉与模式识别 · 计算机科学 2018-02-20 Seyyed Hossein Hasanpour , Mohammad Rouhani , Mohsen Fayyaz , Mohammad Sabokrou , Ehsan Adeli

Weight pruning in deep neural networks (DNNs) can reduce storage and computation cost, but struggles to bring practical speedup to the model inference time. Tensor-cores can significantly boost the throughput of GPUs on dense computation,…

分布式、并行与集群计算 · 计算机科学 2022-03-15 Guyue Huang , Haoran Li , Minghai Qin , Fei Sun , Yufei Ding , Yuan Xie

Recent advancements in quantization and mixed-precision approaches offers substantial opportunities to improve the speed and energy efficiency of Neural Networks (NN). Research has shown that individual parameters with varying low…

硬件体系结构 · 计算机科学 2024-08-14 Giorgos Armeniakos , Alexis Maras , Sotirios Xydis , Dimitrios Soudris

Inference for Deep Neural Networks is increasingly being executed locally on mobile and embedded platforms due to its advantages in latency, privacy and connectivity. Since modern System on Chips typically execute a combination of different…

计算机视觉与模式识别 · 计算机科学 2021-05-11 Lei Xun , Long Tran-Thanh , Bashir M Al-Hashimi , Geoff V. Merrett

The ability of Convolutional Neural Networks (CNNs) to accurately process real-time telemetry has boosted their use in safety-critical and high-performance computing systems. As such systems require high levels of resilience to errors, CNNs…

分布式、并行与集群计算 · 计算机科学 2020-06-11 Siva Kumar Sastry Hari , Michael B. Sullivan , Timothy Tsai , Stephen W. Keckler

Convolutional neural network inference on video data requires powerful hardware for real-time processing. Given the inherent coherence across consecutive frames, large parts of a video typically change little. By skipping identical image…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Mathias Parger , Chengcheng Tang , Christopher D. Twigg , Cem Keskin , Robert Wang , Markus Steinberger