English
Related papers

Related papers: GhostShiftAddNet: More Features from Energy-Effici…

200 papers

Deploying convolutional neural networks (CNNs) on embedded devices is difficult due to the limited memory and computation resources. The redundancy in feature maps is an important characteristic of those successful CNNs, but has rarely been…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Kai Han , Yunhe Wang , Qi Tian , Jianyuan Guo , Chunjing Xu , Chang Xu

Multiplication (e.g., convolution) is arguably a cornerstone of modern deep neural networks (DNNs). However, intensive multiplications cause expensive resource costs that challenge DNNs' deployment on resource-constrained edge devices,…

Machine Learning · Computer Science 2025-03-04 Haoran You , Xiaohan Chen , Yongan Zhang , Chaojian Li , Sicheng Li , Zihao Liu , Zhangyang Wang , Yingyan Celine Lin

Light-weight convolutional neural networks (CNNs) are specially designed for applications on mobile devices with faster inference speed. The convolutional operation can only capture local information in a window region, which prevents…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Yehui Tang , Kai Han , Jianyuan Guo , Chang Xu , Chao Xu , Yunhe Wang

The high computation, memory, and power budgets of inferring convolutional neural networks (CNNs) are major bottlenecks of model deployment to edge computing platforms, e.g., mobile devices and IoT. Moreover, training CNNs is time and…

Machine Learning · Computer Science 2021-07-09 Mostafa Elhoushi , Zihao Chen , Farhan Shafiq , Ye Henry Tian , Joey Yiwei Li

Neural networks (NNs) with intensive multiplications (e.g., convolutions and transformers) are capable yet power hungry, impeding their more extensive deployment into resource-constrained devices. As such, multiplication-free networks,…

Machine Learning · Computer Science 2025-03-04 Haoran You , Baopu Li , Huihong Shi , Yonggan Fu , Yingyan Celine Lin

Modern single image super-resolution (SISR) system based on convolutional neural networks (CNNs) achieves fancy performance while requires huge computational costs. The problem on feature redundancy is well studied in visual recognition…

Image and Video Processing · Electrical Eng. & Systems 2022-08-18 Ying Nie , Kai Han , Zhenhua Liu , Chuanjian Liu , Yunhe Wang

Deep convolutional neural networks have achieved remarkable progress in recent years. However, the large volume of intermediate results generated during inference poses a significant challenge to the accelerator design for…

Hardware Architecture · Computer Science 2021-05-20 Gang Li , Zejian Liu , Fanrong Li , Jian Cheng

Deploying convolutional neural networks (CNNs) on mobile devices is difficult due to the limited memory and computation resources. We aim to design efficient neural networks for heterogeneous devices including CPU and GPU, by exploiting the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Kai Han , Yunhe Wang , Chang Xu , Jianyuan Guo , Chunjing Xu , Enhua Wu , Qi Tian

In this paper we introduce ShiftCNN, a generalized low-precision architecture for inference of multiplierless convolutional neural networks (CNNs). ShiftCNN is based on a power-of-two weight representation and, as a result, performs only…

Computer Vision and Pattern Recognition · Computer Science 2017-06-09 Denis A. Gudovskiy , Luca Rigazio

Convolutional Neural Networks (CNNs) have achieved remarkable success across a wide range of machine learning tasks by leveraging hierarchical feature learning through deep architectures. However, the large number of layers and millions of…

Machine Learning · Statistics 2025-11-18 Biyi Fang , Truong Vo , Jean Utke , Diego Klabjan

Convolutional neural networks (CNNs) have recently demonstrated superior quality for computational imaging applications. Therefore, they have great potential to revolutionize the image pipelines on cameras and displays. However, it is…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-15 Chao-Tsung Huang , Yu-Chun Ding , Huan-Ching Wang , Chi-Wen Weng , Kai-Ping Lin , Li-Wei Wang , Li-De Chen

Feature reuse has been a key technique in light-weight convolutional neural networks (CNNs) architecture design. Current methods usually utilize a concatenation operator to keep large channel numbers cheaply (thus large network capacity) by…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Chengpeng Chen , Zichao Guo , Haien Zeng , Pengfei Xiong , Jian Dong

With recent advancing of Internet of Things (IoTs), it becomes very attractive to implement the deep convolutional neural networks (DCNNs) onto embedded/portable systems. Presently, executing the software-based DCNNs requires…

Computer Vision and Pattern Recognition · Computer Science 2017-02-01 Ao Ren , Ji Li , Zhe Li , Caiwen Ding , Xuehai Qian , Qinru Qiu , Bo Yuan , Yanzhi Wang

The Deep Convolutional Neural Networks (CNNs) have obtained a great success for pattern recognition, such as recognizing the texts in images. But existing CNNs based frameworks still have several drawbacks: 1) the traditaional pooling…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Zhao Zhang , Zemin Tang , Zheng Zhang , Yang Wang , Jie Qin , Meng Wang

Sparse deep neural networks (DNNs) excel in real-world applications like robotics and computer vision, by reducing computational demands that hinder usability. However, recent studies aim to boost DNN efficiency by trimming redundant…

Machine Learning · Computer Science 2024-11-15 Mary Isabelle Wisell , Salimeh Yasaei Sekeh

In this paper, we introduce a memory-efficient CNN (convolutional neural network), which enables resource-constrained low-end embedded and IoT devices to perform on-device vision tasks, such as image classification and object detection,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jaewook Lee , Yoel Park , Seulki Lee

Convolutional neural networks (CNN) have been widely used for boosting the performance of many machine intelligence tasks. However, the CNN models are usually computationally intensive and energy consuming, since they are often designed…

Machine Learning · Computer Science 2021-02-04 Yunhe Wang , Mingqiang Huang , Kai Han , Hanting Chen , Wei Zhang , Chunjing Xu , Dacheng Tao

Convolutional neural networks (CNNs) achieve state-of-the-art accuracy in a variety of tasks in computer vision and beyond. One of the major obstacles hindering the ubiquitous use of CNNs for inference on low-power edge devices is their…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Brian Chmiel , Chaim Baskin , Ron Banner , Evgenii Zheltonozhskii , Yevgeny Yermolin , Alex Karbachevsky , Alex M. Bronstein , Avi Mendelson

In order to enhance the real-time performance of convolutional neural networks(CNNs), more and more researchers are focusing on improving the efficiency of CNN. Based on the analysis of some CNN architectures, such as ResNet, DenseNet,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Qiuyu Zhu , Ruixin Zhang

Convolutional neural networks (CNN) are increasingly used in many areas of computer vision. They are particularly attractive because of their ability to "absorb" great quantities of labeled data through millions of parameters. However, as…

Machine Learning · Computer Science 2015-06-16 Wenlin Chen , James T. Wilson , Stephen Tyree , Kilian Q. Weinberger , Yixin Chen
‹ Prev 1 2 3 10 Next ›