English
Related papers

Related papers: Towards Lossless Binary Convolutional Neural Netwo…

200 papers

A key enabler of deploying convolutional neural networks on resource-constrained embedded systems is the binary neural network (BNN). BNNs save on memory and simplify computation by binarizing both features and weights. Unfortunately,…

Machine Learning · Computer Science 2023-10-19 Floran de Putter , Henk Corporaal

Significant computational cost and memory requirements for deep neural networks (DNNs) make it difficult to utilize DNNs in resource-constrained environments. Binary neural network (BNN), which uses binary weights and binary activations,…

Neural and Evolutionary Computing · Computer Science 2019-03-26 Hyungjun Kim , Yulhwa Kim , Sungju Ryu , Jae-Joon Kim

In the era of artificial intelligence, convolutional neural networks (CNNs) are emerging as a powerful technique for computational imaging. They have shown superior quality for reconstructing fine textures from badly-distorted images and…

Neural and Evolutionary Computing · Computer Science 2021-04-20 Chao-Tsung Huang

To accelerate deep CNN models, this paper proposes a novel spatially adaptive framework that can dynamically generate pixel-wise sparsity according to the input image. The sparse scheme is pixel-wise refined, regional adaptive under a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Chen Tang , Wenyu Sun , Zhuqing Yuan , Yongpan Liu

Convolution Neural Networks (CNN) have been extremely successful in solving intensive computer vision tasks. The convolutional filters used in CNNs have played a major role in this success, by extracting useful features from the inputs.…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Pravendra Singh , Pratik Mazumder , Vinay P. Namboodiri

The large computing and memory cost of deep neural networks (DNNs) often precludes their use in resource-constrained devices. Quantizing the parameters and operations to lower bit-precision offers substantial memory and energy savings for…

Machine Learning · Computer Science 2023-09-01 Clemens JS Schaefer , Siddharth Joshi , Shan Li , Raul Blazquez

Convolutional neural networks (CNNs) are crucial for computer vision tasks on resource-constrained devices. Quantization effectively compresses these models, reducing storage size and energy cost. However, in modern depthwise-separable…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Lukas Meiner , Jens Mehnert , Alexandru Paul Condurache

Binarized Neural Network (BNN) removes bitwidth redundancy in classical CNN by using a single bit (-1/+1) for network parameters and intermediate representations, which has greatly reduced the off-chip data transfer and storage overhead.…

Machine Learning · Computer Science 2018-10-05 Cheng Fu , Shilin Zhu , Hao Su , Ching-En Lee , Jishen Zhao

Deep Convolutional Neural Networks (CNN) have been successfully applied to many real-life problems. However, the huge memory cost of deep CNN models poses a great challenge of deploying them on memory-constrained devices (e.g., mobile…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Weichao Lan , Liang Lan

Nowadays, several deep learning methods are proposed to tackle the challenge of epileptic seizure prediction. However, these methods still cannot be implemented as part of implantable or efficient wearable devices due to their large…

Signal Processing · Electrical Eng. & Systems 2022-06-16 Shiqi Zhao , Jie Yang , Yankun Xu , Mohamad Sawan

Convolutional Neural Networks (CNN) are widely used to face challenging tasks like speech recognition, natural language processing or computer vision. As CNN architectures get larger and more complex, their computational requirements…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Luis Balderas , Miguel Lastra , José M. Benítez

The advancement of deep convolutional neural networks (DCNNs) has driven significant improvement in the accuracy of recognition systems for many computer vision tasks. However, their practical applications are often restricted in…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiaxin Gu , Ce Li , Baochang Zhang , Jungong Han , Xianbin Cao , Jianzhuang Liu , David Doermann

Deep convolutional neural networks (DCNNs) have dominated the recent developments in computer vision through making various record-breaking models. However, it is still a great challenge to achieve powerful DCNNs in resource-limited…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Jiaxin Gu , Junhe Zhao , Xiaolong Jiang , Baochang Zhang , Jianzhuang Liu , Guodong Guo , Rongrong Ji

Binary Neural Network (BNN) represents convolution weights with 1-bit values, which enhances the efficiency of storage and computation. This paper is motivated by a previously revealed phenomenon that the binary kernels in successful BNNs…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yikai Wang , Wenbing Huang , Yinpeng Dong , Fuchun Sun , Anbang Yao

Binary neural networks have attracted tremendous attention due to the efficiency for deploying them on mobile devices. Since the weak expression ability of binary weights and features, their accuracy is usually much lower than that of…

Machine Learning · Computer Science 2019-09-18 Mingzhu Shen , Kai Han , Chunjing Xu , Yunhe Wang

In this paper, we propose a novel Convolutional Neural Network (CNN) architecture for learning multi-scale feature representations with good tradeoffs between speed and accuracy. This is achieved by using a multi-branch network, which has…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Chun-Fu Chen , Quanfu Fan , Neil Mallinar , Tom Sercu , Rogerio Feris

In modern artificial intelligence, convolutional neural networks (CNNs) have become a cornerstone for visual and perceptual tasks. However, their implementation on conventional electronic hardware faces fundamental bottlenecks in speed and…

Multiplication-less neural networks significantly reduce the time and energy cost on the hardware platform, as the compute-intensive multiplications are replaced with lightweight bit-shift operations. However, existing bit-shift networks…

Machine Learning · Computer Science 2022-04-12 Xiaoxuan Lou , Guowen Xu , Kangjie Chen , Guanlin Li , Jiwei Li , Tianwei Zhang

Big neural networks trained on large datasets have advanced the state-of-the-art for a large variety of challenging problems, improving performance by a large margin. However, under low memory and limited computational power constraints,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Adrian Bulat , Georgios Tzimiropoulos , Jean Kossaifi , Maja Pantic

Recently, deep convolutional neural networks (CNNs) have achieved many eye-catching results. However, deploying CNNs on resource-constrained edge devices is constrained by limited memory bandwidth for transmitting large intermediated data…

Image and Video Processing · Electrical Eng. & Systems 2022-07-20 Yu-Shan Tai , Cheng-Yang Chang , Chieh-Fang Teng , AnYeu , Wu