English
Related papers

Related papers: Binarized Convolutional Neural Networks for Effici…

200 papers

FPGA-based hardware accelerators for convolutional neural networks (CNNs) have obtained great attentions due to their higher energy efficiency than GPUs. However, it is challenging for FPGA-based solutions to achieve a higher throughput…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-09 Yixing Li , Zichuan Liu , Kai Xu , Hao Yu , Fengbo Ren

On-device learning remains a formidable challenge, especially when dealing with resource-constrained devices that have limited computational capabilities. This challenge is primarily rooted in two key issues: first, the memory available on…

Machine Learning · Computer Science 2024-01-19 Lorenzo Vorabbi , Davide Maltoni , Guido Borghi , Stefano Santi

We present techniques for speeding up the test-time evaluation of large convolutional networks, designed for object recognition tasks. These models deliver impressive accuracy but each image evaluation requires millions of floating point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Remi Denton , Wojciech Zaremba , Joan Bruna , Yann LeCun , Rob Fergus

In this paper we introduce ShiftCNN, a generalized low-precision architecture for inference of multiplierless convolutional neural networks (CNNs). ShiftCNN is based on a power-of-two weight representation and, as a result, performs only…

Computer Vision and Pattern Recognition · Computer Science 2017-06-09 Denis A. Gudovskiy , Luca Rigazio

Binary neural network (BNN) provides a promising solution to deploy parameter-intensive deep single image super-resolution (SISR) models onto real devices with limited storage and computational resources. To achieve comparable performance…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Zhiqiang Lang , Chongxing Song , Lei Zhang , Wei Wei

Convolutional gridding is a processor-intensive step in interferometric imaging. While it is possible to use graphics processing units (GPUs) to accelerate this operation, existing methods use only a fraction of the available flops. We…

Instrumentation and Methods for Astrophysics · Physics 2016-06-29 Bruce Merry

This invention addresses fixed-point representations of convolutional neural networks (CNN) in integrated circuits. When quantizing a CNN for a practical implementation there is a trade-off between the precision used for operations between…

Neural and Evolutionary Computing · Computer Science 2018-07-27 Mo'taz Al-Hami , Marcin Pietron , Rishi Kumar , Raul A. Casas , Samer L. Hijazi , Chris Rowen

Binary neural network (BNN) is an extreme quantization version of convolutional neural networks (CNNs) with all features and weights mapped to just 1-bit. Although BNN saves a lot of memory and computation demand to make CNN applicable on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Xulong Shi , Zhi Qi , Jiaxuan Cai , Keqi Fu , Yaru Zhao , Zan Li , Xuanyu Liu , Hao Liu

Recent trends show recognition accuracy increasing even more profoundly. Inference process of Deep Convolutional Neural Networks (DCNN) has a large number of parameters, requires a large amount of computation, and can be very slow. The…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Ryuji Kamiya , Takayoshi Yamashita , Mitsuru Ambai , Ikuro Sato , Yuji Yamauchi , Hironobu Fujiyoshi

Low-bit quantized neural networks are of great interest in practical applications because they significantly reduce the consumption of both memory and computational resources. Binary neural networks are memory and computationally efficient…

Machine Learning · Computer Science 2022-05-20 Anton Trusov , Elena Limonova , Dmitry Nikolaev , Vladimir V. Arlazarov

For the problem whether Graphic Processing Unit(GPU),the stream processor with high performance of floating-point computing is applicable to neural networks, this paper proposes the parallel recognition algorithm of Convolutional Neural…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-28 Yi-bin Huang , Kang Li , Ge Wang , Min Cao , Pin Li , Yu-jia Zhang

This paper proposes a novel binarized weight network (BT) for a resource-efficient neural structure. The proposed model estimates a binary representation of weights by taking into account the approximation error with an additional term.…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Savas Ozkan , Gozde Bozdagi Akar

This paper proposes a Bitwise Gated Recurrent Unit (BGRU) network for the single-channel source separation task. Recurrent Neural Networks (RNN) require several sets of weights within its cells, which significantly increases the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-26 Sunwoo Kim , Mrinmoy Maity , Minje Kim

Memory and computation efficient deep learning architec- tures are crucial to continued proliferation of machine learning capabili- ties to new platforms and systems. Binarization of operations in convo- lutional neural networks has shown…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Jeng-Hau Lin , Yunfan Yang , Rajesh Gupta , Zhuowen Tu

Quantized neural networks employ reduced precision representations for both weights and activations. This quantization process significantly reduces the memory requirements and computational complexity of the network. Binary Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Edwin Vargas , Claudia Correa , Carlos Hinojosa , Henry Arguello

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Filip Badan , Lukas Sekanina

Visual place recognition (VPR) is a robot's ability to determine whether a place was visited before using visual data. While conventional hand-crafted methods for VPR fail under extreme environmental appearance changes, those based on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Bruno Ferrarini , Michael Milford , Klaus D. McDonald-Maier , Shoaib Ehsan

Learning vectorized embeddings is at the core of various recommender systems for user-item matching. To perform efficient online inference, representation quantization, aiming to embed the latent features by a compact sequence of discrete…

Information Retrieval · Computer Science 2022-06-07 Yankai Chen , Huifeng Guo , Yingxue Zhang , Chen Ma , Ruiming Tang , Jingjie Li , Irwin King

Convolutional neural networks are modern models that are very efficient in many classification tasks. They were originally created for image processing purposes. Then some trials were performed to use them in different domains like natural…

Computation and Language · Computer Science 2018-05-29 Krzysztof Wróbel , Marcin Pietroń , Maciej Wielgosz , Michał Karwatowski , Kazimierz Wiatr

Being able to learn from complex data with phase information is imperative for many signal processing applications. Today' s real-valued deep neural networks (DNNs) have shown efficiency in latent information analysis but fall short when…

Machine Learning · Computer Science 2021-08-11 Hongwu Peng , Shanglin Zhou , Scott Weitze , Jiaxin Li , Sahidul Islam , Tong Geng , Ang Li , Wei Zhang , Minghu Song , Mimi Xie , Hang Liu , Caiwen Ding