English
Related papers

Related papers: BitSplit-Net: Multi-bit Deep Neural Network with B…

200 papers

Quantization of weights and activations in Deep Neural Networks (DNNs) is a powerful technique for network compression, and has enjoyed significant attention and success. However, much of the inference-time benefit of quantization is…

Performance · Computer Science 2019-12-13 Andrew Anderson , David Gregg

Research has shown that deep neural networks contain significant redundancy, and that high classification accuracies can be achieved even when weights and activations are quantised down to binary values. Network binarisation on FPGAs…

Machine Learning · Computer Science 2019-04-02 Erwei Wang , James J. Davis , Peter Y. K. Cheung , George A. Constantinides

Low-power potential of mixed-signal design makes it an alluring option to accelerate Deep Neural Networks (DNNs). However, mixed-signal circuitry suffers from limited range for information encoding, susceptibility to noise, and Analog to…

Hardware Architecture · Computer Science 2019-07-15 Soroush Ghodrati , Hardik Sharma , Sean Kinzer , Amir Yazdanbakhsh , Kambiz Samadi , Nam Sung Kim , Doug Burger , Hadi Esmaeilzadeh

Object segmentation and structure localization are important steps in automated image analysis pipelines for microscopy images. We present a convolution neural network (CNN) based deep learning architecture for segmentation of objects in…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Shan E Ahmed Raza , Linda Cheung , Muhammad Shaban , Simon Graham , David Epstein , Stella Pelengaris , Michael Khan , Nasir M. Rajpoot

Binary Neural Networks (BNNs), neural networks with weights and activations constrained to -1(0) and +1, are an alternative to deep neural networks which offer faster training, lower memory consumption and lightweight models, ideal for use…

Machine Learning · Computer Science 2022-05-23 Kinshuk Dua

Deep convolutional neural networks (DCNNs) have recently demonstrated high-quality results in single-image super-resolution (SR). DCNNs often suffer from over-parametrization and large amounts of redundancy, which results in inefficient…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Yinglan Ma , Hongyu Xiong , Zhe Hu , Lizhuang Ma

Existing Binary Neural Networks (BNNs) mainly operate on local convolutions with binarization function. However, such simple bit operations lack the ability of modeling contextual dependencies, which is critical for learning discriminative…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Xingrun Xing , Yangguang Li , Wei Li , Wenrui Ding , Yalong Jiang , Yufeng Wang , Jing Shao , Chunlei Liu , Xianglong Liu

One of the most computationally intensive parts in modern recognition systems is an inference of deep neural networks that are used for image classification, segmentation, enhancement, and recognition. The growing popularity of edge…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Elena Limonova , Daniil Alfonso , Dmitry Nikolaev , Vladimir V. Arlazarov

This paper tackles the problem of training a deep convolutional neural network with both low-precision weights and low-bitwidth activations. Optimizing a low-precision network is very challenging since the training process can easily get…

Computer Vision and Pattern Recognition · Computer Science 2021-06-05 Bohan Zhuang , Chunhua Shen , Mingkui Tan , Lingqiao Liu , Ian Reid

Neural network hardware is considered an essential part of future edge devices. In this paper, we propose a binary-weight spiking neural network (BW-SNN) hardware architecture for low-power real-time object classification on edge platforms.…

Signal Processing · Electrical Eng. & Systems 2020-03-16 Pai-Yu Tan , Po-Yao Chuang , Yen-Ting Lin , Cheng-Wen Wu , Juin-Ming Lu

The high computation, memory, and power budgets of inferring convolutional neural networks (CNNs) are major bottlenecks of model deployment to edge computing platforms, e.g., mobile devices and IoT. Moreover, training CNNs is time and…

Machine Learning · Computer Science 2021-07-09 Mostafa Elhoushi , Zihao Chen , Farhan Shafiq , Ye Henry Tian , Joey Yiwei Li

Recently, deep neural networks (DNNs) have been regarded as the state-of-the-art classification methods in a wide range of applications, especially in image classification. Despite the success, the huge number of parameters blocks its…

Machine Learning · Statistics 2017-12-18 Guangxi Li , Jinmian Ye , Haiqin Yang , Di Chen , Shuicheng Yan , Zenglin Xu

Deep Neural Networks (DNNs) have gained immense success in cognitive applications and greatly pushed today's artificial intelligence forward. The biggest challenge in executing DNNs is their extremely data-extensive computations. The…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Fuqiang Liu , C. Liu

Dense prediction is a critical task in computer vision. However, previous methods often require extensive computational resources, which hinders their real-world application. In this paper, we propose BiDense, a generalized binary neural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Rui Yin , Haotong Qin , Yulun Zhang , Wenbo Li , Yong Guo , Jianjun Zhu , Cheng Wang , Biao Jia

A deep learning approach to blind denoising of images without complete knowledge of the noise statistics is considered. We propose DN-ResNet, which is a deep convolutional neural network (CNN) consisting of several residual blocks…

Image and Video Processing · Electrical Eng. & Systems 2019-04-12 Haoyu Ren , Mostafa El-Khamy , Jungwon Lee

Convolutional neural networks have achieved astonishing results in different application areas. Various methods which allow us to use these models on mobile and embedded devices have been proposed. Especially binary neural networks seem to…

Machine Learning · Computer Science 2018-09-28 Joseph Bethge , Haojin Yang , Christian Bartz , Christoph Meinel

Accurate classification of fine-grained images remains a challenge in backbones based on convolutional operations or self-attention mechanisms. This study proposes novel dual-current neural networks (DCNN), which combine the advantages of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Da Fu , Mingfei Rong , Eun-Hu Kim , Hao Huang , Witold Pedrycz

Binary Neural Networks (BNNs), where weights and activations are constrained to binary values (+1, -1), are a highly efficient alternative to traditional neural networks. Unfortunately, typical BNNs, while binarizing linear layers…

Hardware Architecture · Computer Science 2026-01-29 Yuval Harary , Almog Sharoni , Esteban Garzón , Marco Lanuzza , Adam Teman , Leonid Yavits

Deep neural networks are state-of-the-art models for understanding the content of images, video and raw input data. However, implementing a deep neural network in embedded systems is a challenging task, because a typical deep neural…

Machine Learning · Computer Science 2016-04-22 Xichuan Zhou , Shengli Li , Kai Qin , Kunping Li , Fang Tang , Shengdong Hu , Shujun Liu , Zhi Lin

Lighter and faster image restoration (IR) models are crucial for the deployment on resource-limited devices. Binary neural network (BNN), one of the most promising model compression methods, can dramatically reduce the computations and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Bin Xia , Yulun Zhang , Yitong Wang , Yapeng Tian , Wenming Yang , Radu Timofte , Luc Van Gool