English
Related papers

Related papers: Towards Lossless Binary Convolutional Neural Netwo…

200 papers

State-of-the-art approaches for semantic image segmentation are built on Convolutional Neural Networks (CNNs). The typical segmentation architecture is composed of (a) a downsampling path responsible for extracting coarse semantic features,…

Computer Vision and Pattern Recognition · Computer Science 2017-11-01 Simon Jégou , Michal Drozdzal , David Vazquez , Adriana Romero , Yoshua Bengio

Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does not make the network…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Rui-Yang Ju , Jen-Shiun Chiang , Chih-Chia Chen , Yu-Shian Lin

Recently developed adversarial weight attack, a.k.a. bit-flip attack (BFA), has shown enormous success in compromising Deep Neural Network (DNN) performance with an extremely small amount of model parameter perturbation. To defend against…

Machine Learning · Computer Science 2021-03-26 Adnan Siraj Rakin , Li Yang , Jingtao Li , Fan Yao , Chaitali Chakrabarti , Yu Cao , Jae-sun Seo , Deliang Fan

The success of convolutional neural networks (CNNs) in computer vision applications has been accompanied by a significant increase of computation and memory costs, which prohibits its usage on resource-limited environments such as mobile or…

Computer Vision and Pattern Recognition · Computer Science 2019-03-25 Shaohui Lin , Rongrong Ji , Yuchao Li , Cheng Deng , Xuelong Li

Network quantization has rapidly become one of the most widely used methods to compress and accelerate deep neural networks. Recent efforts propose to quantize weights and activations from different layers with different precision to…

Machine Learning · Computer Science 2020-03-18 Yuhang Li , Wei Wang , Haoli Bai , Ruihao Gong , Xin Dong , Fengwei Yu

The Convolutional Neural Network (CNN) is one of the most prominent neural network architectures in deep learning. Despite its widespread adoption, our understanding of its universal approximation properties has been limited due to its…

Neural and Evolutionary Computing · Computer Science 2023-12-05 Geonho Hwang , Myungjoo Kang

A plethora of recent research has focused on improving the memory footprint and inference speed of deep networks by reducing the complexity of (i) numerical representations (for example, by deterministic or stochastic quantization) and (ii)…

Machine Learning · Computer Science 2019-04-05 David Hartmann , Michael Wand

Non-volatile memory (NVM) crossbars have been identified as a promising technology, for accelerating important machine learning operations, with matrix-vector multiplication being a key example. Binary neural networks (BNNs) are especially…

Emerging Technologies · Computer Science 2023-08-14 Ruirong Huang , Zichao Yue , Caroline Huang , Janarbek Matai , Zhiru Zhang

In this era of artificial intelligence, deep neural networks like Convolutional Neural Networks (CNNs) have emerged as front-runners, often surpassing human capabilities. These deep networks are often perceived as the panacea for all…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Neeraj Kumar Singh , Nikhil R. Pal

Recent advances in photoacoustic (PA) imaging have enabled detailed images of microvascular structure and quantitative measurement of blood oxygenation or perfusion. Standard reconstruction methods for PA imaging are based on solving an…

Signal Processing · Electrical Eng. & Systems 2020-04-17 MinWoo Kim , Geng-Shi Jeng , Ivan Pelivanov , Matthew O'Donnell

Attributed to the ever-increasing large image datasets, Convolutional Neural Networks (CNNs) have become popular for vision-based tasks. It is generally admirable to have larger-sized datasets for higher network training accuracies.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Xuan Li , Liqiong Chang , Xue Liu

The recognition ability of human beings is developed in a progressive way. Usually, children learn to discriminate various objects from coarse to fine-grained with limited supervision. Inspired by this learning process, we propose a simple…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Huaxi Huang , Junjie Zhang , Jian Zhang , Qiang Wu , Jingsong Xu

This work presents a method to implement fully convolutional neural networks (FCNs) on Pixel Processor Array (PPA) sensors, and demonstrates coarse segmentation and object localisation tasks. We design and train binarized FCN for both…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Yanan Liu , Laurie Bose , Yao Lu , Piotr Dudek , Walterio Mayol-Cuevas

Convolutional Neural Networks (CNNs) have recently become a favored technique for image denoising due to its adaptive learning ability, especially with a deep configuration. However, their efficacy is inherently limited owing to their…

Image and Video Processing · Electrical Eng. & Systems 2020-09-03 Junaid Malik , Serkan Kiranyaz , Moncef Gabbouj

Discriminative learning based on convolutional neural networks (CNNs) aims to perform image restoration by learning from training examples of noisy-clean image pairs. It has become the go-to methodology for tackling image restoration and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Junaid Malik , Serkan Kiranyaz , Moncef Gabbouj

Deep neural network models, though very powerful and highly successful, are computationally expensive in terms of space and time. Recently, there have been a number of attempts on binarizing the network weights and activations. This greatly…

Neural and Evolutionary Computing · Computer Science 2018-05-11 Lu Hou , Quanming Yao , James T. Kwok

X-Ray image enhancement, along with many other medical image processing applications, requires the segmentation of images into bone, soft tissue, and open beam regions. We apply a machine learning approach to this problem, presenting an…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Joseph Bullock , Carolina Cuesta-Lazaro , Arnau Quera-Bofarull

Purpose: The aim of this work is to demonstrate that convolutional neural networks (CNN) can be applied to extremely sparse image libraries by subdivision of the original image datasets. Methods: Image datasets from a conventional digital…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Johan P. Boetker

This paper tackles the problem of training a deep convolutional neural network of both low-bitwidth weights and activations. Optimizing a low-precision network is very challenging due to the non-differentiability of the quantizer, which may…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Bohan Zhuang , Jing Liu , Mingkui Tan , Lingqiao Liu , Ian Reid , Chunhua Shen

There is an increasing interest in applying deep learning to 3D mesh segmentation. We observe that 1) existing feature-based techniques are often slow or sensitive to feature resizing, 2) there are minimal comparative studies and 3)…

Graphics · Computer Science 2018-02-09 David George , Xianghua Xie , Gary KL Tam