English
Related papers

Related papers: Basic Binary Convolution Unit for Binarized Image …

200 papers

This work investigates use of equivariant neural networks as efficient and high-performance frameworks for image reconstruction and denoising in nuclear medicine. Our work aims to tackle limitations of conventional Convolutional Neural…

Image and Video Processing · Electrical Eng. & Systems 2025-02-03 Amirreza Hashemi , Yuemeng Feng , Arman Rahmim , Hamid Sabet

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Filip Badan , Lukas Sekanina

Convolutional neural networks have achieved astonishing results in different application areas. Various methods that allow us to use these models on mobile and embedded devices have been proposed. Especially binary neural networks are a…

Machine Learning · Computer Science 2018-12-06 Joseph Bethge , Marvin Bornstein , Adrian Loy , Haojin Yang , Christoph Meinel

This study introduces a new normalization layer termed Batch Layer Normalization (BLN) to reduce the problem of internal covariate shift in deep neural network layers. As a combined version of batch and layer normalization, BLN adaptively…

Machine Learning · Computer Science 2023-01-16 Amir Ziaee , Erion Çano

Sequence modeling is a critical yet challenging task with wide-ranging applications, especially in time series forecasting for domains like weather prediction, temperature monitoring, and energy load forecasting. Transformers, with their…

Machine Learning · Computer Science 2025-04-15 Qisai Liu , Zhanhong Jiang , Joshua R. Waite , Chao Liu , Aditya Balu , Soumik Sarkar

Binary Neural Networks (BNNs) are promising to deliver accuracy comparable to conventional deep neural networks at a fraction of the cost in terms of memory and energy. In this paper, we introduce the XNOR Neural Engine (XNE), a fully…

Neural and Evolutionary Computing · Computer Science 2018-07-23 Francesco Conti , Pasquale Davide Schiavone , Luca Benini

This paper describes a CNN where all CNN style 2D convolution operations that lower to matrix matrix multiplication are fully binary. The network is derived from a common building block structure that is consistent with a constructive proof…

Machine Learning · Computer Science 2021-03-08 Arthur J. Redfern , Lijun Zhu , Molly K. Newquist

State-of-the-art convolutional neural networks are enormously costly in both compute and memory, demanding massively parallel GPUs for execution. Such networks strain the computational capabilities and energy available to embedded and…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Jeng-Hau Lin , Tianwei Xing , Ritchie Zhao , Zhiru Zhang , Mani Srivastava , Zhuowen Tu , Rajesh K. Gupta

Significant computational cost and memory requirements for deep neural networks (DNNs) make it difficult to utilize DNNs in resource-constrained environments. Binary neural network (BNN), which uses binary weights and binary activations,…

Neural and Evolutionary Computing · Computer Science 2019-03-26 Hyungjun Kim , Yulhwa Kim , Sungju Ryu , Jae-Joon Kim

This paper presents a new variational inference framework for image restoration and a convolutional neural network (CNN) structure that can solve the restoration problems described by the proposed framework. Earlier CNN-based image…

Image and Video Processing · Electrical Eng. & Systems 2022-07-20 Jae Woong Soh , Nam Ik Cho

Training 1-bit deep convolutional neural networks (DCNNs) is one of the most challenging problems in computer vision, because it is much easier to get trapped into local minima than conventional DCNNs. The reason lies in that the binarized…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Chunlei Liu , Wenrui Ding , Yuan Hu , Baochang Zhang , Jianzhuang Liu , Guodong Guo

The convolutional neural network (CNN) is one of the most commonly used architectures for computer vision tasks. The key building block of a CNN is the convolutional kernel that aggregates information from the pixel neighborhood and shares…

Image and Video Processing · Electrical Eng. & Systems 2022-02-08 Tianyu Ma , Alan Q. Wang , Adrian V. Dalca , Mert R. Sabuncu

Convolutional neural networks (CNNs) have shown promising results on several segmentation tasks in magnetic resonance (MR) images. However, the accuracy of CNNs may degrade severely when segmenting images acquired with different scanners…

Machine Learning · Statistics 2018-05-28 Neerav Karani , Krishna Chaitanya , Christian Baumgartner , Ender Konukoglu

Binary neural networks (BNNs) have received increasing attention due to their superior reductions of computation and memory. Most existing works focus on either lessening the quantization error by minimizing the gap between the…

Machine Learning · Computer Science 2021-08-03 Zihan Xu , Mingbao Lin , Jianzhuang Liu , Jie Chen , Ling Shao , Yue Gao , Yonghong Tian , Rongrong Ji

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

We propose a generalized convolutional neural network (CNN) architecture that first decomposes the input signal into subbands by an adaptive filter bank structure, and then uses convolutional layers to extract features from each subband…

Image and Video Processing · Electrical Eng. & Systems 2023-06-30 Pavel Sinha , Ioannis Psaromiligkos , Zeljko Zilic

For binary neural networks (BNNs) to become the mainstream on-device computer vision algorithm, they must achieve a superior speed-vs-accuracy tradeoff than 8-bit quantization and establish a similar degree of general applicability in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Guhong Nie , Lirui Xiao , Menglong Zhu , Dongliang Chu , Yue Shen , Peng Li , Kang Yang , Li Du , Bo Chen

Convolutional neural networks (CNNs) for biomedical image analysis are often of very large size, resulting in high memory requirement and high latency of operations. Searching for an acceptable compressed representation of the base CNN for…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Suraj Mishra , Peixian Liang , Adam Czajka , Danny Z. Chen , X. Sharon Hu

Image restoration from a single image degradation type, such as blurring, hazing, random noise, and compression has been investigated for decades. However, image degradations in practice are often a mixture of several types of degradation.…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Kazutaka Uchida , Masayuki Tanaka , Masatoshi Okutomi

Deep learning (DL) based semantic segmentation methods have been providing state-of-the-art performance in the last few years. More specifically, these techniques have been successfully applied to medical image classification, segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Md Zahangir Alom , Mahmudul Hasan , Chris Yakopcic , Tarek M. Taha , Vijayan K. Asari