中文
相关论文

相关论文: E2FIF: Push the limit of Binarized Deep Imagery Su…

200 篇论文

For the efficient execution of deep convolutional neural networks (CNN) on edge devices, various approaches have been presented which reduce the bit width of the network parameters down to 1 bit. Binarization of the first layer was always…

机器学习 · 计算机科学 2018-12-11 Robert Dürichen , Thomas Rocznik , Oliver Renz , Christian Peters

In the low-bit quantization field, training Binary Neural Networks (BNNs) is the extreme solution to ease the deployment of deep models on resource-constrained devices, having the lowest storage cost and significantly cheaper bit-wise…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Yikai Wang , Yi Yang , Fuchun Sun , Anbang Yao

Low-precision weights and activations in deep neural networks (DNNs) outperform their full-precision counterparts in terms of hardware efficiency. When implemented with low-precision operations, specifically in the extreme case where…

人工智能 · 计算机科学 2024-07-09 Behnam Ghavami , Mohammad Shahidzadeh , Lesley Shannon , Steve Wilton

Being a promising model to be deployed in resource-limited devices, Binarized Neural Networks (BNNs) have drawn extensive attention from both academic and industry. However, comparing to the full-precision deep neural networks (DNNs), BNNs…

机器学习 · 计算机科学 2022-06-08 Yanfei Li , Ang Li , Huimin Yu

Non-volatile memory (NVM) crossbars have been identified as a promising technology, for accelerating important machine learning operations, with matrix-vector multiplication being a key example. Binary neural networks (BNNs) are especially…

新兴技术 · 计算机科学 2023-08-14 Ruirong Huang , Zichao Yue , Caroline Huang , Janarbek Matai , Zhiru Zhang

Model binarization is an effective method of compressing neural networks and accelerating their inference process. However, a significant performance gap still exists between the 1-bit model and the 32-bit one. The empirical study shows…

计算机视觉与模式识别 · 计算机科学 2022-09-26 Haotong Qin , Xiangguo Zhang , Ruihao Gong , Yifu Ding , Yi Xu , Xianglong Liu

Binarized Neural Networks (BNNs) significantly reduce the computation and memory demands with binarized weights and activations compared to full-precision NNs. Executing a layer in a BNN on different devices of a heterogeneous…

分布式、并行与集群计算 · 计算机科学 2023-01-13 Leonard David Bereholschi , Ching-Chi Lin , Mikail Yayla , Jian-Jia Chen

Binary Neural Networks (BNNs) have gained extensive attention for their superior inferencing efficiency and compression ratio compared to traditional full-precision networks. However, due to the unique characteristics of BNNs, designing a…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Zhihao Lin , Yongtao Wang , Jinhe Zhang , Xiaojie Chu , Haibin Ling

Recently, the deep neural network (derived from the artificial neural network) has attracted many researchers' attention by its outstanding performance. However, since this network requires high-performance GPUs and large storage, it is…

神经与进化计算 · 计算机科学 2016-02-25 Song Wang , Dongchun Ren , Li Chen , Wei Fan , Jun Sun , Satoshi Naoi

Significant computational cost and memory requirements for deep neural networks (DNNs) make it difficult to utilize DNNs in resource-constrained environments. Binary neural network (BNN), which uses binary weights and binary activations,…

神经与进化计算 · 计算机科学 2019-03-26 Hyungjun Kim , Yulhwa Kim , Sungju Ryu , Jae-Joon Kim

Weight and activation binarization can efficiently compress deep neural networks and accelerate model inference, but cause severe accuracy degradation. Existing optimization methods for binary neural networks (BNNs) focus on fitting…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Ping Xue , Yang Lu , Jingfei Chang , Xing Wei , Zhen Wei

Network binarization is a promising hardware-aware direction for creating efficient deep models. Despite its memory and computational advantages, reducing the accuracy gap between binary models and their real-valued counterparts remains an…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Adrian Bulat , Brais Martinez , Georgios Tzimiropoulos

Deep learning (DL) has recently changed the development of intelligent systems and is widely adopted in many real-life applications. Despite their various benefits and potentials, there is a high demand for DL processing in different…

神经与进化计算 · 计算机科学 2023-04-05 Chunyu Yuan , Sos S. Agaian

Deep neural networks are highly effective at a range of computational tasks. However, they tend to be computationally expensive, especially in vision-related problems, and also have large memory requirements. One of the most effective…

计算机视觉与模式识别 · 计算机科学 2018-04-10 Ameya Prabhu , Vishal Batchu , Sri Aurobindo Munagala , Rohit Gajawada , Anoop Namboodiri

It is always well believed that Binary Neural Networks (BNNs) could drastically accelerate the inference efficiency by replacing the arithmetic operations in float-valued Deep Neural Networks (DNNs) with bit-wise operations. Nevertheless,…

计算机视觉与模式识别 · 计算机科学 2019-08-19 Jianhao Zhang , Yingwei Pan , Ting Yao , He Zhao , Tao Mei

Single Image Super-Resolution (SISR) aims to generate a high-resolution (HR) image of a given low-resolution (LR) image. The most of existing convolutional neural network (CNN) based SISR methods usually take an assumption that a LR image…

图像与视频处理 · 电气工程与系统科学 2019-09-10 Rao Muhammad Umer , Gian Luca Foresti , Christian Micheloni

Recent years have witnessed the unprecedented success of deep convolutional neural networks (CNNs) in single image super-resolution (SISR). However, existing CNN-based SISR methods mostly assume that a low-resolution (LR) image is bicubicly…

计算机视觉与模式识别 · 计算机科学 2018-05-25 Kai Zhang , Wangmeng Zuo , Lei Zhang

Binarized neural networks (BNNs) are gaining interest in the deep learning community due to their significantly lower computational and memory cost. They are particularly well suited to reconfigurable logic devices, which contain an…

计算机视觉与模式识别 · 计算机科学 2017-01-30 Nicholas J. Fraser , Yaman Umuroglu , Giulio Gambardella , Michaela Blott , Philip Leong , Magnus Jahre , Kees Vissers

Recently developed adversarial weight attack, a.k.a. bit-flip attack (BFA), has shown enormous success in compromising Deep Neural Network (DNN) performance with an extremely small amount of model parameter perturbation. To defend against…

机器学习 · 计算机科学 2021-03-26 Adnan Siraj Rakin , Li Yang , Jingtao Li , Fan Yao , Chaitali Chakrabarti , Yu Cao , Jae-sun Seo , Deliang Fan

Deep Convolutional Neural Network (DCNN) and Transformer have achieved remarkable successes in image recognition. However, their performance in fine-grained image recognition is still difficult to meet the requirements of actual needs. This…

计算机视觉与模式识别 · 计算机科学 2021-06-08 Chaorong Li , Malu Zhang , Wei Huang , Fengqing Qin , Anping Zeng , Yuanyuan Huang