中文
相关论文

相关论文: DeepShift: Towards Multiplication-Less Neural Netw…

200 篇论文

A novel energy-efficient edge computing paradigm is proposed for real-time deep learning-based image upsampling applications. State-of-the-art deep learning solutions for image upsampling are currently trained using either resize or…

计算机视觉与模式识别 · 计算机科学 2021-07-27 Ian Colbert , Ken Kreutz-Delgado , Srinjoy Das

In this paper, we study 1-bit convolutional neural networks (CNNs), of which both the weights and activations are binary. While efficient, the lacking of representational capability and the training difficulty impede 1-bit CNNs from…

计算机视觉与模式识别 · 计算机科学 2019-09-05 Zechun Liu , Wenhan Luo , Baoyuan Wu , Xin Yang , Wei Liu , Kwang-Ting Cheng

In this work, we study the 1-bit convolutional neural networks (CNNs), of which both the weights and activations are binary. While being efficient, the classification accuracy of the current 1-bit CNNs is much worse compared to their…

计算机视觉与模式识别 · 计算机科学 2018-10-02 Zechun Liu , Baoyuan Wu , Wenhan Luo , Xin Yang , Wei Liu , Kwang-Ting Cheng

Convolutional neural networks (CNNs) with deep architectures have substantially advanced the state-of-the-art in computer vision tasks. However, deep networks are typically resource-intensive and thus difficult to be deployed on mobile…

神经与进化计算 · 计算机科学 2017-06-08 Yiwen Guo , Anbang Yao , Hao Zhao , Yurong Chen

This paper proposes a training method having multiple cyclic training for achieving enhanced performance in low-bit quantized convolutional neural networks (CNNs). Quantization is a popular method for obtaining lightweight CNNs, where the…

计算机视觉与模式识别 · 计算机科学 2022-06-28 HyunJin Kim , Jungwoo Shin , Alberto A. Del Barrio

The Deep Convolutional Neural Networks (CNNs) have obtained a great success for pattern recognition, such as recognizing the texts in images. But existing CNNs based frameworks still have several drawbacks: 1) the traditaional pooling…

计算机视觉与模式识别 · 计算机科学 2020-01-20 Zhao Zhang , Zemin Tang , Zheng Zhang , Yang Wang , Jie Qin , Meng Wang

The quantized neural network (QNN) is an efficient approach for network compression and can be widely used in the implementation of FPGAs. This paper proposes a novel learning framework for n-bit QNNs, whose weights are constrained to the…

机器学习 · 计算机科学 2020-04-07 Jun Chen , Liang Liu , Yong Liu , Xianfang Zeng

Convolutional Neural Networks (CNNs) have proven to be a powerful state-of-the-art method for image classification tasks. One drawback however is the high computational complexity and high memory consumption of CNNs which makes them…

计算机视觉与模式识别 · 计算机科学 2021-02-04 Rishabh Goyal , Joaquin Vanschoren , Victor van Acht , Stephan Nijssen

Deep convolutional neural networks (DCNN) are currently ubiquitous in medical imaging. While their versatility and high quality results for common image analysis tasks including segmentation, localisation and prediction is astonishing, the…

计算机视觉与模式识别 · 计算机科学 2018-07-03 Mattias P. Heinrich , Max Blendowski , Ozan Oktay

This paper is focused on the improvement the efficiency of the sparse convolutional neural networks (CNNs) layers on graphic processing units (GPU). The Nvidia deep neural network (cuDnn) library provides the most effective implementation…

机器学习 · 计算机科学 2022-01-03 Marcin Pietroń , Dominik Żurek

Porting state of the art deep learning algorithms to resource constrained compute platforms (e.g. VR, AR, wearables) is extremely challenging. We propose a fast, compact, and accurate model for convolutional neural networks that enables…

计算机视觉与模式识别 · 计算机科学 2017-06-14 Hessam Bagherinezhad , Mohammad Rastegari , Ali Farhadi

Binary neural networks (BNNs), where both weights and activations are binarized into 1 bit, have been widely studied in recent years due to its great benefit of highly accelerated computation and substantially reduced memory footprint that…

计算机视觉与模式识别 · 计算机科学 2021-01-01 Zhuo Su , Linpu Fang , Deke Guo , Dewen Hu , Matti Pietikäinen , Li Liu

Convolutional neural networks (CNNs) have constantly achieved better performance over years by introducing more complex topology, and enlarging the capacity towards deeper and wider CNNs. This makes the manual design of CNNs extremely…

计算机视觉与模式识别 · 计算机科学 2022-12-09 Bin Wang , Bing Xue , Mengjie Zhang

Large-scale convolutional neural networks (CNNs) suffer from very long training times, spanning from hours to weeks, limiting the productivity and experimentation of deep learning practitioners. As networks grow in size and complexity,…

计算机视觉与模式识别 · 计算机科学 2020-06-18 Aditya Rajagopal , Diederik Adriaan Vink , Stylianos I. Venieris , Christos-Savvas Bouganis

Deep Neural Networks (DNNs) are computationally and memory intensive, which makes their hardware implementation a challenging task especially for resource constrained devices such as IoT nodes. To address this challenge, this paper…

计算机视觉与模式识别 · 计算机科学 2021-05-10 Mohammed F. Tolba , Huruy Tekle Tesfai , Hani Saleh , Baker Mohammad , Mahmoud Al-Qutayri

Due to the advent of modern embedded systems and mobile devices with constrained resources, there is a great demand for incredibly efficient deep neural networks for machine learning purposes. There is also a growing concern of privacy and…

计算机视觉与模式识别 · 计算机科学 2021-12-02 Priyank Kalgaonkar , Mohamed El-Sharkawy

Binary Convolutional Neural Networks (CNNs) can significantly reduce the number of arithmetic operations and the size of memory storage, which makes the deployment of CNNs on mobile or embedded systems more promising. However, the accuracy…

计算机视觉与模式识别 · 计算机科学 2020-09-01 Baozhou Zhu , Zaid Al-Ars , Wei Pan

It is well known that Convolutional Neural Networks (CNNs) have significant redundancy in their filter weights. Various methods have been proposed in the literature to compress trained CNNs. These include techniques like pruning weights,…

机器学习 · 计算机科学 2019-06-12 Muhammad Tayyab , Abhijit Mahalanobis

The training of deep and/or convolutional neural networks (DNNs/CNNs) is traditionally done on servers with powerful CPUs and GPUs. Recent efforts have emerged to localize machine learning tasks fully on the edge. This brings advantages in…

分布式、并行与集群计算 · 计算机科学 2024-09-17 Pranav Rama , Madison Threadgill , Andreas Gerstlauer

Efficiently deploying deep neural networks on low-resource edge devices is challenging due to their ever-increasing resource requirements. To address this issue, researchers have proposed multiplication-free neural networks, such as…

计算机视觉与模式识别 · 计算机科学 2023-10-25 Xinlin Li , Bang Liu , Rui Heng Yang , Vanessa Courville , Chao Xing , Vahid Partovi Nia