中文
相关论文

相关论文: Deep Neural Network inference with reduced word le…

200 篇论文

Deep neural networks (DNNs) have the advantage that they can take into account a large number of parameters, which enables them to solve complex tasks. In computer vision and speech recognition, they have a better accuracy than common…

机器学习 · 计算机科学 2021-04-20 Lukas Baischer , Matthias Wess , Nima TaheriNejad

Deep neural networks (DNN) have been widely used and play a major role in the field of computer vision and autonomous navigation. However, these DNNs are computationally complex and their deployment over resource-constrained platforms is…

机器学习 · 计算机科学 2022-08-01 Mee Seong Im , Venkat R. Dasari

The concept of compressing deep Convolutional Neural Networks (CNNs) is essential to use limited computation, power, and memory resources on embedded devices. However, existing methods achieve this objective at the cost of a drop in…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Waqar Ahmed , Andrea Zunino , Pietro Morerio , Vittorio Murino

Deep neural networks (DNNs) have recently achieved great success in many visual recognition tasks. However, existing deep neural network models are computationally expensive and memory intensive, hindering their deployment in devices with…

机器学习 · 计算机科学 2020-06-16 Yu Cheng , Duo Wang , Pan Zhou , Tao Zhang

As recently demonstrated, Deep Neural Networks (DNN), usually trained using single precision IEEE 754 floating point numbers (binary32), can also work using lower precision. Therefore, 16-bit and 8-bit compressed format have attracted…

Being able to learn from complex data with phase information is imperative for many signal processing applications. Today' s real-valued deep neural networks (DNNs) have shown efficiency in latent information analysis but fall short when…

Deep neural networks are commonly developed and trained in 32-bit floating point format. Significant gains in performance and energy efficiency could be realized by training and inference in numerical formats optimized for deep learning.…

Low-precision DNNs have been extensively explored in order to reduce the size of DNN models for edge devices. Recently, the posit numerical format has shown promise for DNN data representation and compute with ultra-low precision in…

机器学习 · 计算机科学 2019-08-08 Hamed F. Langroudi , Zachariah Carmichael , David Pastuch , Dhireesha Kudithipudi

Deep neural networks are state-of-the-art models for understanding the content of images, video and raw input data. However, implementing a deep neural network in embedded systems is a challenging task, because a typical deep neural…

机器学习 · 计算机科学 2016-04-22 Xichuan Zhou , Shengli Li , Kai Qin , Kunping Li , Fang Tang , Shengdong Hu , Shujun Liu , Zhi Lin

Deep Neural Networks (DNN) achieve human level performance in many image analytics tasks but DNNs are mostly deployed to GPU platforms that consume a considerable amount of power. New hardware platforms using lower precision arithmetic…

神经与进化计算 · 计算机科学 2017-05-23 Antonio Jimeno Yepes , Jianbin Tang , Benjamin Scott Mashford

In the low-bit quantization field, training Binary Neural Networks (BNNs) is the extreme solution to ease the deployment of deep models on resource-constrained devices, having the lowest storage cost and significantly cheaper bit-wise…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Yikai Wang , Yi Yang , Fuchun Sun , Anbang Yao

Deep neural networks (DNNs) have demonstrated remarkable performance in many tasks but it often comes at a high computational cost and memory usage. Compression techniques, such as pruning and quantization, are applied to reduce the memory…

机器学习 · 计算机科学 2025-07-09 Kimia Soroush , Mohsen Raji , Behnam Ghavami

Quantization of weights and activations in Deep Neural Networks (DNNs) is a powerful technique for network compression, and has enjoyed significant attention and success. However, much of the inference-time benefit of quantization is…

性能 · 计算机科学 2019-12-13 Andrew Anderson , David Gregg

Deploying deep neural networks (DNNs) in real-world environments poses challenges due to faults that can manifest in physical hardware from radiation, aging, and temperature fluctuations. To address this, previous works have focused on…

机器学习 · 计算机科学 2024-12-02 Ninnart Fuengfusin , Hakaru Tamukoh

Deep neural networks (DNNs) underpin many machine learning applications. Production quality DNN models achieve high inference accuracy by training millions of DNN parameters which has a significant resource footprint. This presents a…

机器学习 · 计算机科学 2025-04-09 Bailey J. Eccles , Philip Rodgers , Peter Kilpatrick , Ivor Spence , Blesson Varghese

Modern CNN are typically based on floating point linear algebra based implementations. Recently, reduced precision NN have been gaining popularity as they require significantly less memory and computational resources compared to floating…

计算机视觉与模式识别 · 计算机科学 2018-07-30 Jiang Su , Nicholas J. Fraser , Giulio Gambardella , Michaela Blott , Gianluca Durelli , David B. Thomas , Philip Leong , Peter Y. K. Cheung

Deep learning methods have shown great promise in many practical applications, ranging from speech recognition, visual object recognition, to text processing. However, most of the current deep learning methods suffer from scalability…

机器学习 · 统计学 2015-08-31 Yanping Huang , Sai Zhang

Deep neural networks (DNNs) are state-of-the-art techniques for solving most computer vision problems. DNNs require billions of parameters and operations to achieve state-of-the-art results. This requirement makes DNNs extremely compute,…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Ishmeet Kaur , Adwaita Janardhan Jadhav

Previous work has shown that it is possible to train deep neural networks with low precision weights and activations. In the extreme case it is even possible to constrain the network to binary values. The costly floating point…

神经与进化计算 · 计算机科学 2017-11-30 Sam Leroux , Steven Bohez , Tim Verbelen , Bert Vankeirsbilck , Pieter Simoens , Bart Dhoedt

In collaborative intelligence applications, part of a deep neural network (DNN) is deployed on a lightweight device such as a mobile phone or edge device, and the remaining portion of the DNN is processed where more computing resources are…

机器学习 · 计算机科学 2021-05-18 Robert A. Cohen , Hyomin Choi , Ivan V. Bajić