English
Related papers

Related papers: Compressing deep neural networks on FPGAs to binar…

200 papers

Recurrent neural networks (RNNs) have shown excellent performance in processing sequence data. However, they are both complex and memory intensive due to their recursive nature. These limitations make RNNs difficult to embed on mobile…

Machine Learning · Computer Science 2019-01-28 Arash Ardakani , Zhengyun Ji , Sean C. Smithson , Brett H. Meyer , Warren J. Gross

Recent breakthroughs in computer vision make use of large deep neural networks, utilizing the substantial speedup offered by GPUs. For applications running on limited hardware, however, high precision real-time processing can still be a…

Machine Learning · Computer Science 2018-02-05 Oran Shayer , Dan Levi , Ethan Fetaya

Artificial neural networks are already widely used for physics analysis, but there are only few applications within low-level hardware triggers, and typically only with small networks. Modern high-end FPGAs offer Tera-scale arithmetic…

Instrumentation and Detectors · Physics 2020-01-29 N. Nottbeck , C. Schmitt , V. Büscher

Quantization of weights of deep neural networks (DNN) has proven to be an effective solution for the purpose of implementing DNNs on edge devices such as mobiles, ASICs and FPGAs, because they have no sufficient resources to support…

Machine Learning · Computer Science 2019-12-20 Tianyu Zhang , Lei Zhu , Qian Zhao , Kilho Shin

Low-bit quantized neural networks are of great interest in practical applications because they significantly reduce the consumption of both memory and computational resources. Binary neural networks are memory and computationally efficient…

Machine Learning · Computer Science 2022-05-20 Anton Trusov , Elena Limonova , Dmitry Nikolaev , Vladimir V. Arlazarov

Binary Neural Networks (BNNs) are neural networks which use binary weights and activations instead of the typical 32-bit floating point values. They have reduced model sizes and allow for efficient inference on mobile or embedded devices…

Machine Learning · Computer Science 2020-03-25 Joseph Bethge , Christian Bartz , Haojin Yang , Ying Chen , Christoph Meinel

Binary Neural Networks (BNNs) enable efficient deep learning by saving on storage and computational costs. However, as the size of neural networks continues to grow, meeting computational requirements remains a challenge. In this work, we…

Machine Learning · Computer Science 2024-07-18 Matt Gorbett , Hossein Shirazi , Indrakshi Ray

Neural network models are resource hungry. It is difficult to deploy such deep networks on devices with limited resources, like smart wearables, cellphones, drones, and autonomous vehicles. Low bit quantization such as binary and ternary…

Machine Learning · Computer Science 2021-09-15 Ryan Razani , Grégoire Morin , Vahid Partovi Nia , Eyyüb Sari

We are trying to implement deep neural networks in the edge computing environment for real-world applications such as the IoT(Internet of Things), the FinTech etc., for the purpose of utilizing the significant achievement of Deep Learning…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Hideo Terada , Hayaru Shouno

Deep convolutional neural networks (DCNN) are currently ubiquitous in medical imaging. While their versatility and high quality results for common image analysis tasks including segmentation, localisation and prediction is astonishing, the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Mattias P. Heinrich , Max Blendowski , Ozan Oktay

Ternary and binary neural networks enable multiplication-free computation and promise multiple orders of magnitude efficiency gains over full-precision networks if implemented on specialized hardware. However, since both the parameter and…

Computation and Language · Computer Science 2023-06-06 Zechun Liu , Barlas Oguz , Aasish Pappu , Yangyang Shi , Raghuraman Krishnamoorthi

We investigate the application of hybrid quantum tensor networks to aeroelastic problems, harnessing the power of Quantum Machine Learning (QML). By combining tensor networks with variational quantum circuits, we demonstrate the potential…

Quantum Physics · Physics 2025-08-08 M. Lautaro Hickmann , Pedro Alves , David Quero , Friedhelm Schwenker , Hans-Martin Rieser

We propose a cluster-based quantization method to convert pre-trained full precision weights into ternary weights with minimal impact on the accuracy. In addition, we also constrain the activations to 8-bits thus enabling sub 8-bit full…

Machine Learning · Computer Science 2017-02-02 Naveen Mellempudi , Abhisek Kundu , Dipankar Das , Dheevatsa Mudigere , Bharat Kaul

Deep neural networks are an extremely successful and widely used technique for various pattern recognition and machine learning tasks. Due to power and resource constraints, these computationally intensive networks are difficult to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-02 Thorbjörn Posewsky , Daniel Ziener

Neural networks with a latency requirement on the order of microseconds, like the ones used at the CERN Large Hadron Collider, are typically deployed on FPGAs fully unrolled and pipelined. A bottleneck for the deployment of such neural…

Hardware Architecture · Computer Science 2026-04-27 Chang Sun , Zhiqiang Que , Vladimir Loncar , Wayne Luk , Maria Spiropulu

A neural network based flexible object manipulation system for a humanoid robot on FPGA is proposed. Although the manipulations of flexible objects using robots attract ever increasing attention since these tasks are the basic and essential…

Robotics · Computer Science 2021-07-02 Satoshi Ohara , Tetsuya Ogata , Hiromitsu Awano

Deep neural networks (DNNs) have proven successful in a wide variety of applications such as speech recognition and synthesis, computer vision, machine translation, and game playing, to name but a few. However, existing deep neural network…

Machine Learning · Computer Science 2022-08-08 Ramit Pahwa

Binarization is an extreme network compression approach that provides large computational speedups along with energy and memory savings, albeit at significant accuracy costs. We investigate the question of where to binarize inputs at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Ameya Prabhu , Vishal Batchu , Rohit Gajawada , Sri Aurobindo Munagala , Anoop Namboodiri

We present a generic parallel implementation of the decision tree-based machine learning (ML) method in hardware description language (HDL) on field programmable gate arrays (FPGA). A regression problem in high energy physics at the Large…

High Energy Physics - Experiment · Physics 2025-11-05 Pavel Serhiayenka , Stephen Roche , Benjamin Carlson , Tae Min Hong

Binary neural networks (BNNs) have 1-bit weights and activations. Such networks are well suited for FPGAs, as their dominant computations are bitwise arithmetic and the memory requirement is also significantly reduced. However, compared to…

Machine Learning · Computer Science 2020-12-23 Yichi Zhang , Junhao Pan , Xinheng Liu , Hongzheng Chen , Deming Chen , Zhiru Zhang