English
Related papers

Related papers: FPGA-accelerated machine learning inference as a s…

200 papers

Federated Learning (FL) has become very popular since it enables clients to train a joint model collaboratively without sharing their private data. However, FL has been shown to be susceptible to backdoor and inference attacks. While in the…

Cryptography and Security · Computer Science 2023-08-02 Huimin Li , Phillip Rieger , Shaza Zeitouni , Stjepan Picek , Ahmad-Reza Sadeghi

The energy and latency costs of deep neural network inference are increasingly driven by deployment rather than training, motivating hardware-specialized alternatives to arithmetic-heavy models. Field-Programmable Gate Arrays (FPGAs)…

Machine Learning · Computer Science 2026-02-10 Simon Bührer , Andreas Plesner , Aczel Till , Roger Wattenhofer

Convolutional Neural Networks (CNNs) have a major impact on our society because of the numerous services they provide. On the other hand, they require considerable computing power. To satisfy these requirements, it is possible to use…

Machine Learning · Computer Science 2020-04-13 Alireza Ghaffari , Yvon Savaria

Deep neural networks (DNNs) are used by different applications that are executed on a range of computer architectures, from IoT devices to supercomputers. The footprint of these networks is huge as well as their computational and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Chaim Baskin , Natan Liss , Evgenii Zheltonozhskii , Alex M. Bronshtein , Avi Mendelson

The use of reconfigurable computing, and FPGAs in particular, to accelerate computational kernels has the potential to be of great benefit to scientific codes and the HPC community in general. However, whilst recent advanced in FPGA tooling…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-06 Nick Brown , David Dolman

This work presents a novel reconfigurable architecture for Low Latency Graph Neural Network (LL-GNN) designs for particle detectors, delivering unprecedented low latency performance. Incorporating FPGA-based GNNs into particle detectors…

Hardware Architecture · Computer Science 2024-01-19 Zhiqiang Que , Hongxiang Fan , Marcus Loo , He Li , Michaela Blott , Maurizio Pierini , Alexander Tapper , Wayne Luk

Detector simulation and reconstruction are a significant computational bottleneck in particle physics. We develop Particle-flow Neural Assisted Simulations (Parnassus) to address this challenge. Our deep learning model takes as input a…

Data Analysis, Statistics and Probability · Physics 2024-11-22 Etienne Dreyer , Eilam Gross , Dmitrii Kobylianskii , Vinicius Mikuni , Benjamin Nachman , Nathalie Soybelman

Mini-batch inference of Graph Neural Networks (GNNs) is a key problem in many real-world applications. Recently, a GNN design principle of model depth-receptive field decoupling has been proposed to address the well-known issue of…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-05 Bingyi Zhang , Hanqing Zeng , Viktor Prasanna

While hardware implementations of inference routines for Binarized Neural Networks (BNNs) are plentiful, current realizations of efficient BNN hardware training accelerators, suitable for Internet of Things (IoT) edge devices, leave much to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Corey Lammie , Wei Xiang , Mostafa Rahimi Azghadi

Modern deep learning applications urge to push the model inference taking place at the edge devices for multiple reasons such as achieving shorter latency, relieving the burden of the network connecting to the cloud, and protecting user…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-05 Leyuan Wang , Zhi Chen , Yizhi Liu , Yao Wang , Lianmin Zheng , Mu Li , Yida Wang

Hyperspectral image (HSI) classification has been widely adopted in applications involving remote sensing imagery analysis which require high classification accuracy and real-time processing speed. Methods based on Convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-08-21 Shuanglong Liu , Ringo S. W. Chu , Xiwei Wang , Wayne Luk

Developing high performance embedded vision applications requires balancing run-time performance with energy constraints. Given the mix of hardware accelerators that exist for embedded computer vision (e.g. multi-core CPUs, GPUs, and…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Murad Qasaimeh , Kristof Denolf , Jack Lo , Kees Vissers , Joseph Zambreno , Phillip H. Jones

Reliable uncertainty estimation plays a crucial role in various safety-critical applications such as medical diagnosis and autonomous driving. In recent years, Bayesian neural networks (BayesNNs) have gained substantial research and…

Machine Learning · Computer Science 2024-06-25 Hao Mark Chen , Liam Castelli , Martin Ferianc , Hongyu Zhou , Shuanglong Liu , Wayne Luk , Hongxiang Fan

Efficient quantum control is necessary for practical quantum computing implementations with current technologies. Conventional algorithms for determining optimal control parameters are computationally expensive, largely excluding them from…

This paper introduces an effort to incorporate reconfigurable logic (FPGA) components into a software programming model. For this purpose, we have implemented a hardware engine for remote memory communication between hardware computation…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-08-22 Ruediger Willenberg , Paul Chow

We have a FPGA design, we make it fast, efficient, and tested for a few important examples. Now we must infer a general solution to deploy in the data center. Here, we describe the FPGA DPUV3INT8 design and our compiler effort. The…

Computation and Language · Computer Science 2021-10-12 Paolo D'Alberto , Jiangsha Ma , Jintao Li , Yiming Hu , Manasa Bollavaram , Shaoxia Fang

A deep-learning inference accelerator is synthesized from a C-language software program parallelized with Pthreads. The software implementation uses the well-known producer/consumer model with parallel threads interconnected by FIFO queues.…

Machine Learning · Computer Science 2018-07-30 Jin Hee Kim , Brett Grady , Ruolong Lian , John Brothers , Jason H. Anderson

Deep networks are now able to achieve human-level performance on a broad spectrum of recognition tasks. Independently, neuromorphic computing has now demonstrated unprecedented energy-efficiency through a new chip architecture based on…

Graph Neural Networks (GNNs) have shown great success in many applications such as recommendation systems, molecular property prediction, traffic prediction, etc. Recently, CPU-FPGA heterogeneous platforms have been used to accelerate many…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-23 Yi-Chien Lin , Bingyi Zhang , Viktor Prasanna

Three machine learning models are used to perform jet origin classification. These models are optimized for deployment on a field-programmable gate array device. In this context, we demonstrate how latency and resource consumption scale…