English
Related papers

Related papers: Ultra Fast Transformers on FPGAs for Particle Phys…

200 papers

Convolutional Neural Networks (CNNs) are fundamental to deep learning, driving applications across various domains. However, their growing complexity has significantly increased computational demands, necessitating efficient hardware…

Machine Learning · Computer Science 2025-05-21 Junye Jiang , Yaan Zhou , Yuanhao Gong , Haoxuan Yuan , Shuanglong Liu

Transformer neural networks (TNNs) are being applied across a widening range of application domains, including natural language processing (NLP), machine translation, and computer vision (CV). Their popularity is largely attributed to the…

Hardware Architecture · Computer Science 2025-12-22 Ehsan Kabir , Md. Arafat Kabir , Austin R. J. Downey , Jason D. Bakos , David Andrews , Miaoqing Huang

We describe the implementation of Boosted Decision Trees in the hls4ml library, which allows the translation of a trained model into FPGA firmware through an automated conversion process. Thanks to its fully on-chip implementation, hls4ml…

Field-programmable gate arrays (FPGAs) are widely used to implement deep learning inference. Standard deep neural network inference involves the computation of interleaved linear maps and nonlinear activation functions. Prior work for…

Machine Learning · Computer Science 2024-02-12 Marta Andronic , George A. Constantinides

Transformers have revolutionized deep learning with applications in natural language processing, computer vision, and beyond. However, their computational demands make it challenging to deploy them on low-power edge devices. This paper…

Hardware Architecture · Computer Science 2025-07-18 Rohit Prasad

Domain-specialized FPGAs have delivered unprecedented performance for low-latency inference across scientific and industrial workloads, yet nearly all existing accelerators assume static models trained offline, relegating learning and…

Hardware Architecture · Computer Science 2026-02-03 Duc Hoang

The use of Field Programmable Gate Arrays (FPGAs) to accelerate computational kernels has the potential to be of great benefit to scientific codes and the HPC community in general. With the recent developments in FPGA programming…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-06 Nick Brown

This work presents a novel reconfigurable architecture for Low Latency Graph Neural Network (LL-GNN) designs for particle detectors, delivering unprecedented low latency performance. Incorporating FPGA-based GNNs into particle detectors…

Hardware Architecture · Computer Science 2024-01-19 Zhiqiang Que , Hongxiang Fan , Marcus Loo , He Li , Michaela Blott , Maurizio Pierini , Alexander Tapper , Wayne Luk

Transformers and vision-language models (VLMs) have emerged as dominant architectures in computer vision and multimodal AI, offering state-of-the-art performance in tasks such as image classification, object detection, visual question…

Hardware Architecture · Computer Science 2025-09-05 Safa Mohammed Sali , Mahmoud Meribout , Ashiyana Abdul Majeed

Fast Fourier transform (FFT) of large number of samples requires huge hardware resources of field programmable gate arrays (FPGA), which needs more area and power. In this paper, we present an area efficient architecture of FFT processor…

Hardware Architecture · Computer Science 2015-02-26 Atin Mukherjee , Amitabha Sinha , Debesh Choudhury

The growing adoption of Deep Learning (DL) applications in the Internet of Things has increased the demand for energy-efficient accelerators. Field Programmable Gate Arrays (FPGAs) offer a promising platform for such acceleration due to…

Hardware Architecture · Computer Science 2025-04-15 Chao Qian

Transformer-based models have shown strong performance across diverse time-series tasks, but their deployment on resource-constrained devices remains challenging due to high memory and computational demand. While prior work targeting…

Machine Learning · Computer Science 2025-09-22 Tianheng Ling , Chao Qian , Lukas Johannes Haßler , Gregor Schiele

In-time particle trajectory reconstruction in the Large Hadron Collider is challenging due to the high collision rate and numerous particle hits. Using GNN (Graph Neural Network) on FPGA has enabled superior accuracy with flexible…

Hardware Architecture · Computer Science 2023-06-28 Shi-Yu Huang , Yun-Chen Yang , Yu-Ru Su , Bo-Cheng Lai , Javier Duarte , Scott Hauck , Shih-Chieh Hsu , Jin-Xuan Hu , Mark S. Neubauer

The high instantaneous luminosities expected following the upgrade of the Large Hadron Collider (LHC) to the High Luminosity LHC (HL-LHC) pose major experimental challenges for the CMS experiment. A central component to allow efficient…

The determination of charged particle trajectories (tracking) in collisions at the CERN Large Hadron Collider (LHC) is one of the most important aspects for event reconstruction at hadron colliders. This is especially true in the high…

Instrumentation and Detectors · Physics 2022-12-06 H. Abidi , A. Boveia , V. Cavaliere , D. Furletov , A. Gekow , C. W. Kalderon , S. Yoo

The advent of unmanned aerial vehicles (UAVs) has improved a variety of fields by providing a versatile, cost-effective and accessible platform for implementing state-of-the-art algorithms. To accomplish a broader range of tasks, there is a…

Systems and Control · Electrical Eng. & Systems 2024-03-29 Sharif Azem , David Scheunert , Mengguang Li , Jonas Gehrunger , Kai Cui , Christian Hochberger , Heinz Koeppl

While there is a large body of research on efficient processing of deep neural networks (DNNs), ultra-low-latency realization of these models for applications with stringent, sub-microsecond latency requirements continues to be an…

Machine Learning · Computer Science 2021-04-13 Mahdi Nazemi , Arash Fayyazi , Amirhossein Esmaili , Atharva Khare , Soheil Nazar Shahsavani , Massoud Pedram

Machine learning algorithms are being used more frequently in the first-level triggers in collider experiments, with Graph Neural Networks pushing the hardware requirements of FPGA-based triggers beyond the current state of the art. To meet…

High Energy Physics - Experiment · Physics 2026-02-27 Marc Neu , Isabel Haide , Torben Ferber , Jürgen Becker

Transformer models have achieved state-of-the-art performance across a wide range of machine learning tasks. There is growing interest in training transformers on resource-constrained edge devices due to considerations such as privacy,…

Machine Learning · Computer Science 2025-08-07 Jiayi Tian , Jinming Lu , Hai Li , Xiangwei Wang , Cong Hao , Ian Young , Zheng Zhang

We present a custom implementation of a 2D Convolutional Neural Network (CNN) as a viable application for real-time data selection in high-resolution and high-rate particle imaging detectors, making use of hardware acceleration in high-end…

Instrumentation and Detectors · Physics 2022-01-19 Yeon-jae Jwa , Giuseppe Di Guglielmo , Lukas Arnold , Luca Carloni , Georgia Karagiorgi