English
Related papers

Related papers: BitLogic: Training Framework for Gradient-Based FP…

200 papers

The growing adoption of Deep Learning (DL) applications in the Internet of Things has increased the demand for energy-efficient accelerators. Field Programmable Gate Arrays (FPGAs) offer a promising platform for such acceleration due to…

Hardware Architecture · Computer Science 2025-04-15 Chao Qian

Recently, deep learning-based pan-sharpening algorithms have achieved notable advancements over traditional methods. However, deep learning-based methods incur substantial computational overhead during inference, especially with large…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zhongnan Cai , Yingying Wang , Hui Zheng , Panwang Pan , ZiXu Lin , Ge Meng , Chenxin Li , Chunming He , Jiaxin Xie , Yunlong Lin , Junbin Lu , Yue Huang , Xinghao Ding

Among hardware accelerators for deep-learning inference, data flow implementations offer low latency and high throughput capabilities. In these architectures, each neuron is mapped to a dedicated hardware unit, making them well-suited for…

Machine Learning · Computer Science 2026-03-10 Tobias Habermann , Michael Mecik , Zhenyu Wang , César David Vera , Martin Kumm , Mario Garrido

Modern large language models (LLMs) increasingly depends on efficient long-context processing and generation mechanisms, including sparse attention, retrieval-augmented generation (RAG), and compressed contextual memory, to support complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Zifan He , Rui Ma , Yizhou Sun , Jason Cong

The LCLS2 Free Electron Laser FEL will generate xray pulses to beamline experiments at up to 1Mhz These experimentals will require new ultrahigh rate UHR detectors that can operate at rates above 100 kHz and generate data throughputs…

Instrumentation and Detectors · Physics 2023-06-01 Ryan Herbst , Ryan Coffee , Nathan Fronk , Kukhee Kim , Kuktae Kim , Larry Ruckman , J. J. Russell

The rapid scaling of large language models (LLMs) has unveiled critical limitations in current hardware architectures, including constraints in memory capacity, computational efficiency, and interconnection bandwidth. DeepSeek-V3, trained…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-24 Chenggang Zhao , Chengqi Deng , Chong Ruan , Damai Dai , Huazuo Gao , Jiashi Li , Liyue Zhang , Panpan Huang , Shangyan Zhou , Shirong Ma , Wenfeng Liang , Ying He , Yuqing Wang , Yuxuan Liu , Y. X. Wei

Training deep neural networks (DNNs) is a computationally expensive job, which can take weeks or months even with high performance GPUs. As a remedy for this challenge, community has started exploring the use of more efficient data…

Machine Learning · Computer Science 2022-03-15 Seock-Hwan Noh , Jahyun Koo , Seunghyun Lee , Jongse Park , Jaeha Kung

Retrieval-augmented generation (RAG) extends large language models (LLMs) with external data sources to enhance factual correctness and domain coverage. Modern RAG pipelines rely on large datastores, creating a significant system challenge:…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Chien-Yu Lin , Keisuke Kamahori , Yiyu Liu , Xiaoxiang Shi , Madhav Kashyap , Yile Gu , Rulin Shao , Zihao Ye , Kan Zhu , Rohan Kadekodi , Stephanie Wang , Arvind Krishnamurthy , Luis Ceze , Baris Kasikci

Accelerating the neural network inference by FPGA has emerged as a popular option, since the reconfigurability and high performance computing capability of FPGA intrinsically satisfies the computation demand of the fast-evolving neural…

Hardware Architecture · Computer Science 2021-12-16 Yu Gong , Zhihan Xu , Zhezhi He , Weifeng Zhang , Xiaobing Tu , Xiaoyao Liang , Li Jiang

We present a novel implementation of classification using the machine learning / artificial intelligence method called boosted decision trees (BDT) on field programmable gate arrays (FPGA). The firmware implementation of binary…

High Energy Physics - Experiment · Physics 2023-04-12 Tae Min Hong , Benjamin Carlson , Brandon Eubanks , Stephen Racz , Stephen Roche , Joerg Stelzer , Daniel Stumpp

Low-cost FPGA platforms can broaden access to neuromorphic systems research, but current spiking neural network (SNN) workflows remain divided between hardware-first implementations, which are difficult to integrate with PyTorch-style…

Hardware Architecture · Computer Science 2026-04-27 Jiwoon Lee , Souvik Chakraborty , Syed Bahauddin Alam , Cheolsoo Park

In recent years the computational capacity of single Field Programmable Gate Arrays (FPGA) devices as well as their versatility has increased significantly. Adding to that the High Level Synthesis frameworks allowing to program such…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-22 G. Korcyl , P. Korcyl

Artificial Intelligence (AI) applications, such as Large Language Models, are primarily driven and executed by Graphics Processing Units (GPUs). These GPU programs (kernels) consume substantial amounts of energy, yet software developers…

Software Engineering · Computer Science 2026-01-21 Saurabhsingh Rajput , Alexander Brandt , Vadim Elisseev , Tushar Sharma

Deep Neural Networks (DNNs) are capable of solving complex problems in domains related to embedded systems, such as image and natural language processing. To efficiently implement DNNs on a specific FPGA platform for a given cost criterion,…

Hardware Architecture · Computer Science 2021-10-22 Jonas Ney , Dominik Loroch , Vladimir Rybalkin , Nico Weber , Jens Krüger , Norbert Wehn

Trajectory prediction is a fundamental task for autonomous systems, requiring complex reasoning about multi-agent interactions and intents. Large language models (LLMs) have recently been adopted for this task, as they provide strong…

Artificial Intelligence · Computer Science 2026-05-29 Mincheol Kang , Hyunjin Lim , Bomin Kang , Daehee Park

Autonomous control systems onboard planetary rovers and spacecraft benefit from having cognitive capabilities like learning so that they can adapt to unexpected situations in-situ. Q-learning is a form of reinforcement learning and it has…

Machine Learning · Computer Science 2017-01-27 Pranay Gankidi , Jekan Thangavelautham

Recent work in the machine learning literature has demonstrated that deep learning can train neural networks made of discrete logic gate functions to perform simple image classification tasks at very high speeds on CPU, GPU and FPGA…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Sebastian Fieldhouse , Kea-Tiong Tang

Multimodal stacks that mix ViTs, CNNs, GNNs, and transformer NLP strain embedded platforms because their compute/memory patterns diverge and hard real-time targets leave little slack. TRINE is a single-bitstream FPGA accelerator and…

Hardware Architecture · Computer Science 2026-03-25 Hyunwoo Oh , Hanning Chen , Sanggeon Yun , Yang Ni , Suyeon Jang , Behnam Khaleghi , Fei Wen , Mohsen Imani

This paper describes an optimized implementation of a Forward Propagating Classification Neural Network which has been previously trained. The implementation described highlights a novel means of using Python scripts to generate a Verilog…

Hardware Architecture · Computer Science 2020-12-16 Matthew Joseph Adiletta , Brian Flanagan

Spiking Neural Networks (SNNs) offer a biologically inspired foundation for low-power, event-driven intelligence, yet their direct on-chip supervised training remains a key hardware challenge. This paper presents a multiplication-free,…

Neural and Evolutionary Computing · Computer Science 2026-04-28 Maryam Mirsadeghi , Mojtaba Mirbagheri , Saeed Reza Kheradpisheh