English
Related papers

Related papers: An Efficient FPGA-Based Accelerator for Swin Trans…

200 papers

Existing FPGA-based DNN accelerators typically fall into two design paradigms. Either they adopt a generic reusable architecture to support different DNN networks but leave some performance and efficiency on the table because of the…

Hardware Architecture · Computer Science 2021-03-25 Xiaofan Zhang , Hanchen Ye , Junsong Wang , Yonghua Lin , Jinjun Xiong , Wen-mei Hwu , Deming Chen

Convolutional Neural Networks (CNNs) have gained significant traction in the field of machine learning, particularly due to their high accuracy in visual recognition. Recent works have pushed the performance of GPU implementations of CNNs…

Computer Vision and Pattern Recognition · Computer Science 2016-10-03 Roberto DiCecco , Griffin Lacey , Jasmina Vasiljevic , Paul Chow , Graham Taylor , Shawki Areibi

Multimodal stacks that mix ViTs, CNNs, GNNs, and transformer NLP strain embedded platforms because their compute/memory patterns diverge and hard real-time targets leave little slack. TRINE is a single-bitstream FPGA accelerator and…

Hardware Architecture · Computer Science 2026-03-25 Hyunwoo Oh , Hanning Chen , Sanggeon Yun , Yang Ni , Suyeon Jang , Behnam Khaleghi , Fei Wen , Mohsen Imani

The predictive power of Convolutional Neural Networks (CNNs) has been an integral factor for emerging latency-sensitive applications, such as autonomous drones and vehicles. Such systems employ multiple CNNs, each one trained for a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Stylianos I. Venieris , Christos-Savvas Bouganis

Mixed-precision neural networks (MPNNs) that enable the use of just enough data width for a deep learning task promise significant advantages of both inference accuracy and computing overhead. FPGAs with fine-grained reconfiguration…

Hardware Architecture · Computer Science 2023-08-23 Erjing Luo , Haitong Huang , Cheng Liu , Guoyu Li , Bing Yang , Ying Wang , Huawei Li , Xiaowei Li

Photonic Microring Resonator (MRR) based hardware accelerators have been shown to provide disruptive speedup and energy-efficiency improvements for processing deep Convolutional Neural Networks (CNNs). However, previous MRR-based CNN…

Hardware Architecture · Computer Science 2022-07-13 Sairam Sri Vatsavai , Ishan G Thakkar

Convolutional Neural Networks (CNN) have been widely deployed in diverse application domains. There has been significant progress in accelerating both their training and inference using high-performance GPUs, FPGAs, and custom ASICs for…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-07 Guanwen Zhong , Akshat Dubey , Tan Cheng , Tulika Mitra

Edge AI applications increasingly require models that can learn and adapt on-device with minimal energy budget. Traditional deep learning models, while powerful, are often overparameterized, energy-hungry, and dependent on cloud…

Hardware Architecture · Computer Science 2025-06-24 Muhammad Ihsan Al Hafiz , Naresh Ravichandran , Anders Lansner , Pawel Herman , Artur Podobas

Deep Convolutional Neural Networks (CNNs) have become state-of-the art for computer vision and other signal processing tasks due to their superior accuracy. In recent years, large efforts have been made to reduce the computational costs of…

Hardware Architecture · Computer Science 2021-04-13 Mario Fischer , Juergen Wassner

Transformers' compute-intensive operations pose enormous challenges for their deployment in resource-constrained EdgeAI / tinyML devices. As an established neural network compression technique, quantization reduces the hardware…

Machine Learning · Computer Science 2023-04-26 Alberto Marchisio , Davide Dura , Maurizio Capra , Maurizio Martina , Guido Masera , Muhammad Shafique

Brain-inspired spiking neural networks (SNNs) replace the multiply-accumulate operations of traditional neural networks by integrate-and-fire neurons, with the goal of achieving greater energy efficiency. Specialized hardware…

Neural and Evolutionary Computing · Computer Science 2023-05-10 Myat Thu Linn Aung , Daniel Gerlinghoff , Chuping Qu , Liwei Yang , Tian Huang , Rick Siow Mong Goh , Tao Luo , Weng-Fai Wong

We present both a novel Convolutional Neural Network (CNN) accelerator architecture and a network compiler for FPGAs that outperforms all prior work. Instead of having generic processing elements that together process one layer at a time,…

Hardware Architecture · Computer Science 2020-07-22 Mathew Hall , Vaughn Betz

Artificial intelligence (AI) is increasingly deployed in real-time and energy-constrained environments, driving demand for hardware platforms that can deliver high performance and power efficiency. While central processing units (CPUs) and…

Hardware Architecture · Computer Science 2026-01-28 Aybars Yunusoglu , Talha Coskun , Hiruna Vishwamith , Murat Isik , I. Can Dikmen

Brain-inspired Spiking Neural Networks (SNNs) have attracted attention for their event-driven characteristics and high energy efficiency. However, the temporal dependency and irregularity of spikes present significant challenges for…

Hardware Architecture · Computer Science 2025-06-11 Kainan Wang , Chengyi Yang , Chengting Yu , Yee Sin Ang , Bo Wang , Aili Wang

Deep convolutional neural networks (CNNs) obtain outstanding results in tasks that require human-level understanding of data, like image or speech recognition. However, their computational load is significant, motivating the development of…

Neural and Evolutionary Computing · Computer Science 2019-11-28 Paolo Meloni , Alessandro Capotondi , Gianfranco Deriu , Michele Brian , Francesco Conti , Davide Rossi , Luigi Raffo , Luca Benini

Graph neural networks (GNNs) have recently exploded in popularity thanks to their broad applicability to ubiquitous graph-related problems such as quantum chemistry, drug discovery, and high energy physics. However, meeting demand for novel…

Machine Learning · Computer Science 2022-01-24 Stefan Abi-Karam , Yuqi He , Rishov Sarkar , Lakshmi Sathidevi , Zihang Qiao , Cong Hao

This paper presents the design and evaluation of a GPU-accelerated inference pipeline for transformer models using NVIDIA TensorRT with mixed-precision optimization. We evaluate BERT-base (110M parameters) and GPT-2 (124M parameters) across…

Machine Learning · Computer Science 2026-03-31 Soutrik Mukherjee , Sangwhan Cha

The reconfigurability, energy-efficiency, and massive parallelism on FPGAs make them one of the best choices for implementing efficient deep learning accelerators. However, state-of-art implementations seldom consider the balance between…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-05 Feng Shi , Haochen Li , Yuhe Gao , Benjamin Kuschner , Song-Chun Zhu

Deep learning algorithms are a key component of many state-of-the-art vision systems, especially as Convolutional Neural Networks (CNN) outperform most solutions in the sense of accuracy. To apply such algorithms in real-time applications,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Dominika Przewlocka-Rus , Marcin Kowalczyk , Tomasz Kryjak

Binarized neural networks (BNNs) are gaining interest in the deep learning community due to their significantly lower computational and memory cost. They are particularly well suited to reconfigurable logic devices, which contain an…

Computer Vision and Pattern Recognition · Computer Science 2017-01-30 Nicholas J. Fraser , Yaman Umuroglu , Giulio Gambardella , Michaela Blott , Philip Leong , Magnus Jahre , Kees Vissers