中文
相关论文

相关论文: ShortcutFusion: From Tensorflow to FPGA-based acce…

200 篇论文

Attention accounts for an increasingly dominant fraction of total computation during inference for mixture-of-experts (MoE) models, making efficient acceleration critical. Emerging domain-specific accelerators for large model inference are…

硬件体系结构 · 计算机科学 2026-04-03 Chi Zhang , Luca Colagrande , Renzo Andri , Luca Benini

Fully realizing the potential of acceleration for Deep Neural Networks (DNNs) requires understanding and leveraging algorithmic properties. This paper builds upon the algorithmic insight that bitwidth of operations in DNNs can be reduced…

神经与进化计算 · 计算机科学 2018-05-31 Hardik Sharma , Jongse Park , Naveen Suda , Liangzhen Lai , Benson Chau , Joon Kyung Kim , Vikas Chandra , Hadi Esmaeilzadeh

Offloading compute-intensive kernels to hardware accelerators relies on the large degree of parallelism offered by these platforms. However, the effective bandwidth of the memory interface often causes a bottleneck, hindering the…

硬件体系结构 · 计算机科学 2022-02-25 Corentin Ferry , Tomofumi Yuki , Steven Derrien , Sanjay Rajopadhye

Multi-Head Attention (MHA) is a critical computational kernel in transformer-based AI models. Emerging scalable tile-based accelerator architectures integrate increasing numbers of tightly-packed processing elements (PEs) with tensor units.…

Convolutional neural network (CNN) accelerators are being widely used for their efficiency, but they require a large amount of memory, leading to the use of a slow and power consuming external memory. This paper exploits two schemes to…

硬件体系结构 · 计算机科学 2022-12-23 Hyeong-Ju Kang

Gated DeltaNet (GDN) is a linear attention mechanism that replaces the growing KV cache with a fixed-size recurrent state. Hybrid LLMs like Qwen3-Next use 75% GDN layers and achieve competitive accuracy to attention-only models. However, at…

硬件体系结构 · 计算机科学 2026-03-09 Neelesh Gupta , Peter Wang , Rajgopal Kannan , Viktor K. Prasanna

Convolutional neural networks (CNNs) demonstrate excellent performance in various computer vision applications. In recent years, FPGA-based CNN accelerators have been proposed for optimizing performance and power efficiency. Most…

分布式、并行与集群计算 · 计算机科学 2018-12-19 Jung-Woo Chang , Keon-Woo Kang , Suk-Ju Kang

Today, artificial neural networks are one of the major innovators pushing the progress of machine learning. This has particularly affected the development of neural network accelerating hardware. However, since most of these architectures…

硬件体系结构 · 计算机科学 2021-02-12 Simon Pfenning , Philipp Holzinger , Marc Reichenbach

The research interest in specialized hardware accelerators for deep neural networks (DNN) spikes recently owing to their superior performance and efficiency. However, today's DNN accelerators primarily focus on accelerating specific…

分布式、并行与集群计算 · 计算机科学 2020-06-11 Cong Guo , Yangjie Zhou , Jingwen Leng , Yuhao Zhu , Zidong Du , Quan Chen , Chao Li , Bin Yao , Minyi Guo

Recurrent neural networks (RNNs), particularly LSTMs, are effective for time-series tasks like sentiment analysis and short-term stock prediction. However, their computational complexity poses challenges for real-time deployment in resource…

Convolutional Neural Networks (CNNs) are fundamental to deep learning, driving applications across various domains. However, their growing complexity has significantly increased computational demands, necessitating efficient hardware…

机器学习 · 计算机科学 2025-05-21 Junye Jiang , Yaan Zhou , Yuanhao Gong , Haoxuan Yuan , Shuanglong Liu

The success of DNN pruning has led to the development of energy-efficient inference accelerators that support pruned models with sparse weight and activation tensors. Because the memory layouts and dataflows in these architectures are…

神经与进化计算 · 计算机科学 2020-09-24 Dingqing Yang , Amin Ghasemazar , Xiaowei Ren , Maximilian Golub , Guy Lemieux , Mieszko Lis

The acceleration of pruned Deep Neural Networks (DNNs) on edge devices such as Microcontrollers (MCUs) is a challenging task, given the tight area- and power-constraints of these devices. In this work, we propose a three-fold contribution…

Graph neural networks (GNNs) have recently exploded in popularity thanks to their broad applicability to graph-related problems such as quantum chemistry, drug discovery, and high energy physics. However, meeting demand for novel GNN models…

分布式、并行与集群计算 · 计算机科学 2022-10-20 Rishov Sarkar , Stefan Abi-Karam , Yuqi He , Lakshmi Sathidevi , Cong Hao

This paper presents a complete video fusion system with hardware acceleration and investigates the energy trade-offs between computing in the CPU or the FPGA device. The video fusion application is based on the Dual-Tree Complex Wavelet…

硬件体系结构 · 计算机科学 2016-02-09 Jose Nunez-Yanez , Tom Sun

Convolutional Neural Networks (CNNs) have gained widespread popularity in the field of computer vision and image processing. Due to huge computational requirements of CNNs, dedicated hardware-based implementations are being explored to…

信号处理 · 电气工程与系统科学 2019-03-06 Afzal Ahmad , Muhammad Adeel Pasha

Recurrent Neural Networks (RNNs) are becoming increasingly important for time series-related applications which require efficient and real-time implementations. The two major types are Long Short-Term Memory (LSTM) and Gated Recurrent Unit…

计算机视觉与模式识别 · 计算机科学 2018-12-19 Zhe Li , Caiwen Ding , Siyue Wang , Wujie Wen , Youwei Zhuo , Chang Liu , Qinru Qiu , Wenyao Xu , Xue Lin , Xuehai Qian , Yanzhi Wang

Heterogeneous embedded systems, with diverse computing elements and accelerators such as FPGAs, offer a promising platform for fast and flexible ML inference, which is crucial for services such as autonomous driving and augmented reality,…

硬件体系结构 · 计算机科学 2026-02-16 Alexandros Patras , Spyros Lalis , Christos D. Antonopoulos , Nikolaos Bellas

Neural Networks (NN) have been proven to be powerful tools to analyze Big Data. However, traditional CPUs cannot achieve the desired performance and/or energy efficiency for NN applications. Therefore, numerous NN accelerators have been…

Deep neural network (DNN) inference is increasingly being executed on mobile and embedded platforms due to low latency and better privacy. However, efficient deployment on these platforms is challenging due to the intensive computation and…

硬件体系结构 · 计算机科学 2022-06-08 Lei Xun , Bashir M. Al-Hashimi , Jonathon Hare , Geoff V. Merrett