中文
相关论文

相关论文: A Cost-Efficient FPGA Implementation of Tiny Trans…

200 篇论文

The rapid growth in computing demands, particularly driven by artificial intelligence applications, has begun to exceed the capabilities of traditional electronic hardware. Optical computing offers a promising alternative due to its…

硬件体系结构 · 计算机科学 2025-07-24 Shupeng Ning , Hanqing Zhu , Chenghao Feng , Jiaqi Gu , David Z. Pan , Ray T. Chen

The growing demand for real-time processing in artificial intelligence applications, particularly those involving Convolutional Neural Networks (CNNs), has highlighted the need for efficient computational solutions. Conventional processors,…

硬件体系结构 · 计算机科学 2025-10-16 Angelos Athanasiadis , Nikolaos Tampouratzis , Ioannis Papaefstathiou

Space missions increasingly deploy high-fidelity sensors that produce data volumes exceeding onboard buffering and downlink capacity. This work evaluates FPGA acceleration of neural networks (NNs) across four space use cases on the AMD…

Continual learning (CL) aims to learn new tasks while retaining past knowledge, addressing the challenge of forgetting during task adaptation. Rehearsal-based methods, which replay previous samples, effectively mitigate forgetting. However,…

计算机视觉与模式识别 · 计算机科学 2025-03-31 Ruiqi Liu , Boyu Diao , Libo Huang , Hangda Liu , Chuanguang Yang , Zhulin An , Yongjun Xu

The transfer of tensors from/to memory during neural network training dominates time and energy. To improve energy efficiency and performance, research has been exploring ways to use narrower data representations. So far, these attempts…

Point cloud registration serves as a basis for vision and robotic applications including 3D reconstruction and mapping. Despite significant improvements on the quality of results, recent deep learning approaches are computationally…

机器人学 · 计算机科学 2024-04-02 Keisuke Sugiura , Hiroki Matsutani

Deep learning models have achieved significant success in various image related tasks. However, they often encounter challenges related to computational complexity and overfitting. In this paper, we propose an efficient approach that…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Salim Khazem , Jeremy Fix , Cédric Pradalier

This paper details the FPGA implementation methodology for Convolutional Spiking Neural Networks (CSNN) and applies this methodology to low-power radioisotope identification using high-resolution data. Power consumption of 75 mW has been…

信号处理 · 电气工程与系统科学 2021-02-26 Xiaoyu Huang , Edward Jones , Siru Zhang , Shouyu Xie , Steve Furber , Yannis Goulermas , Edward Marsden , Ian Baistow , Srinjoy Mitra , Alister Hamilton

Vision Transformers (ViTs) take all the image patches as tokens and construct multi-head self-attention (MHSA) among them. Complete leverage of these image tokens brings redundant computations since not all the tokens are attentive in MHSA.…

计算机视觉与模式识别 · 计算机科学 2022-04-15 Youwei Liang , Chongjian Ge , Zhan Tong , Yibing Song , Jue Wang , Pengtao Xie

In recent years, Transformer networks have shown remarkable performance in speech recognition tasks. However, their deployment poses challenges due to high computational and storage resource requirements. To address this issue, a…

声音 · 计算机科学 2024-05-01 Jianzong Wang , Ziqi Liang , Xulong Zhang , Ning Cheng , Jing Xiao

Neural networks (NN) have demonstrated remarkable capabilities in various tasks, but their computation-intensive nature demands faster and more energy-efficient hardware implementations. Optics-based platforms, using technologies such as…

Transformer-based models have achieved remarkable results in low-level vision tasks including image super-resolution (SR). However, early Transformer-based approaches that rely on self-attention within non-overlapping windows encounter…

图像与视频处理 · 电气工程与系统科学 2024-04-18 Cansu Korkmaz , A. Murat Tekalp

Deploying deep learning models on embedded systems has been challenging due to limited computing resources. The majority of existing work focuses on accelerating image classification, while other fundamental vision problems, such as object…

计算机视觉与模式识别 · 计算机科学 2021-01-27 Zhen Dong , Dequan Wang , Qijing Huang , Yizhao Gao , Yaohui Cai , Tian Li , Bichen Wu , Kurt Keutzer , John Wawrzynek

Popular Transformer networks have been successfully applied to remote sensing (RS) image change detection (CD) identifications and achieve better results than most convolutional neural networks (CNNs), but they still suffer from two main…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Tao Lei , Yetong Xu , Hailong Ning , Zhiyong Lv , Chongdan Min , Yaochu Jin , Asoke K. Nandi

While the integration of transformers in vision models have yielded significant improvements on vision tasks they still require significant amounts of computation for both training and inference. Restricted attention mechanisms…

计算机视觉与模式识别 · 计算机科学 2025-06-27 Steven Walton , Ali Hassani , Xingqian Xu , Zhangyang Wang , Humphrey Shi

Adopting FPGA as an accelerator in datacenters is becoming mainstream for customized computing, but the fact that FPGAs are hard to program creates a steep learning curve for software programmers. Even with the help of high-level synthesis…

硬件体系结构 · 计算机科学 2021-09-01 Atefeh Sohrabizadeh , Cody Hao Yu , Min Gao , Jason Cong

This paper implements a Binary Neural Network (BNN) based YOLOv3-tiny-like object detector on a low-cost FPGA. The network takes 320*320*3 RGB images as input. Its main convolution layers use 1-bit weights and 8-bit activations, while Conv1…

硬件体系结构 · 计算机科学 2026-05-12 Xuyu Zhao , Yunpeng Wu , Mengyuan Zhu , Haoyu Huang , Xiaoyu Xu , Yanjing Li , Gaolong Zhang , Baochang Zhang

While there is a large body of research on efficient processing of deep neural networks (DNNs), ultra-low-latency realization of these models for applications with stringent, sub-microsecond latency requirements continues to be an…

Image dehazing, a pivotal task in low-level vision, aims to restore the visibility and detail from hazy images. Many deep learning methods with powerful representation learning capability demonstrate advanced performance on non-homogeneous…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Wei Dong , Han Zhou , Ruiyi Wang , Xiaohong Liu , Guangtao Zhai , Jun Chen

Deep neural networks (DNNs) demand a very large amount of computation and weight storage, and thus efficient implementation using special purpose hardware is highly desired. In this work, we have developed an FPGA based fixed-point DNN…

硬件体系结构 · 计算机科学 2016-08-30 Jinhwan Park , Wonyong Sung