中文
相关论文

相关论文: A Cost-Efficient FPGA Implementation of Tiny Trans…

200 篇论文

Backpropagation has been the cornerstone of neural network training for decades, yet its inefficiencies in time and energy consumption limit its suitability for resource-constrained edge devices. While low-precision neural network…

机器学习 · 计算机科学 2025-07-01 Jingxiao Ma , Priyadarshini Panda , Sherief Reda

Federated learning (FL) has emerged as a promising approach to collaboratively train machine learning models across multiple edge devices while preserving privacy. The success of FL hinges on the efficiency of participating models and their…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Chu Myaet Thwal , Minh N. H. Nguyen , Ye Lin Tun , Seong Tae Kim , My T. Thai , Choong Seon Hong

Research has shown that deep neural networks contain significant redundancy, and thus that high classification accuracy can be achieved even when weights and activations are quantized down to binary values. Network binarization on FPGAs…

机器学习 · 计算机科学 2020-03-04 Erwei Wang , James J. Davis , Peter Y. K. Cheung , George A. Constantinides

Deep Neural Networks (DNNs) have achieved extraordinary performance in various application domains. To support diverse DNN models, efficient implementations of DNN inference on edge-computing platforms, e.g., ASICs, FPGAs, and embedded…

机器学习 · 计算机科学 2020-12-15 Sung-En Chang , Yanyu Li , Mengshu Sun , Runbin Shi , Hayden K. -H. So , Xuehai Qian , Yanzhi Wang , Xue Lin

Few-Shot Learning (FSL) is a challenging task, which aims to recognize novel classes with few examples. Pre-training based methods effectively tackle the problem by pre-training a feature extractor and then performing class prediction via a…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Baoquan Zhang , Shanshan Feng , Bingqi Shan , Xutao Li , Yunming Ye , Yew-Soon Ong

Denoising is a core operation in modern video pipelines. In codecs, in-loop filters suppress sensor noise and quantisation artefacts to improve rate-distortion performance; in cinema post-production, denoisers are used for restoration,…

图像与视频处理 · 电气工程与系统科学 2025-10-07 Changhong Li , Clément Bled , Rosa Fernandez , Shreejith Shanker

Existing semantic segmentation works have been mainly focused on designing effective decoders; however, the computational load introduced by the overall structure has long been ignored, which hinders their applications on…

计算机视觉与模式识别 · 计算机科学 2023-01-12 Bo Dong , Pichao Wang , Fan Wang

Transformer architecture has emerged to be successful in a number of natural language processing tasks. However, its applications to medical vision remain largely unexplored. In this study, we present UTNet, a simple yet powerful hybrid…

计算机视觉与模式识别 · 计算机科学 2021-09-29 Yunhe Gao , Mu Zhou , Dimitris Metaxas

The quantized neural network (QNN) is an efficient approach for network compression and can be widely used in the implementation of FPGAs. This paper proposes a novel learning framework for n-bit QNNs, whose weights are constrained to the…

机器学习 · 计算机科学 2020-04-07 Jun Chen , Liang Liu , Yong Liu , Xianfang Zeng

During the past decade, implementing reconstruction algorithms on hardware has been at the center of much attention in the field of real-time reconstruction in Compressed Sensing (CS). Orthogonal Matching Pursuit (OMP) is the most widely…

多媒体 · 计算机科学 2021-10-12 Jiayao Xu , Chen Fu , Zhiqiang Zhang , Jinjia Zhou

The ever-growing cost of both training and inference for state-of-the-art neural networks has brought literature to look upon ways to cut off resources used with a minimal impact on accuracy. Using lower precision comes at the cost of…

机器学习 · 计算机科学 2021-02-03 Quentin Ducasse , Pascal Cotret , Loïc Lagadec , Robert Stewart

Convolutional neural networks (CNNs) achieve state-of-the-art accuracy in a variety of tasks in computer vision and beyond. One of the major obstacles hindering the ubiquitous use of CNNs for inference on low-power edge devices is their…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Brian Chmiel , Chaim Baskin , Ron Banner , Evgenii Zheltonozhskii , Yevgeny Yermolin , Alex Karbachevsky , Alex M. Bronstein , Avi Mendelson

Convolutional neural networks (CNNs) with large kernels, drawing inspiration from the key operations of vision transformers (ViTs), have demonstrated impressive performance in various vision-based applications. To address the issue of…

硬件体系结构 · 计算机科学 2024-02-23 Miaoxin Wang , Xiao Wu , Jun Lin , Zhongfeng Wang

Transformer neural networks (TNN) excel in natural language processing (NLP), machine translation, and computer vision (CV) without relying on recurrent or convolutional layers. However, they have high computational and memory demands,…

硬件体系结构 · 计算机科学 2025-12-30 Ehsan Kabir , Jason D. Bakos , David Andrews , Miaoqing Huang

As DenseNet conserves intermediate features with diverse receptive fields by aggregating them with dense connection, it shows good performance on the object detection task. Although feature reuse enables DenseNet to produce strong features…

计算机视觉与模式识别 · 计算机科学 2019-04-23 Youngwan Lee , Joong-won Hwang , Sangrok Lee , Yuseok Bae , Jongyoul Park

Diffusion models have achieved significant visual generation quality. However, their significant computational and memory costs pose challenge for their application on resource-constrained mobile devices or even desktop GPUs. Recent…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Tianchen Zhao , Xuefei Ning , Tongcheng Fang , Enshu Liu , Guyue Huang , Zinan Lin , Shengen Yan , Guohao Dai , Yu Wang

Modern mobile neural networks with a reduced number of weights and parameters do a good job with image classification tasks, but even they may be too complex to be implemented in an FPGA for video processing tasks. The article proposes…

计算机视觉与模式识别 · 计算机科学 2020-12-04 Roman Solovyev , Alexander Kustov , Dmitry Telpukhov , Vladimir Rukhlov , Alexandr Kalinin

Acceleration of Convolutional Neural Network (CNN) on edge devices has recently achieved a remarkable performance in image classification and object detection applications. This paper proposes an efficient and scalable CNN-based SoC-FPGA…

硬件体系结构 · 计算机科学 2022-07-29 Azzam Alhussain , Mingjie Lin

Designing hardware accelerators for deep neural networks (DNNs) has been much desired. Nonetheless, most of these existing accelerators are built for either convolutional neural networks (CNNs) or recurrent neural networks (RNNs). Recently,…

信号处理 · 电气工程与系统科学 2020-09-21 Siyuan Lu , Meiqi Wang , Shuang Liang , Jun Lin , Zhongfeng Wang

Image deblurring aims to recover the latent sharp image from its blurry counterpart and has a wide range of applications in computer vision. The Convolution Neural Networks (CNNs) have performed well in this domain for many years, and until…

计算机视觉与模式识别 · 计算机科学 2023-02-07 Lingyan Ruan , Mojtaba Bemana , Hans-peter Seidel , Karol Myszkowski , Bin Chen