中文
相关论文

相关论文: Accelerating Large Kernel Convolutions with Nested…

200 篇论文

Convolution is the core operation for many deep neural networks. The Winograd convolution algorithms have been shown to accelerate the widely-used small convolution sizes. Quantized neural networks can effectively reduce model sizes and…

神经与进化计算 · 计算机科学 2019-01-09 Lingchuan Meng , John Brothers

Winograd's minimal filtering algorithm has been widely used in Convolutional Neural Networks (CNNs) to reduce the number of multiplications for faster processing. However, it is only effective on convolutions with kernel size as 3x3 and…

机器学习 · 计算机科学 2020-02-06 Di Huang , Xishan Zhang , Rui Zhang , Tian Zhi , Deyuan He , Jiaming Guo , Chang Liu , Qi Guo , Zidong Du , Shaoli Liu , Tianshi Chen , Yunji Chen

Convolutional neural networks (CNNs) have dramatically improved the accuracy of tasks such as object recognition, image segmentation and interactive speech systems. CNNs require large amounts of computing resources because ofcomputationally…

计算机视觉与模式识别 · 计算机科学 2022-01-26 Syed Asad Alam , Andrew Anderson , Barbara Barabasz , David Gregg

Convolutional Neural Network (CNN) has been widely used in various fields and played an important role. Convolution operators are the fundamental component of convolutional neural networks, and it is also the most time-consuming part of…

人工智能 · 计算机科学 2021-11-02 Gan Tong , Libo Huang

Lightweight architectural designs of Convolutional Neural Networks (CNNs) together with quantization have paved the way for the deployment of demanding computer vision applications on mobile devices. Parallel to this, alternative…

机器学习 · 计算机科学 2020-03-24 Javier Fernandez-Marques , Paul N. Whatmough , Andrew Mundy , Matthew Mattina

Neural Networks (NNs) have become the mainstream technology in the artificial intelligence (AI) renaissance over the past decade. Among different types of neural networks, convolutional neural networks (CNNs) have been widely adopted as…

新兴技术 · 计算机科学 2019-12-05 Armin Mehrabian , Mario Miscuglio , Yousra Alkabani , Volker J. Sorger , Tarek El-Ghazawi

Prior research has shown that Winograd algorithm can reduce the computational complexity of convolutional neural networks (CNN) with weights and activations represented in floating point. However it is difficult to apply the scheme to the…

机器学习 · 计算机科学 2020-07-27 Zhi-Gang Liu , Matthew Mattina

Deep convolutional neural networks (ConvNets) of 3-dimensional kernels allow joint modeling of spatiotemporal features. These networks have improved performance of video and volumetric image analysis, but have been limited in size due to…

计算机视觉与模式识别 · 计算机科学 2017-06-13 David Budden , Alexander Matveev , Shibani Santurkar , Shraman Ray Chaudhuri , Nir Shavit

Convolutional Neural Networks (CNNs) have gained widespread popularity in the field of computer vision and image processing. Due to huge computational requirements of CNNs, dedicated hardware-based implementations are being explored to…

信号处理 · 电气工程与系统科学 2019-03-06 Afzal Ahmad , Muhammad Adeel Pasha

Large CNNs have delivered impressive performance in various computer vision applications. But the storage and computation requirements make it problematic for deploying these models on mobile devices. Recently, tensor decompositions have…

机器学习 · 计算机科学 2016-02-16 Cheng Tai , Tong Xiao , Yi Zhang , Xiaogang Wang , Weinan E

As Convolutional Neural Networks (CNNs) gain prominence in deep learning, algorithms like Winograd Convolution have been introduced to enhance computational efficiency. However, existing implementations often face challenges such as high…

性能 · 计算机科学 2024-12-30 Haoyuan Gui , Xiaoyu Zhang , Chong Zhang , Zitong Su , Huiyuan Li

Winograd convolution is originally proposed to reduce the computing overhead by converting multiplication in neural network (NN) with addition via linear transformation. Other than the computing efficiency, we observe its great potential in…

机器学习 · 计算机科学 2022-02-18 Xinghua Xue , Haitong Huang , Cheng Liu , Ying Wang , Tao Luo , Lei Zhang

Convolutional Neural Networks (CNNs) are computationally intensive, which limits their application on mobile devices. Their energy is dominated by the number of multiplies needed to perform the convolutions. Winograd's minimal filtering…

计算机视觉与模式识别 · 计算机科学 2018-02-20 Xingyu Liu , Jeff Pool , Song Han , William J. Dally

The combination of Winograd's algorithm and systolic array architecture has demonstrated the capability of improving DSP efficiency in accelerating convolutional neural networks (CNNs) on FPGA platforms. However, handling arbitrary…

硬件体系结构 · 计算机科学 2021-07-12 Xinheng Liu , Yao Chen , Cong Hao , Ashutosh Dhar , Deming Chen

Most of today's computer vision pipelines are built around deep neural networks, where convolution operations require most of the generally high compute effort. The Winograd convolution algorithm computes convolutions with fewer MACs…

硬件体系结构 · 计算机科学 2022-09-28 Renzo Andri , Beatrice Bussolino , Antonio Cipolletta , Lukas Cavigelli , Zhe Wang

This paper focuses on Winograd transformation in 3D convolutional neural networks (CNNs) that are more over-parameterized compared with the 2D version. The over-increasing Winograd parameters not only exacerbate training complexity but also…

计算机视觉与模式识别 · 计算机科学 2023-01-27 Ziran Qin , Mingbao Lin , Weiyao Lin

The problem how to speed up the convolution computations in Deep Neural Networks is widely investigated in recent years. The Winograd convolution algorithm is a common used method that significantly reduces time consumption. However, it…

机器学习 · 计算机科学 2020-04-24 Barbara Barabasz

This paper considers a convolutional neural network transformation that reduces computation complexity and thus speedups neural network processing. Usage of convolutional neural networks (CNN) is the standard approach to image recognition…

计算机视觉与模式识别 · 计算机科学 2020-02-19 Elena Limonova , Alexander Sheshkus , Dmitry Nikolaev

The prevalence of convolution in applications within signal processing, deep neural networks, and numerical solvers has motivated the development of numerous fast convolution algorithms. In many of these problems, convolution is performed…

数值分析 · 数学 2020-07-03 Caleb Ju , Edgar Solomonik

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

计算机视觉与模式识别 · 计算机科学 2018-10-10 Xiaobo Huang
‹ 上一页 1 2 3 10 下一页 ›