English
Related papers

Related papers: ILP-M Conv: Optimize Convolution Algorithm for Sin…

200 papers

FPGAs provide a flexible and efficient platform to accelerate rapidly-changing algorithms for computer vision. The majority of existing work focuses on accelerating image classification, while other fundamental vision problems, including…

Image and Video Processing · Electrical Eng. & Systems 2020-03-25 Qijing Huang , Dequan Wang , Yizhao Gao , Yaohui Cai , Zhen Dong , Bichen Wu , Kurt Keutzer , John Wawrzynek

In this paper, we explore optimizations to run Recurrent Neural Network (RNN) models locally on mobile devices. RNN models are widely used for Natural Language Processing, Machine Translation, and other tasks. However, existing mobile…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-06 Qingqing Cao , Niranjan Balasubramanian , Aruna Balasubramanian

Image convolution is widely used for sharpening, blurring and edge detection. In this paper, we review two common algorithms for convolving a 2D image by a separable kernel (filter). After optimising the naive codes using loop unrolling and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-28 Ashkan Tousimojarad , Wim Vanderbauwhede , W Paul Cockshott

Convolution is the most time-consuming part in the computation of convolutional neural networks (CNNs), which have achieved great successes in numerous applications. Due to the complex data dependency and the increase in the amount of model…

Machine Learning · Computer Science 2021-01-01 Xiaoyang Zhang , Junmin Xiao , Guangming Tan

Lightweight convolutional neural networks (e.g., MobileNets) are specifically designed to carry out inference directly on mobile devices. Among the various lightweight models, depthwise convolution (DWConv) and pointwise convolution…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-09 Pengfei Zhang , Eric Lo , Baotong Lu

MLP-based architectures, which consist of a sequence of consecutive multi-layer perceptron blocks, have recently been found to reach comparable results to convolutional and transformer-based methods. However, most adopt spatial MLPs which…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jiachen Li , Ali Hassani , Steven Walton , Humphrey Shi

As deep learning (DL) is being rapidly pushed to edge computing, researchers invented various ways to make inference computation more efficient on mobile/IoT devices, such as network pruning, parameter compression, and etc. Quantization, as…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Tao Sheng , Chen Feng , Shaojie Zhuo , Xiaopeng Zhang , Liang Shen , Mickey Aleksic

Group convolution works well with many deep convolutional neural networks (CNNs) that can effectively compress the model by reducing the number of parameters and computational cost. Using this operation, feature maps of different group…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Xukai Xie , Yuan Zhou , Sun-Yuan Kung

Convolutional neural networks have recently achieved significant breakthroughs in various image classification tasks. However, they are computationally expensive,which can make their feasible mplementation on embedded and low-power devices…

Machine Learning · Computer Science 2018-08-02 Mir Khan , Heikki Huttunen , Jani Boutellier

We present techniques for speeding up the test-time evaluation of large convolutional networks, designed for object recognition tasks. These models deliver impressive accuracy but each image evaluation requires millions of floating point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Remi Denton , Wojciech Zaremba , Joan Bruna , Yann LeCun , Rob Fergus

Training convolutional neural networks (CNNs) requires intense compute throughput and high memory bandwidth. Especially, convolution layers account for the majority of the execution time of CNN training, and GPUs are commonly used to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-28 Sangkug Lym , Donghyuk Lee , Mike O'Connor , Niladrish Chatterjee , Mattan Erez

Constructing effective image priors is critical to solving ill-posed inverse problems in image processing and imaging. Recent works proposed to exploit image non-local similarity for inverse problems by grouping similar patches and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Lanqing Guo , Zhiyuan Zha , Saiprasad Ravishankar , Bihan Wen

During the last years, algorithms known as Convolutional Neural Networks (CNNs) had become increasingly popular, expanding its application range to several areas. In particular, the image processing field has experienced a remarkable…

Hardware Architecture · Computer Science 2024-08-27 Federico Nicolas Peccia , Luciano Ferreyro , Alejandro Furfaro

As the core of artificial intelligence applications, the research of convolution has become a hot topic in high performance computing. With the rapid development of the emerging SW26010 processor in artificial intelligence, there is an…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-12 Zheng Wu

We present a fast, fully parameterizable GPU implementation of Convolutional Neural Network variants. Our feature extractors are neither carefully designed nor pre-wired, but rather learned in a supervised way. Our deep hierarchical…

Artificial Intelligence · Computer Science 2011-02-02 Dan C. Cireşan , Ueli Meier , Jonathan Masci , Luca M. Gambardella , Jürgen Schmidhuber

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Filip Badan , Lukas Sekanina

Deep learning frameworks commonly implement convolution operators with GEMM-based algorithms. In these algorithms, convolution is implemented on top of matrix-matrix multiplication (GEMM) functions, provided by highly optimized BLAS…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Marat Dukhan

Image subtraction in astronomy is a tool for transient object discovery such as asteroids, extra-solar planets and supernovae. To match point spread functions (PSFs) between images of the same field taken at different times a convolution…

Instrumentation and Methods for Astrophysics · Physics 2013-05-30 Steven Hartung , Hemant Shukla , J. Patrick Miller , Carlton Pennypacker

Inter-Prediction is used effectively in multiple standards, including H.264 and HEVC (also known as H.265). It leverages correlation between blocks of consecutive video frames in order to perform motion compensation and thus predict block…

Image and Video Processing · Electrical Eng. & Systems 2020-02-25 Raz Birman , Yoram Segal , Ofer Hadar , Jenny Benois-Pineau

Semantic Segmentation is an important module for autonomous robots such as self-driving cars. The advantage of video segmentation approaches compared to single image segmentation is that temporal image information is considered, and their…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Andreas Pfeuffer , Klaus Dietmayer