English
Related papers

Related papers: NullHop: A Flexible Convolutional Neural Network A…

200 papers

In the past decade, Convolutional Neural Networks (CNNs) have demonstrated state-of-the-art performance in various Artificial Intelligence tasks. To accelerate the experimentation and development of CNNs, several software frameworks have…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Stylianos I. Venieris , Alexandros Kouris , Christos-Savvas Bouganis

Modern efficient Convolutional Neural Networks(CNNs) always use Depthwise Separable Convolutions(DSCs) and Neural Architecture Search(NAS) to reduce the number of parameters and the computational complexity. But some inherent…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Liangqi Zhang , Haibo Shen , Yihao Luo , Xiang Cao , Leixilan Pan , Tianjiang Wang , Qi Feng

Machine intelligence, especially using convolutional neural networks (CNNs), has become a large area of research over the past years. Increasingly sophisticated hardware accelerators are proposed that exploit e.g. the sparsity in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-23 Andreas Bytyn , René Ahlsdorf , Rainer Leupers , Gerd Ascheid

Convolutional neural networks (CNNs) perform well on problems such as handwriting recognition and image classification. However, the performance of the networks is often limited by budget and time constraints, particularly when trying to…

Computer Vision and Pattern Recognition · Computer Science 2014-09-23 Benjamin Graham

As a successful deep model applied in image super-resolution (SR), the Super-Resolution Convolutional Neural Network (SRCNN) has demonstrated superior performance to the previous hand-crafted models either in speed and restoration quality.…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Chao Dong , Chen Change Loy , Xiaoou Tang

To achieve high accuracy, convolutional neural networks (CNNs) are increasingly growing in complexity and diversity in layer types and topologies. This makes it very challenging to efficiently deploy such networks on custom processor…

Systems and Control · Electrical Eng. & Systems 2024-06-21 Steven Colleman , Man Shi , Marian Verhelst

Computer vision performances have been significantly improved in recent years by Convolutional Neural Networks(CNN). Currently, applications using CNN algorithms are deployed mainly on general purpose hardwares, such as CPUs, GPUs or FPGAs.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Baohua Sun , Lin Yang , Patrick Dong , Wenhan Zhang , Jason Dong , Charles Young

We present a novel deep learning architecture in which the convolution operation leverages heterogeneous kernels. The proposed HetConv (Heterogeneous Kernel-Based Convolution) reduces the computation (FLOPs) and the number of parameters as…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Pravendra Singh , Vinay Kumar Verma , Piyush Rai , Vinay P. Namboodiri

Training of convolutional neural networks (CNNs)on embedded platforms to support on-device learning is earning vital importance in recent days. Designing flexible training hard-ware is much more challenging than inference hardware, due to…

Machine Learning · Computer Science 2019-08-20 Shreyas Kolala Venkataramanaiah , Yufei Ma , Shihui Yin , Eriko Nurvithadhi , Aravind Dasu , Yu Cao , Jae-sun Seo

With the rapidly-developing high-speed wireless communications, the 60 GHz millimeter-wave frequency range and radio-over-fiber systems have been investigated as a promising solution to deliver mm-wave signals. Neural networks have been…

Signal Processing · Electrical Eng. & Systems 2020-05-20 Jeonghun Lee , Jiayuan He , Ke Wang

Vision Graph Neural Networks (ViGs) represent an image as a graph of patch tokens, enabling adaptive, feature-driven neighborhoods. Unlike CNNs with fixed grid biases or Vision Transformers with global token interactions, ViGs rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Anvitha Ramachandran , Dhruv Parikh , Viktor Prasanna

Convolutional neural networks (CNNs) are typically trained using 16- or 32-bit floating-point (FP) and researchers show that low-precision floating-point (FP) can be highly effective for inference. Low-precision FP can be implemented in…

Hardware Architecture · Computer Science 2021-03-02 James Garland , David Gregg

We introduce an extremely computation-efficient CNN architecture named ShuffleNet, which is designed specially for mobile devices with very limited computing power (e.g., 10-150 MFLOPs). The new architecture utilizes two new operations,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-08 Xiangyu Zhang , Xinyu Zhou , Mengxiao Lin , Jian Sun

Spiking Neural Networks (SNNs) are biologically-inspired models that are capable of processing information in streams of action potentials. However, simulating and training SNNs is computationally expensive due to the need to solve large…

Neurons and Cognition · Quantitative Biology 2023-12-29 Rainer Engelken

Convolutional Neural Networks (CNNs) have achieved remarkable success in various computer vision tasks but rely on tremendous computational cost. To solve this problem, existing approaches either compress well-trained large-scale models or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Chen Zhang , Yinghao Xu , Yujun Shen

Custom dataflow Convolutional Neural Network (CNN) inference accelerators on FPGA are tailored to a specific CNN topology and store parameters in On-Chip Memory (OCM), resulting in high energy efficiency and low inference latency. However,…

Hardware Architecture · Computer Science 2020-11-17 Lucian Petrica , Tobias Alonso , Mairin Kroes , Nicholas Fraser , Sorin Cotofana , Michaela Blott

Deep convolutional neural networks have achieved remarkable progress in recent years. However, the large volume of intermediate results generated during inference poses a significant challenge to the accelerator design for…

Hardware Architecture · Computer Science 2021-05-20 Gang Li , Zejian Liu , Fanrong Li , Jian Cheng

Convolutional neural networks (CNNs) require high throughput hardware accelerators for real time applications owing to their huge computational cost. Most traditional CNN accelerators rely on single core, linear processing elements (PEs) in…

Hardware Architecture · Computer Science 2020-07-21 Mahmood Azhar Qureshi , Arslan Munir

This work presents and analyzes three convolutional neural network (CNN) models for efficient pixelwise classification of images. When using convolutional neural networks to classify single pixels in patches of a whole image, a lot of…

Computer Vision and Pattern Recognition · Computer Science 2015-09-14 Fabian Tschopp

Graph Convolutional Networks (GCNs) are increasingly adopted in large-scale graph-based recommender systems. Training GCN requires the minibatch generator traversing graphs and sampling the sparsely located neighboring nodes to obtain their…

Machine Learning · Computer Science 2021-08-17 Seung Won Min , Kun Wu , Sitao Huang , Mert Hidayetoğlu , Jinjun Xiong , Eiman Ebrahimi , Deming Chen , Wen-mei Hwu