中文
相关论文

相关论文: Iterative Filter Pruning for Concatenation-based C…

200 篇论文

Embedded and personal IoT devices are powered by microcontroller units (MCUs), whose extreme resource scarcity is a major obstacle for applications relying on on-device deep learning inference. Orders of magnitude less storage, memory and…

机器学习 · 计算机科学 2022-12-09 Edgar Liberis , Nicholas D. Lane

Most modern convolutional neural networks (CNNs) used for object recognition are built using the same principles: Alternating convolution and max-pooling layers followed by a small number of fully connected layers. We re-evaluate the state…

机器学习 · 计算机科学 2015-04-14 Jost Tobias Springenberg , Alexey Dosovitskiy , Thomas Brox , Martin Riedmiller

In this work, we propose a graph-adaptive pruning (GAP) method for efficient inference of convolutional neural networks (CNNs). In this method, the network is viewed as a computational graph, in which the vertices denote the computation…

计算机视觉与模式识别 · 计算机科学 2018-11-22 Mengdi Wang , Qing Zhang , Jun Yang , Xiaoyuan Cui , Wei Lin

Real time application of deep learning algorithms is often hindered by high computational complexity and frequent memory accesses. Network pruning is a promising technique to solve this problem. However, pruning usually results in irregular…

神经与进化计算 · 计算机科学 2015-12-31 Sajid Anwar , Kyuyeon Hwang , Wonyong Sung

Besides accuracy, the model size of convolutional neural networks (CNN) models is another important factor considering limited hardware resources in practical applications. For example, employing deep neural networks on mobile systems…

机器学习 · 计算机科学 2021-07-05 Huixin Zhan , Wei-Ming Lin , Yongcan Cao

Deep Convolutional Neural Networks~(CNNs) offer remarkable performance of classifications and regressions in many high-dimensional problems and have been widely utilized in real-word cognitive applications. However, high computational cost…

计算机视觉与模式识别 · 计算机科学 2018-09-10 Chuhan Min , Aosen Wang , Yiran Chen , Wenyao Xu , Xin Chen

We present the implementation of four FPGA-accelerated convolutional neural network (CNN) models for onboard cloud detection in resource-constrained CubeSat missions, leveraging Xilinx's Vitis AI (VAI) framework and Deep Learning Processing…

This paper proposes anchor pruning for object detection in one-stage anchor-based detectors. While pruning techniques are widely used to reduce the computational cost of convolutional neural networks, they tend to focus on optimizing the…

计算机视觉与模式识别 · 计算机科学 2022-06-02 Maxim Bonnaerens , Matthias Freiberger , Joni Dambre

During the last years, algorithms known as Convolutional Neural Networks (CNNs) had become increasingly popular, expanding its application range to several areas. In particular, the image processing field has experienced a remarkable…

硬件体系结构 · 计算机科学 2024-08-27 Federico Nicolas Peccia , Luciano Ferreyro , Alejandro Furfaro

Typical convolutional neural networks (CNNs) have several millions of parameters and require a large amount of annotated data to train them. In medical applications where training data is hard to come by, these sophisticated machine…

计算机视觉与模式识别 · 计算机科学 2016-12-09 Rahul Venkataramani , Sheshadri Thiruvenkadam , Prasad Sudhakar , Hariharan Ravishankar , Vivek Vaidya

Pruning is one of the major methods to compress deep neural networks. In this paper, we propose an Ising energy model within an optimization framework for pruning convolutional kernels and hidden units. This model is designed to reduce…

神经与进化计算 · 计算机科学 2021-02-11 Hojjat Salehinejad , Shahrokh Valaee

Graph Neural Networks (GNNs) are proven to be powerful models to generate node embedding for downstream applications. However, due to the high computation complexity of GNN inference, it is hard to deploy GNNs for large-scale or real-time…

机器学习 · 计算机科学 2021-05-11 Hongkuan Zhou , Ajitesh Srivastava , Hanqing Zeng , Rajgopal Kannan , Viktor Prasanna

While CNNs naturally lend themselves to densely sampled data, and sophisticated implementations are available, they lack the ability to efficiently process sparse data. In this work we introduce a suite of tools that exploit sparsity in…

计算机视觉与模式识别 · 计算机科学 2020-03-13 Timo Hackel , Mikhail Usvyatsov , Silvano Galliani , Jan D. Wegner , Konrad Schindler

In this paper we evaluate the quality of the activation layers of a convolutional neural network (CNN) for the gen- eration of object proposals. We generate hypotheses in a sliding-window fashion over different activation layers and show…

计算机视觉与模式识别 · 计算机科学 2015-10-16 Amir Ghodrati , Ali Diba , Marco Pedersoli , Tinne Tuytelaars , Luc Van Gool

CNN model is a popular method for imagery analysis, so it could be utilized to recognize handwritten digits based on MNIST datasets. For higher recognition accuracy, various CNN models with different fully connected layer sizes are…

计算机视觉与模式识别 · 计算机科学 2021-01-18 Mengyu Chen

Deep Neural Networks have been used in a wide variety of applications with significant success. However, their highly complex nature owing to comprising millions of parameters has lead to problems during deployment in pipelines with low…

机器学习 · 计算机科学 2022-08-15 Elvis Johnson , Xiaochen Tang , Sriramacharyulu Samudrala

Computational complexity and storage requirements are crucial factors influencing the performance and efficiency of convolutional neural networks (CNNs) in resource-constrained environments. This paper presents a high-performance embedded…

In this paper, we evaluate convolutional neural network (CNN) features using the AlexNet architecture and very deep convolutional network (VGGNet) architecture. To date, most CNN researchers have employed the last layers before output,…

计算机视觉与模式识别 · 计算机科学 2015-09-28 Hirokatsu Kataoka , Kenji Iwata , Yutaka Satoh

To compress deep convolutional neural networks (CNNs) with large memory footprint and long inference time, this paper proposes a novel pruning criterion using layer-wised Ln-norm of feature maps. Different from existing pruning criteria,…

神经与进化计算 · 计算机科学 2018-12-11 Wei Wang , Liqiang Zhu

CNN architectures are generally heavy on memory and computational requirements which makes them infeasible for embedded systems with limited hardware resources. We propose dual convolutional kernels (DualConv) for constructing lightweight…

计算机视觉与模式识别 · 计算机科学 2022-02-16 Jiachen Zhong , Junying Chen , Ajmal Mian