中文
相关论文

相关论文: Extreme Network Compression via Filter Group Appro…

200 篇论文

Deep Convolutional Neural Networks (CNNs) for image classification successively alternate convolutions and downsampling operations, such as pooling layers or strided convolutions, resulting in lower resolution features the deeper the…

计算机视觉与模式识别 · 计算机科学 2022-09-29 Ioannis Vezakis , Antonios Vezakis , Sofia Gourtsoyianni , Vassilis Koutoulidis , George K. Matsopoulos , Dimitrios Koutsouris

In recent years deep learning algorithms have shown extremely high performance on machine learning tasks such as image classification and speech recognition. In support of such applications, various FPGA accelerator architectures have been…

机器学习 · 计算机科学 2017-05-09 Xinyu Zhang , Srinjoy Das , Ojash Neopane , Ken Kreutz-Delgado

Deep convolutional neural networks (DCNN) have recently shown promising results in low-level computer vision problems such as optical flow and disparity estimation, but still, have much room to further improve their performance. In this…

计算机视觉与模式识别 · 计算机科学 2018-10-12 Juan Luis Gonzalez , Muhammad Sarmad , Hyunjoo J. Lee , Munchurl Kim

Model compression and acceleration are attracting increasing attentions due to the demand for embedded devices and mobile applications. Research on efficient convolutional neural networks (CNNs) aims at removing feature redundancy by…

机器学习 · 计算机科学 2020-08-21 Jinhua Liang , Tao Zhang , Guoqing Feng

Although deep neural networks (NNs) have achievedstate-of-the-art accuracy in many visual recognition tasks,the growing computational complexity and energy con-sumption of networks remains an issue, especially for ap-plications on platforms…

The training phases of Deep neural network~(DNN) consumes enormous processing time and energy. Compression techniques utilizing the sparsity of DNNs can effectively accelerate the inference phase of DNNs. However, it can be hardly used in…

机器学习 · 计算机科学 2018-12-17 Zhuoran Song , Ru Wang , Dongyu Ru , Hongru Huang , Zhenghao Peng , Jing Ke , Xiaoyao Liang , Li Jiang

Filtered backpropagation (FBPP) is a well-known technique used for Diffraction Tomography (DT). For accurate reconstruction of a complex image using FBPP, full $360^{\circ}$ angular coverage is necessary. However, it has been shown that…

医学物理 · 物理学 2016-05-09 Pavel Roy Paladhi , Ashoke Sinha , Amin Tayebi , Lalita Udpa

In this paper, a new methodology is proposed that allows for the low-complexity development of neural network (NN) based equalizers for the mitigation of impairments in high-speed coherent optical transmission systems. In this work, we…

Filter is the key component in modern convolutional neural networks (CNNs). However, since CNNs are usually over-parameterized, a pre-trained network always contain some invalid (unimportant) filters. These filters have relatively small…

机器学习 · 计算机科学 2021-01-18 Hao Cheng , Fanxu Meng , Ke Li , Yuting Gao , Guangming Lu , Xing Sun , Rongrong Ji

Recent works on neural network pruning advocate that reducing the depth of the network is more effective in reducing run-time memory usage and accelerating inference latency than reducing the width of the network through channel pruning. In…

机器学习 · 计算机科学 2023-06-05 Jinuk Kim , Yeonwoo Jeong , Deokjae Lee , Hyun Oh Song

Deep neural networks (DNN) are powerful models for many pattern recognition tasks, yet their high computational complexity and memory requirement limit them to applications on high-performance computing platforms. In this paper, we propose…

机器学习 · 计算机科学 2018-10-24 Lukas Mauch , Bin Yang

Convolutional neural network (CNN) pruning has become one of the most successful network compression approaches in recent years. Existing works on network pruning usually focus on removing the least important filters in the network to…

计算机视觉与模式识别 · 计算机科学 2021-04-09 Zi Wang , Chengcheng Li , Xiangyang Wang

Deep neural networks (DNNs) have demonstrated remarkable success in various fields. However, the large number of floating-point operations (FLOPs) in DNNs poses challenges for their deployment in resource-constrained applications, e.g.,…

人工智能 · 计算机科学 2024-02-20 Mengnan Jiang , Jingcun Wang , Amro Eldebiky , Xunzhao Yin , Cheng Zhuo , Ing-Chao Lin , Grace Li Zhang

In this paper, we present MicroNet, which is an efficient convolutional neural network using extremely low computational cost (e.g. 6 MFLOPs on ImageNet classification). Such a low cost network is highly desired on edge devices, yet usually…

计算机视觉与模式识别 · 计算机科学 2020-11-25 Yunsheng Li , Yinpeng Chen , Xiyang Dai , Dongdong Chen , Mengchen Liu , Lu Yuan , Zicheng Liu , Lei Zhang , Nuno Vasconcelos

To apply deep CNNs to mobile terminals and portable devices, many scholars have recently worked on the compressing and accelerating deep convolutional neural networks. Based on this, we propose a novel uniform channel pruning (UCP) method…

计算机视觉与模式识别 · 计算机科学 2020-10-06 Jingfei Chang , Yang Lu , Ping Xue , Xing Wei , Zhen Wei

We present an approach to learn a dense pixel-wise labeling from image-level tags. Each image-level tag imposes constraints on the output labeling of a Convolutional Neural Network (CNN) classifier. We propose Constrained CNN (CCNN), a…

计算机视觉与模式识别 · 计算机科学 2015-10-20 Deepak Pathak , Philipp Krähenbühl , Trevor Darrell

We present a filter pruning approach for deep model compression, using a multitask network. Our approach is based on learning a a pruner network to prune a pre-trained target network. The pruner is essentially a multitask deep neural…

计算机视觉与模式识别 · 计算机科学 2020-01-17 Vinay Kumar Verma , Pravendra Singh , Vinay P. Namboodiri , Piyush Rai

In order to better understand manifold neural networks (MNNs), we introduce Manifold Filter-Combine Networks (MFCNs). The filter-combine framework parallels the popular aggregate-combine paradigm for graph neural networks (GNNs) and…

It is well known that Convolutional Neural Networks (CNNs) have significant redundancy in their filter weights. Various methods have been proposed in the literature to compress trained CNNs. These include techniques like pruning weights,…

机器学习 · 计算机科学 2019-06-12 Muhammad Tayyab , Abhijit Mahalanobis

This paper presents an efficient technique to prune deep and/or wide convolutional neural network models by eliminating redundant features (or filters). Previous studies have shown that over-sized deep neural network models tend to produce…

计算机视觉与模式识别 · 计算机科学 2018-02-22 Babajide O. Ayinde , Jacek M. Zurada