中文
相关论文

相关论文: Deep Roots: Improving CNN Efficiency with Hierarch…

200 篇论文

Although state-of-the-art (SOTA) CNNs achieve outstanding performance on various tasks, their high computation demand and massive number of parameters make it difficult to deploy these SOTA CNNs onto resource-constrained devices. Previous…

计算机视觉与模式识别 · 计算机科学 2020-06-26 Shiyu Li , Edward Hanson , Hai Li , Yiran Chen

Convolutional neural networks (CNNs) are widely used in image recognition. Numerous CNN models, such as LeNet, AlexNet, VGG, ResNet, and GoogLeNet, have been proposed by increasing the number of layers, to improve the performance of CNNs.…

神经与进化计算 · 计算机科学 2021-08-10 Wei-Chang Yeh , Yi-Ping Lin , Yun-Chia Liang , Chyh-Ming Lai

Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does not make the network…

计算机视觉与模式识别 · 计算机科学 2022-11-16 Rui-Yang Ju , Jen-Shiun Chiang , Chih-Chia Chen , Yu-Shian Lin

Neural networks have recently had a lot of success for many tasks. However, neural network architectures that perform well are still typically designed manually by experts in a cumbersome trial-and-error process. We propose a new method to…

机器学习 · 统计学 2017-11-15 Thomas Elsken , Jan-Hendrik Metzen , Frank Hutter

Convolutional neural network (CNN) is a class of artificial neural networks widely used in computer vision tasks. Most CNNs achieve excellent performance by stacking certain types of basic units. In addition to increasing the depth and…

计算机视觉与模式识别 · 计算机科学 2021-02-09 Junyi An , Fengshan Liu , Jian Zhao , Furao Shen

Deep Convolutional Neural Networks (CNNs) are more powerful than Deep Neural Networks (DNN), as they are able to better reduce spectral variation in the input signal. This has also been confirmed experimentally, with CNNs showing…

Deciding the amount of neurons during the design of a deep neural network to maximize performance is not intuitive. In this work, we attempt to search for the neuron (filter) configuration of a fixed network architecture that maximizes…

计算机视觉与模式识别 · 计算机科学 2020-06-25 Eugene Lee , Chen-Yi Lee

Convolutional Neural Networks (CNNs) have demonstrated exceptional performance in recent years. Compressing these models not only reduces storage requirements, making deployment to edge devices feasible, but also accelerates inference,…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Boyao Wang , Volodymyr Kindratenko

While Convolutional Neural Networks (CNNs) excel at learning complex latent-space representations, their over-parameterization can lead to overfitting and reduced performance, particularly with limited data. This, alongside their high…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Manish Sharma , Jamison Heard , Eli Saber , Panos P. Markopoulos

This paper aims to accelerate the test-time computation of deep convolutional neural networks (CNNs). Unlike existing methods that are designed for approximating linear filters or linear responses, our method takes the nonlinear units into…

计算机视觉与模式识别 · 计算机科学 2014-11-18 Xiangyu Zhang , Jianhua Zou , Xiang Ming , Kaiming He , Jian Sun

Training deep Convolutional Neural Networks (CNN) is a time consuming task that may take weeks to complete. In this article we propose a novel, theoretically founded method for reducing CNN training time without incurring any loss in…

计算机视觉与模式识别 · 计算机科学 2016-10-13 Pedro Porto Buarque de Gusmão , Gianluca Francini , Skjalg Lepsøy , Enrico Magli

Deep convolutional neural networks (CNN) brought revolution without any doubt to various challenging tasks, mainly in computer vision. However, their model designing still requires attention to reduce number of learnable parameters, with no…

计算机视觉与模式识别 · 计算机科学 2016-08-16 Ihsan Ullah , Alfredo Petrosino

Deploying deep convolutional neural networks (CNNs) on resource-constrained devices presents significant challenges due to their high computational demands and rigid, static architectures. To overcome these limitations, this thesis explores…

机器学习 · 计算机科学 2025-05-20 Pooja Mangal , Sudaksh Kalra , Dolly Sapra

Nowadays, it is still difficult to adapt Convolutional Neural Network (CNN) based models for deployment on embedded devices. The heavy computation and large memory footprint of CNN models become the main burden in real application. In this…

计算机视觉与模式识别 · 计算机科学 2017-08-09 Xin Li , Changsong Liu

In this paper we propose cross-modal convolutional neural networks (X-CNNs), a novel biologically inspired type of CNN architectures, treating gradient descent-specialised CNNs as individual units of processing in a larger-scale network…

机器学习 · 统计学 2017-09-26 Petar Veličković , Duo Wang , Nicholas D. Lane , Pietro Liò

Convolutional neural networks (CNN) are increasingly used in many areas of computer vision. They are particularly attractive because of their ability to "absorb" great quantities of labeled data through millions of parameters. However, as…

机器学习 · 计算机科学 2015-06-16 Wenlin Chen , James T. Wilson , Stephen Tyree , Kilian Q. Weinberger , Yixin Chen

To accelerate deep CNN models, this paper proposes a novel spatially adaptive framework that can dynamically generate pixel-wise sparsity according to the input image. The sparse scheme is pixel-wise refined, regional adaptive under a…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Chen Tang , Wenyu Sun , Zhuqing Yuan , Yongpan Liu

As a successful deep model applied in image super-resolution (SR), the Super-Resolution Convolutional Neural Network (SRCNN) has demonstrated superior performance to the previous hand-crafted models either in speed and restoration quality.…

计算机视觉与模式识别 · 计算机科学 2016-08-02 Chao Dong , Chen Change Loy , Xiaoou Tang

With the continuous development of neural networks for computer vision tasks, more and more network architectures have achieved outstanding success. As one of the most advanced neural network architectures, DenseNet shortcuts all feature…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Rui-Yang Ju , Ting-Yu Lin , Jia-Hao Jian , Jen-Shiun Chiang , Wei-Bin Yang

Pruning methods have shown to be effective at reducing the size of deep neural networks while keeping accuracy almost intact. Among the most effective methods are those that prune a network while training it with a sparsity prior loss and…

神经与进化计算 · 计算机科学 2019-12-20 Carl Lemaire , Andrew Achkar , Pierre-Marc Jodoin