English
Related papers

Related papers: LeanResNet: A Low-cost Yet Effective Convolutional…

200 papers

Deep convolutional neural networks (CNNs) have recently achieved great success for single image super-resolution (SISR) task due to their powerful feature representation capabilities. The most recent deep learning based SISR methods focus…

Image and Video Processing · Electrical Eng. & Systems 2020-09-11 Rao Muhammad Umer , Gian Luca Foresti , Christian Micheloni

Convolutional neural networks (CNNs) are widely used in image recognition. Numerous CNN models, such as LeNet, AlexNet, VGG, ResNet, and GoogLeNet, have been proposed by increasing the number of layers, to improve the performance of CNNs.…

Neural and Evolutionary Computing · Computer Science 2021-08-10 Wei-Chang Yeh , Yi-Ping Lin , Yun-Chia Liang , Chyh-Ming Lai

Head poses are a key component of human bodily communication and thus a decisive element of human-computer interaction. Real-time head pose estimation is crucial in the context of human-robot interaction or driver assistance systems. The…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Ines Rieger , Thomas Hauenstein , Sebastian Hettenkofer , Jens-Uwe Garbas

This work investigates use of equivariant neural networks as efficient and high-performance frameworks for image reconstruction and denoising in nuclear medicine. Our work aims to tackle limitations of conventional Convolutional Neural…

Image and Video Processing · Electrical Eng. & Systems 2025-02-03 Amirreza Hashemi , Yuemeng Feng , Arman Rahmim , Hamid Sabet

Deep convolutional neural networks (CNNs) are usually over-parameterized, which cannot be easily deployed on edge devices such as mobile phones and smart cameras. Existing works used to decrease the number or size of requested convolution…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Kai Han , Yunhe Wang , Yixing Xu , Chunjing Xu , Dacheng Tao , Chang Xu

Deep neural networks (DNNs), especially deep convolutional neural networks (CNNs), have emerged as the powerful technique in various machine learning applications. However, the large model sizes of DNNs yield high demands on computation…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Siyu Liao , Zhe Li , Liang Zhao , Qinru Qiu , Yanzhi Wang , Bo Yuan

The performance of a Convolutional Neural Network (CNN) depends on its hyperparameters, like the number of layers, kernel sizes, or the learning rate for example. Especially in smaller networks and applications with limited computational…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Lukas Hahn , Lutz Roese-Koerner , Klaus Friedrichs , Anton Kummert

Convolutional neural networks (CNNs) have rapidly risen in popularity for many machine learning applications, particularly in the field of image recognition. Much of the benefit generated from these networks comes from their ability to…

Quantum Physics · Physics 2019-04-10 Maxwell Henderson , Samriddhi Shakya , Shashindra Pradhan , Tristan Cook

Residual network (ResNet) and densely connected network (DenseNet) have significantly improved the training efficiency and performance of deep convolutional neural networks (DCNNs) mainly for object classification tasks. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Mina Jafari , Dorothee Auer , Susan Francis , Jonathan Garibaldi , Xin Chen

This paper shows that it is possible to train large and deep convolutional neural networks (CNN) for JPEG compression artifacts reduction, and that such networks can provide significantly better reconstruction quality compared to previously…

Computer Vision and Pattern Recognition · Computer Science 2016-05-03 Pavel Svoboda , Michal Hradis , David Barina , Pavel Zemcik

While Convolutional Neural Networks (CNNs) excel at learning complex latent-space representations, their over-parameterization can lead to overfitting and reduced performance, particularly with limited data. This, alongside their high…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Manish Sharma , Jamison Heard , Eli Saber , Panos P. Markopoulos

Deep residual networks (ResNets) made a recent breakthrough in deep learning. The core idea of ResNets is to have shortcut connections between layers that allow the network to be much deeper while still being easy to optimize avoiding…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Sam Leroux , Pavlo Molchanov , Pieter Simoens , Bart Dhoedt , Thomas Breuel , Jan Kautz

Filters are the essential elements in convolutional neural networks (CNNs). Filters are corresponded to the feature maps and form the main part of the computational and memory requirement for the CNN processing. In filter pruning methods, a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Morteza Mousa-Pasandi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi , Shahram Shirani

Deep learning, especially convolutional neural networks, has triggered accelerated advancements in computer vision, bringing changes into our daily practice. Furthermore, the standardized deep learning modules (also known as backbone…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Hongzhi Zhu , Robert Rohling , Septimiu Salcudean

The convolutional neural network (CNN) is one of the most commonly used architectures for computer vision tasks. The key building block of a CNN is the convolutional kernel that aggregates information from the pixel neighborhood and shares…

Image and Video Processing · Electrical Eng. & Systems 2022-02-08 Tianyu Ma , Alan Q. Wang , Adrian V. Dalca , Mert R. Sabuncu

Model pruning has become a useful technique that improves the computational efficiency of deep learning, making it possible to deploy solutions in resource-limited scenarios. A widely-used practice in relevant work assumes that a…

Machine Learning · Computer Science 2018-02-06 Jianbo Ye , Xin Lu , Zhe Lin , James Z. Wang

Convolutional Neural Networks (CNNs) have revolutionized performances in several machine learning tasks such as image classification, object tracking, and keyword spotting. However, given that they contain a large number of parameters,…

Image and Video Processing · Electrical Eng. & Systems 2019-03-28 Taruna Agrawal , Rahul Gupta , Shrikanth Narayanan

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

Over recent years, increasingly complex approaches based on sophisticated convolutional neural network architectures have been slowly pushing performance on well-established benchmark datasets. In this paper, we take a step back to examine…

Image and Video Processing · Electrical Eng. & Systems 2021-12-22 Tariq M Khan , Antonio Robles-Kelly , Syed S. Naqvi

Recent studies have used deep residual convolutional neural networks (CNNs) for JPEG compression artifact reduction. This study proposes a scalable CNN called S-Net. Our approach effectively adjusts the network scale dynamically in a…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Bolun Zheng , Rui Sun , Xiang Tian , Yaowu Chen