English
Related papers

Related papers: ShaResNet: reducing residual network parameter num…

200 papers

Because hyperspectral remote sensing images contain a lot of redundant information and the data structure is highly non-linear, leading to low classification accuracy of traditional machine learning methods. The latest research shows that…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Xiangdong Zhang , Tengjun Wang , Yun Yang

Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does not make the network…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Rui-Yang Ju , Jen-Shiun Chiang , Chih-Chia Chen , Yu-Shian Lin

In a hybrid neural network, the expensive convolutional layers are replaced by a non-trainable fixed transform with a great reduction in parameters. In previous works, good results were obtained by replacing the convolutions with wavelets.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Manny Ko , Ujjawal K. Panchal , Héctor Andrade-Loarca , Andres Mendez-Vazquez

Semantic Segmentation using deep convolutional neural network pose more complex challenge for any GPU intensive task. As it has to compute million of parameters, it results to huge memory consumption. Moreover, extracting finer features and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Sharif Amit Kamran , Ali Shihab Sabbir

We introduce Repetition-Reduction network (RRNet) for resource-constrained depth estimation, offering significantly improved efficiency in terms of computation, memory and energy consumption. The proposed method is based on…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Sangyun Oh , Hye-Jin S. Kim , Jongeun Lee , Junmo Kim

ResNets (or Residual Networks) are one of the most commonly used models for image classification tasks. In this project, we design and train a modified ResNet model for CIFAR-10 image classification. In particular, we aimed at maximizing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Aditya Thakur , Harish Chauhan , Nikunj Gupta

Convolutional neural networks are the most successful models in single image super-resolution. Deeper networks, residual connections, and attention mechanisms have further improved their performance. However, these strategies often improve…

Image and Video Processing · Electrical Eng. & Systems 2020-12-09 Parichehr Behjati , Pau Rodriguez , Armin Mehri , Isabelle Hupont , Carles Fernández Tena , Jordi Gonzalez

The block-based coding structure in the hybrid video coding framework inevitably introduces compression artifacts such as blocking, ringing, etc. To compensate for those artifacts, extensive filtering techniques were proposed in the loop of…

Image and Video Processing · Electrical Eng. & Systems 2021-05-05 Wei Jia , Li Li , Zhu Li , xiang zhang , Shan Liu

Very deep convolutional networks with hundreds of layers have led to significant reductions in error on competitive benchmarks. Although the unmatched expressiveness of the many layers can be highly desirable at test time, training very…

Machine Learning · Computer Science 2016-08-01 Gao Huang , Yu Sun , Zhuang Liu , Daniel Sedra , Kilian Weinberger

PCANet and its variants provided good accuracy results for classification tasks. However, despite the importance of network depth in achieving good classification accuracy, these networks were trained with a maximum of nine layers. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Mubarakah Alotaibi , Richard Wilson

While convolutional neural networks (CNNs) demonstrate outstanding performance on computer vision tasks, their computational costs remain high. Several techniques are used to reduce these costs, like reducing channel count, and using…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Nazmul Shahadat , Anthony S. Maida

Deep convolutional networks are well-known for their high computational and memory demands. Given limited resources, how does one design a network that balances its size, training time, and prediction accuracy? A surprisingly effective…

Computer Vision and Pattern Recognition · Computer Science 2017-02-22 Soravit Changpinyo , Mark Sandler , Andrey Zhmoginov

Neural networks are both computationally intensive and memory intensive, making them difficult to deploy on embedded systems. Also, conventional networks fix the architecture before training starts; as a result, training cannot improve the…

Neural and Evolutionary Computing · Computer Science 2015-11-03 Song Han , Jeff Pool , John Tran , William J. Dally

This paper presents an efficient technique to prune deep and/or wide convolutional neural network models by eliminating redundant features (or filters). Previous studies have shown that over-sized deep neural network models tend to produce…

Computer Vision and Pattern Recognition · Computer Science 2018-02-22 Babajide O. Ayinde , Jacek M. Zurada

Super-resolution reconstruction techniques entail the utilization of software algorithms to transform one or more sets of low-resolution images captured from the same scene into high-resolution images. In recent years, considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Hao Yan , Zixiang Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu , Ranran Lyu

Recent work has shown that convolutional networks can be substantially deeper, more accurate, and efficient to train if they contain shorter connections between layers close to the input and those close to the output. In this paper, we…

Machine Learning · Computer Science 2020-01-09 Gao Huang , Zhuang Liu , Geoff Pleiss , Laurens van der Maaten , Kilian Q. Weinberger

Deep residual networks (ResNets) and their variants are widely used in many computer vision applications and natural language processing tasks. However, the theoretical principles for designing and training ResNets are still not fully…

Machine Learning · Statistics 2018-02-05 Bo Chang , Lili Meng , Eldad Haber , Frederick Tung , David Begert

Scaling up network depth is a fundamental pursuit in neural architecture design, as theory suggests that deeper models offer exponentially greater capability. Benefiting from the residual connections, modern neural networks can scale up to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Dongchen Han , Tianzhu Ye , Zhuofan Xia , Kaiyi Chen , Yulin Wang , Hanting Chen , Gao Huang

Deep convolutional neural networks (CNNs) have obtained remarkable performance in single image super-resolution (SISR). However, very deep networks can suffer from training difficulty and hardly achieve further performance gain. There are…

Image and Video Processing · Electrical Eng. & Systems 2022-11-18 Alexander Panaetov , Karim Elhadji Daou , Igor Samenko , Evgeny Tetin , Ilya Ivanov

Convolutional Neural Networks (CNNs) have been proven to be extremely successful at solving computer vision tasks. State-of-the-art methods favor such deep network architectures for its accuracy performance, with the cost of having massive…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Jiahui Huang , Kshitij Dwivedi , Gemma Roig