English
Related papers

Related papers: Resnet in Resnet: Generalizing Residual Architectu…

200 papers

Deep convolutional neural networks (CNNs) have recently achieved great success for single image super-resolution (SISR) task due to their powerful feature representation capabilities. The most recent deep learning based SISR methods focus…

Image and Video Processing · Electrical Eng. & Systems 2020-09-11 Rao Muhammad Umer , Gian Luca Foresti , Christian Micheloni

A residual network (or ResNet) is a standard deep neural net architecture, with state-of-the-art performance across numerous applications. The main premise of ResNets is that they allow the training of each layer to focus on fitting just…

Machine Learning · Computer Science 2018-09-28 Ohad Shamir

Residual neural networks (ResNets) are a promising class of deep neural networks that have shown excellent performance for a number of learning tasks, e.g., image classification and recognition. Mathematically, ResNet architectures can be…

Optimization and Control · Mathematics 2019-07-26 S. Günther , L. Ruthotto , J. B. Schroder , E. C. Cyr , N. R. Gauger

Deep residual networks have recently shown appealing performance on many challenging computer vision tasks. However, the original residual structure still has some defects making it difficult to converge on very deep networks. In this…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Falong Shen , Gang Zeng

Very deep convolutional neural networks (CNNs) yield state of the art results on a wide variety of visual recognition problems. A number of state of the the art methods for image recognition are based on networks with well over 100 layers…

Computer Vision and Pattern Recognition · Computer Science 2016-07-15 Joel Moniz , Christopher Pal

We present new Recurrent Neural Network (RNN) cells for image classification using a Neural Architecture Search (NAS) approach called DARTS. We are interested in the ReNet architecture, which is a RNN based approach presented as an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Brian Moser , Federico Raue , Jörn Hees , Andreas Dengel

Representing features at multiple scales is of great importance for numerous vision tasks. Recent advances in backbone convolutional neural networks (CNNs) continually demonstrate stronger multi-scale representation ability, leading to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Shang-Hua Gao , Ming-Ming Cheng , Kai Zhao , Xin-Yu Zhang , Ming-Hsuan Yang , Philip Torr

Convolutional neural network (CNN) depth is of crucial importance for image super-resolution (SR). However, we observe that deeper networks for image SR are more difficult to train. The low-resolution inputs and features contain abundant…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Yulun Zhang , Kunpeng Li , Kai Li , Lichen Wang , Bineng Zhong , Yun Fu

Residual networks (Resnets) have become a prominent architecture in deep learning. However, a comprehensive understanding of Resnets is still a topic of ongoing research. A recent view argues that Resnets perform iterative refinement of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-09 Stanisław Jastrzębski , Devansh Arpit , Nicolas Ballas , Vikas Verma , Tong Che , Yoshua Bengio

Deep residual networks (ResNets) made a recent breakthrough in deep learning. The core idea of ResNets is to have shortcut connections between layers that allow the network to be much deeper while still being easy to optimize avoiding…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Sam Leroux , Pavlo Molchanov , Pieter Simoens , Bart Dhoedt , Thomas Breuel , Jan Kautz

Deep residual networks (ResNets) and their variants are widely used in many computer vision applications and natural language processing tasks. However, the theoretical principles for designing and training ResNets are still not fully…

Machine Learning · Statistics 2018-02-05 Bo Chang , Lili Meng , Eldad Haber , Frederick Tung , David Begert

Deep Convolutional Neural Networks (DCNNs) have achieved impressive performance in Single Image Super-Resolution (SISR). To further improve the performance, existing CNN-based methods generally focus on designing deeper architecture of the…

Image and Video Processing · Electrical Eng. & Systems 2020-05-22 Wenjie Ai , Xiaoguang Tu , Shilei Cheng , Mei Xie

ResNets and its variants play an important role in various fields of image recognition. This paper gives another variant of ResNets, a kind of cross-residual learning networks called C-ResNets, which has less computation and parameters than…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Jun Liang , Songsen Yu , Huan Yang

Deep convolutional neural networks (CNNs) have obtained remarkable performance in single image super-resolution (SISR). However, very deep networks can suffer from training difficulty and hardly achieve further performance gain. There are…

Image and Video Processing · Electrical Eng. & Systems 2022-11-18 Alexander Panaetov , Karim Elhadji Daou , Igor Samenko , Evgeny Tetin , Ilya Ivanov

Capturing feature information effectively is of great importance in the field of computer vision. With the development of convolutional neural networks (CNNs), concepts like residual connection and multiple scales promote continual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yuanpeng He , Wenjie Song , Lijian Li , Tianxiang Zhan , Wenpin Jiao

Deep convolutional neural networks (DCNNs) have shown remarkable performance in image classification tasks in recent years. Generally, deep neural network architectures are stacks consisting of a large number of convolutional layers, and…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Dongyoon Han , Jiwhan Kim , Junmo Kim

Various deep neural network architectures (DNNs) maintain massive vital records in computer vision. While drawing attention worldwide, the design of the overall structure lacks general guidance. Based on the relationship between DNN design…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Zhengbo Luo , Zitang Sun , Weilian Zhou , Zizhang Wu , Sei-ichiro Kamata

The influential Residual Networks designed by He et al. remain the gold-standard architecture in numerous scientific publications. They typically serve as the default architecture in studies, or as baselines when new architectures are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Ross Wightman , Hugo Touvron , Hervé Jégou

Adaptive inference is an effective mechanism to achieve a dynamic tradeoff between accuracy and computational cost in deep networks. Existing works mainly exploit architecture redundancy in network depth or width. In this paper, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Le Yang , Yizeng Han , Xi Chen , Shiji Song , Jifeng Dai , Gao Huang

Deep neural network has been ensured as a key technology in the field of many challenging and vigorously researched computer vision tasks. Furthermore, classical ResNet is thought to be a state-of-the-art convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Prathibha Varghese , G. Arockia Selva Saroja