English
Related papers

Related papers: Resnet in Resnet: Generalizing Residual Architectu…

200 papers

Most existing Convolutional Neural Networks(CNNs) used for action recognition are either difficult to optimize or underuse crucial temporal information. Inspired by the fact that the recurrent model consistently makes breakthroughs in the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Zhenxing Zheng , Gaoyun An , Qiuqi Ruan

Recent advances in the design of convolutional neural network (CNN) have yielded significant improvements in the performance of image super-resolution (SR). The boost in performance can be attributed to the presence of residual or dense…

Image and Video Processing · Electrical Eng. & Systems 2022-01-31 Kuldeep Purohit , Srimanta Mandal , A. N. Rajagopalan

Deep Convolutional Neural Networks (CNNs) i.e. Residual Networks (ResNets) have been used successfully for many computer vision tasks, but are difficult to scale to 3D volumetric medical data. Memory is increasingly often the bottleneck…

Image and Video Processing · Electrical Eng. & Systems 2021-03-17 Kashu Yamazaki , Vidhiwar Singh Rathour , T. Hoang Ngan Le

Novel computer vision architectures monopolize the spotlight, but the impact of the model architecture is often conflated with simultaneous changes to training methodology and scaling strategies. Our work revisits the canonical ResNet (He…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Irwan Bello , William Fedus , Xianzhi Du , Ekin D. Cubuk , Aravind Srinivas , Tsung-Yi Lin , Jonathon Shlens , Barret Zoph

Recovering images from undersampled linear measurements typically leads to an ill-posed linear inverse problem, that asks for proper statistical priors. Building effective priors is however challenged by the low train and test overhead…

Artificial Intelligence · Computer Science 2017-11-29 Morteza Mardani , Hatef Monajemi , Vardan Papyan , Shreyas Vasanawala , David Donoho , John Pauly

Deep learning architectures suffer from depth-related performance degradation, limiting the effective depth of neural networks. Approaches like ResNet are able to mitigate this, but they do not completely eliminate the problem. We introduce…

Machine Learning · Computer Science 2023-11-28 Antonio Di Cecco , Carlo Metta , Marco Fantozzi , Francesco Morandin , Maurizio Parton

In recent years, deep learning methods have been successfully applied to single-image super-resolution tasks. Despite their great performances, deep learning methods cannot be easily applied to real-world applications due to the requirement…

Computer Vision and Pattern Recognition · Computer Science 2018-10-08 Namhyuk Ahn , Byungkon Kang , Kyung-Ah Sohn

In this work, we propose "Residual Attention Network", a convolutional neural network using attention mechanism which can incorporate with state-of-art feed forward network architecture in an end-to-end training fashion. Our Residual…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Fei Wang , Mengqing Jiang , Chen Qian , Shuo Yang , Cheng Li , Honggang Zhang , Xiaogang Wang , Xiaoou Tang

Single image super-resolution (SISR) is a very popular topic nowadays, which has both research value and practical value. In daily life, we crop a large image into sub-images to do super-resolution and then merge them together. Although…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Junyu , Wang , Rong Song

Convolutional Neural Networks (CNNs) have achieved tremendous success in a number of learning tasks including image classification. Recent advanced models in CNNs, such as ResNets, mainly focus on the skip connection to avoid gradient…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Xinglin Pan , Jing Xu , Yu Pan , liangjian Wen , WenXiang Lin , Kun Bai , Zenglin Xu

We introduce Repetition-Reduction network (RRNet) for resource-constrained depth estimation, offering significantly improved efficiency in terms of computation, memory and energy consumption. The proposed method is based on…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Sangyun Oh , Hye-Jin S. Kim , Jongeun Lee , Junmo Kim

We propose a simple extension of residual networks that works simultaneously in multiple resolutions. Our network design is inspired by the iterative back-projection algorithm but seeks the more difficult task of learning how to enhance…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Pablo Navarrete Michelini , Hanwen Liu , Yunhua Lu , Xingqun Jiang

The Reference-based Super-resolution (RefSR) super-resolves a low-resolution (LR) image given an external high-resolution (HR) reference image, where the reference image and LR image share similar viewpoint but with significant resolution…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Haitian Zheng , Mengqi Ji , Haoqian Wang , Yebin Liu , Lu Fang

Very deep convolutional neural networks offer excellent recognition results, yet their computational expense limits their impact for many real-world applications. We introduce BlockDrop, an approach that learns to dynamically choose which…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Zuxuan Wu , Tushar Nagarajan , Abhishek Kumar , Steven Rennie , Larry S. Davis , Kristen Grauman , Rogerio Feris

Recently, Neural Architecture Search (NAS) methods are introduced and show impressive performance on many benchmarks. Among those NAS studies, Neural Architecture Transformer (NAT) aims to improve the given neural architecture to have…

Machine Learning · Computer Science 2021-10-20 Do-Guk Kim , Heung-Chang Lee

Basing on the analysis by revealing the equivalence of modern networks, we find that both ResNet and DenseNet are essentially derived from the same "dense topology", yet they only differ in the form of connection -- addition (dubbed "inner…

Machine Learning · Computer Science 2018-02-07 Wenhai Wang , Xiang Li , Jian Yang , Tong Lu

One of the methods used in image recognition is the Deep Convolutional Neural Network (DCNN). DCNN is a model in which the expressive power of features is greatly improved by deepening the hidden layer of CNN. The architecture of CNNs is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Genta Kobayashi , Hayaru Shouno

Improving existing neural network architectures can involve several design choices such as manipulating the loss functions, employing a diverse learning strategy, exploiting gradient evolution at training time, optimizing the network…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Danilo Avola , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti

Super-resolution (SR) is the technique of increasing the nominal resolution of image / video content accompanied with quality improvement. Video super-resolution (VSR) can be considered as the generalization of single image super-resolution…

Image and Video Processing · Electrical Eng. & Systems 2023-10-18 MohammadHossein Ashoori , Arash Amini

Semantic image segmentation is an essential component of modern autonomous driving systems, as an accurate understanding of the surrounding scene is crucial to navigation and action planning. Current state-of-the-art approaches in semantic…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Tobias Pohlen , Alexander Hermans , Markus Mathias , Bastian Leibe