English
Related papers

Related papers: Dynamic Steerable Blocks in Deep Residual Networks

200 papers

Residual networks (ResNets) have been utilized for various computer vision and image processing applications. The residual connection improves the training of the network with better gradient flow. A residual block consists of few…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Satya Rajendra Singh , Roshan Reddy Yedla , Shiv Ram Dubey , Rakesh Sanodiya , Wei-Ta Chu

Trainable layers such as convolutional building blocks are the standard network design choices by learning parameters to capture the global context through successive spatial operations. When designing an efficient network, trainable layers…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Dongyoon Han , YoungJoon Yoo , Beomyoung Kim , Byeongho Heo

Although remarkable progress has been made on single image super-resolution due to the revival of deep convolutional neural networks, deep learning methods are confronted with the challenges of computation and memory consumption in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Dehua Song , Chang Xu , Xu Jia , Yiyi Chen , Chunjing Xu , Yunhe Wang

It has long been recognized that the invariance and equivariance properties of a representation are critically important for success in many vision tasks. In this paper we present Steerable Convolutional Neural Networks, an efficient and…

Machine Learning · Computer Science 2019-04-23 Taco S. Cohen , Max Welling

Particle filters flexibly represent multiple posterior modes nonparametrically, via a collection of weighted samples, but have classically been applied to tracking problems with known dynamics and observation likelihoods. Such generative…

Machine Learning · Computer Science 2024-04-16 Ali Younis , Erik Sudderth

Deep residual networks were shown to be able to scale up to thousands of layers and still have improving performance. However, each fraction of a percent of improved accuracy costs nearly doubling the number of layers, and so training very…

Computer Vision and Pattern Recognition · Computer Science 2017-06-15 Sergey Zagoruyko , Nikos Komodakis

In StyleGAN, convolution kernels are shaped by both static parameters shared across images and dynamic modulation factors $w^+\in\mathcal{W}^+$ specific to each image. Therefore, $\mathcal{W}^+$ space is often used for image inversion and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Siwei Xia , Xueqi Hu , Li Sun , Qingli Li

Artificial neural networks have advanced the frontiers of reversible steganography. The core strength of neural networks is the ability to render accurate predictions for a bewildering variety of data. Residual modulation is recognised as…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Ching-Chun Chang , Xu Wang , Sisheng Chen , Hitoshi Kiya , Isao Echizen

Recent work has shown that convolutional networks can be substantially deeper, more accurate, and efficient to train if they contain shorter connections between layers close to the input and those close to the output. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Gao Huang , Zhuang Liu , Laurens van der Maaten , Kilian Q. Weinberger

Deep convolutional neural networks accurately classify a diverse range of natural images, but may be easily deceived when designed, imperceptible perturbations are embedded in the images. In this paper, we design a multi-pronged training,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Nathaniel Dean , Dilip Sarkar

Deep neural network has been ensured as a key technology in the field of many challenging and vigorously researched computer vision tasks. Furthermore, classical ResNet is thought to be a state-of-the-art convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Prathibha Varghese , G. Arockia Selva Saroja

The superior performance of Deformable Convolutional Networks arises from its ability to adapt to the geometric variations of objects. Through an examination of its adaptive behavior, we observe that while the spatial support for its neural…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Xizhou Zhu , Han Hu , Stephen Lin , Jifeng Dai

In this work we propose a deep learning network for deformable image registration (DIRNet). The DIRNet consists of a convolutional neural network (ConvNet) regressor, a spatial transformer, and a resampler. The ConvNet analyzes a pair of…

Computer Vision and Pattern Recognition · Computer Science 2017-12-08 Bob D. de Vos , Floris F. Berendsen , Max A. Viergever , Marius Staring , Ivana Išgum

Deep Convolutional Neural Networks (CNNs), such as Dense Convolutional Networks (DenseNet), have achieved great success for image representation by discovering deep hierarchical information. However, most existing networks simply stacks the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Zhao Zhang , Zemin Tang , Yang Wang , Zheng Zhang , Choujun Zhan , Zhengjun Zha , Meng Wang

Deep neural networks have recently achieved state of the art performance thanks to new training algorithms for rapid parameter estimation and new regularization methods to reduce overfitting. However, in practice the network architecture…

Machine Learning · Computer Science 2016-03-04 Minyoung Kim , Luca Rigazio

In this paper, we propose to exploit the rich hierarchical features of deep convolutional neural networks to improve the accuracy and robustness of visual tracking. Deep neural networks trained on object recognition datasets consist of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Chao Ma , Jia-Bin Huang , Xiaokang Yang , Ming-Hsuan Yang

A deep residual network, built by stacking a sequence of residual blocks, is easy to train, because identity mappings skip residual branches and thus improve information flow. To further reduce the training difficulty, we present a simple…

Computer Vision and Pattern Recognition · Computer Science 2017-07-20 Liming Zhao , Jingdong Wang , Xi Li , Zhuowen Tu , Wenjun Zeng

The deep-learning-based image restoration and fusion methods have achieved remarkable results. However, the existing restoration and fusion methods paid little research attention to the robustness problem caused by dynamic degradation. In…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Aiqing Fang , Xinbo Zhao , Jiaqi Yang , Yanning Zhang

Extremely efficient convolutional neural network architectures are one of the most important requirements for limited-resource devices (such as embedded and mobile devices). The computing power and memory size are two important constraints…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Fahimeh Fooladgar , Shohreh Kasaei

Residual networks (ResNets) represent a powerful type of convolutional neural network (CNN) architecture, widely adopted and used in various tasks. In this work we propose an improved version of ResNets. Our proposed improvements address…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Ionut Cosmin Duta , Li Liu , Fan Zhu , Ling Shao