English
Related papers

Related papers: Dynamic Steerable Blocks in Deep Residual Networks

200 papers

A residual-networks family with hundreds or even thousands of layers dominates major image recognition tasks, but building a network by simply stacking residual blocks inevitably limits its optimization ability. This paper proposes a novel…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Ke Zhang , Miao Sun , Tony X. Han , Xingfang Yuan , Liru Guo , Tao Liu

The inference structures and computational complexity of existing deep neural networks, once trained, are fixed and remain the same for all test images. However, in practice, it is highly desirable to establish a progressive structure for…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Zhi Zhang , Guanghan Ning , Yigang Cen , Yang Li , Zhiqun Zhao , Hao Sun , Zhihai He

Most deep learning backbones are evaluated on ImageNet. Using scenery images as an example, we conducted extensive experiments to demonstrate the widely accepted principles in network design may result in dramatic performance differences…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Zhinan Qiao , Xiaohui Yuan

The trend towards increasingly deep neural networks has been driven by a general observation that increasing depth increases the performance of a network. Recently, however, evidence has been amassing that simply increasing depth may not be…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Zifeng Wu , Chunhua Shen , Anton van den Hengel

In the last decade, deep learning has contributed to advances in a wide range computer vision tasks including texture analysis. This paper explores a new approach for texture segmentation using deep convolutional neural networks, sharing…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Vincent Andrearczyk , Paul F. Whelan

Recently it has been shown that deep learning-based image compression has shown the potential to outperform traditional codecs. However, most existing methods train multiple networks for multiple bit rates, which increases the…

Image and Video Processing · Electrical Eng. & Systems 2019-12-13 Mohammad Akbari , Jie Liang , Jingning Han , Chengjie Tu

Histology images are inherently symmetric under rotation, where each orientation is equally as likely to appear. However, this rotational symmetry is not widely utilised as prior knowledge in modern Convolutional Neural Networks (CNNs),…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Simon Graham , David Epstein , Nasir Rajpoot

Deep residual networks have emerged as a family of extremely deep architectures showing compelling accuracy and nice convergence behaviors. In this paper, we analyze the propagation formulations behind the residual building blocks, which…

Computer Vision and Pattern Recognition · Computer Science 2016-07-26 Kaiming He , Xiangyu Zhang , Shaoqing Ren , Jian Sun

Deep neural networks can struggle to learn continually in the face of non-stationarity. This phenomenon is known as loss of plasticity. In this paper, we identify underlying principles that lead to plastic algorithms. In particular, we…

Machine Learning · Computer Science 2024-10-29 Alex Lewandowski , Dale Schuurmans , Marlos C. Machado

We present a method that trains large capacity neural networks with significantly improved accuracy and lower dynamic computational cost. We achieve this by gating the deep-learning architecture on a fine-grained-level. Individual…

Machine Learning · Computer Science 2020-04-06 Babak Ehteshami Bejnordi , Tijmen Blankevoort , Max Welling

Data-driven deep learning approaches to image registration can be less accurate than conventional iterative approaches, especially when training data is limited. To address this whilst retaining the fast inference speed of deep learning, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Xi Jia , Alexander Thorley , Wei Chen , Huaqi Qiu , Linlin Shen , Iain B Styles , Hyung Jin Chang , Ales Leonardis , Antonio de Marvao , Declan P. O'Regan , Daniel Rueckert , Jinming Duan

Dictionary learning algorithms or supervised deep convolution networks have considerably improved the efficiency of predefined feature representations such as SIFT. We introduce a deep scattering convolution network, with predefined wavelet…

Computer Vision and Pattern Recognition · Computer Science 2015-06-02 Edouard Oyallon , Stéphane Mallat

The nonlocal-based blocks are designed for capturing long-range spatial-temporal dependencies in computer vision tasks. Although having shown excellent performances, they lack the mechanism to encode the rich, structured information among…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Lei Zhu , Qi She , Lidan Zhang , Ping Guo

Recent deep learning-based methods have shown promising results and runtime advantages in deformable image registration. However, analyzing the effects of hyperparameters and searching for optimal regularization parameters prove to be too…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Tony C. W. Mok , Albert C. S. Chung

Convolutional neural networks are state-of-the-art for various segmentation tasks. While for 2D images these networks are also computationally efficient, 3D convolutions have huge storage requirements and therefore, end-to-end training is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Christoph Angermann , Markus Haltmeier

Deep neural network algorithms are difficult to analyze because they lack structure allowing to understand the properties of underlying transforms and invariants. Multiscale hierarchical convolutional networks are structured deep…

Machine Learning · Computer Science 2017-03-14 Jörn-Henrik Jacobsen , Edouard Oyallon , Stéphane Mallat , Arnold W. M. Smeulders

Image denoising is a classical problem in low level computer vision. Model-based optimization methods and deep learning approaches have been the two main strategies for solving the problem. Model-based optimization methods are flexible for…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Chang Liu , Zhaowei Shang , Anyong Qin

Convolutional neural networks can automatically learn features via deep network architectures and given input samples. However, the robustness of obtained models may face challenges in varying scenes. Bigger differences in network…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Ziang Wu , Jinwei Xie , Xuanyu Zhang , Tao Wang , Yongjun Zhang , Qi Zhu , Chunwei Tian

Accurate segmentation of retinal vessels is a basic step in Diabetic retinopathy(DR) detection. Most methods based on deep convolutional neural network (DCNN) have small receptive fields, and hence they are unable to capture global context…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Yun Jiang , Ning Tan , Tingting Peng , Hai Zhang

The layers of convolutional neural networks (CNNs) can be used to alter the resolution of their inputs, but the scaling factors are limited to integer values. However, in many image and video processing applications, the ability to resize…

Image and Video Processing · Electrical Eng. & Systems 2021-05-24 Li-Heng Chen , Christos G. Bampis , Zhi Li , Chao Chen , Alan C. Bovik