English
Related papers

Related papers: Highway and Residual Networks learn Unrolled Itera…

200 papers

Road network and trajectory representation learning are essential for traffic systems since the learned representation can be directly used in various downstream tasks (e.g., traffic speed inference, and travel time estimation). However,…

Machine Learning · Computer Science 2023-02-14 Zhenyu Mao , Ziyue Li , Dedong Li , Lei Bai , Rui Zhao

Recurrent neural network architectures can have useful computational properties, with complex temporal dynamics and input-sensitive attractor states. However, evaluation of recurrent dynamic architectures requires solution of systems of…

Neural and Evolutionary Computing · Computer Science 2019-11-18 Dylan Richard Muir

The trend towards increasingly deep neural networks has been driven by a general observation that increasing depth increases the performance of a network. Recently, however, evidence has been amassing that simply increasing depth may not be…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Zifeng Wu , Chunhua Shen , Anton van den Hengel

Apart from discriminative models for classification and object detection tasks, the application of deep convolutional neural networks to basic research utilizing natural imaging data has been somewhat limited; particularly in cases where a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 R. Ian Etheredge , Manfred Schartl , Alex Jordan

Progress in deep learning has spawned great successes in many engineering applications. As a prime example, convolutional neural networks, a type of feedforward neural networks, are now approaching -- and sometimes even surpassing -- human…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Drew Linsley , Junkyung Kim , Vijay Veerabadran , Thomas Serre

Given a collection of images, humans are able to discover landmarks by modeling the shared geometric structure across instances. This idea of geometric equivariance has been widely used for the unsupervised discovery of object landmark…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Zezhou Cheng , Jong-Chyi Su , Subhransu Maji

Despite the remarkable success of deep learning systems over the last decade, a key difference still remains between neural network and human decision-making: As humans, we cannot only form a decision on the spot, but also ponder,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Gregor Koehler , Tassilo Wald , Constantin Ulrich , David Zimmerer , Paul F. Jaeger , Jörg K. H. Franke , Simon Kohl , Fabian Isensee , Klaus H. Maier-Hein

We propose a simple extension of residual networks that works simultaneously in multiple resolutions. Our network design is inspired by the iterative back-projection algorithm but seeks the more difficult task of learning how to enhance…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Pablo Navarrete Michelini , Hanwen Liu , Yunhua Lu , Xingqun Jiang

The assessment of highly-risky situations at road intersections have been recently revealed as an important research topic within the context of the automotive industry. In this paper we shall introduce a novel approach to compute risk…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Alejandro Chinea Manrique De Lara , Michel Parent

Learned image reconstruction has become a pillar in computational imaging and inverse problems. Among the most successful approaches are learned iterative networks, which are formulated by unrolling classical iterative optimisation…

Image and Video Processing · Electrical Eng. & Systems 2025-12-10 Andreas Hauptmann , Ozan Öktem

Nontrivial connectivity has allowed the training of very deep networks by addressing the problem of vanishing gradients and offering a more efficient method of reusing parameters. In this paper we make a comparison between residual…

Sound · Computer Science 2017-11-29 Marius Paraschiv , Lasse Borgholt , Tycho Max Sylvester Tax , Marco Singh , Lars Maaløe

Continual learning could shift the machine learning paradigm from data centric to model centric. A continual learning model needs to scale efficiently to handle semantically different datasets, while avoiding unnecessary growth. We…

Machine Learning · Computer Science 2020-10-13 Ahmad Berjaoui

We present a novel two-view geometry estimation framework which is based on a differentiable robust loss function fitting. We propose to treat the robust fundamental matrix estimation as an implicit layer, which allows us to avoid…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Vladislav Pyatov , Iaroslav Koshelev , Stamatis Lefkimmiatis

Models for image representation learning are typically designed for either recognition or generation. Various forms of contrastive learning help models learn to convert images to embeddings that are useful for classification, detection, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Matthew Gwilliam , Xiao Wang , Xuefeng Hu , Zhenheng Yang

Recursive Neural Networks are non-linear adaptive models that are able to learn deep structured information. However, these models have not yet been broadly accepted. This fact is mainly due to its inherent complexity. In particular, not…

Neural and Evolutionary Computing · Computer Science 2009-11-18 Alejandro Chinea

Deep learning based methods hold state-of-the-art results in image denoising, but remain difficult to interpret due to their construction from poorly understood building blocks such as batch-normalization, residual learning, and feature…

Image and Video Processing · Electrical Eng. & Systems 2021-03-09 Nikola Janjušević , Amirhossein Khalilian-Gourtani , Yao Wang

Residual neural networks (ResNets) are a promising class of deep neural networks that have shown excellent performance for a number of learning tasks, e.g., image classification and recognition. Mathematically, ResNet architectures can be…

Optimization and Control · Mathematics 2019-07-26 S. Günther , L. Ruthotto , J. B. Schroder , E. C. Cyr , N. R. Gauger

Currently, low-resolution image recognition is confronted with a significant challenge in the field of intelligent traffic perception. Compared to high-resolution images, low-resolution images suffer from small size, low quality, and lack…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Zongcai Tan , Zhenhai Gao

Convolutional networks for image classification progressively reduce resolution until the image is represented by tiny feature maps in which the spatial structure of the scene is no longer discernible. Such loss of spatial acuity can limit…

Computer Vision and Pattern Recognition · Computer Science 2017-05-30 Fisher Yu , Vladlen Koltun , Thomas Funkhouser

In this effort, we propose a new deep architecture utilizing residual blocks inspired by implicit discretization schemes. As opposed to the standard feed-forward networks, the outputs of the proposed implicit residual blocks are defined as…

Machine Learning · Computer Science 2021-02-23 Viktor Reshniak , Clayton Webster