English
Related papers

Related papers: Extra Proximal-Gradient Inspired Non-local Network

200 papers

Training a very deep neural network is a challenging task, as the deeper a neural network is, the more non-linear it is. We compare the performances of various preconditioned Langevin algorithms with their non-Langevin counterparts for the…

Machine Learning · Computer Science 2023-01-02 Pierre Bras

When optimizing a nonlinear objective, one can employ a neural network as a surrogate for the nonlinear function. However, the resulting optimization model can be time-consuming to solve globally with exact methods. As a result, local…

Optimization and Control · Mathematics 2026-03-19 Jiatai Tong , Yilin Zhu , Thiago Serra , Samuel Burer

It is well-known that in inverse problems, end-to-end trained networks overfit the degradation model seen in the training set, i.e., they do not generalize to other types of degradations well. Recently, an approach to first map images…

Image and Video Processing · Electrical Eng. & Systems 2021-06-02 Cansu Korkmaz , A. Murat Tekalp , Zafer Dogan

Artificial Neural Networks are computational network models inspired by signal processing in the brain. These models have dramatically improved the performance of many learning tasks, including speech and object recognition. However,…

The inverse problem of supervised reconstruction of depth-variable (time-dependent) parameters in a neural ordinary differential equation (NODE) is considered, that means finding the weights of a residual network with time continuous…

Machine Learning · Computer Science 2022-02-14 George Baravdish , Gabriel Eilertsen , Rym Jaroudi , B. Tomas Johansson , Lukáš Malý , Jonas Unger

In this paper, we address the problem of dynamic scene deblurring in the presence of motion blur. Restoration of images affected by severe blur necessitates a network design with a large receptive field, which existing networks attempt to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Kuldeep Purohit , A. N. Rajagopalan

Continuous-depth neural networks, such as Neural ODEs, have refashioned the understanding of residual neural networks in terms of non-linear vector-valued optimal control problems. The common solution is to use the adjoint sensitivity…

Machine Learning · Computer Science 2022-02-16 Andrew Corbett , Dmitry Kangin

We propose a deep network that can be trained to tackle image reconstruction and classification problems that involve detection of multiple object instances, without any supervision regarding their whereabouts. The network learns to extract…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Baptiste Angles , Yuhe Jin , Simon Kornblith , Andrea Tagliasacchi , Kwang Moo Yi

Learning fine-grained image similarity is a challenging task. It needs to capture between-class and within-class image differences. This paper proposes a deep ranking model that employs deep learning techniques to learn similarity metric…

Computer Vision and Pattern Recognition · Computer Science 2014-04-21 Jiang Wang , Yang song , Thomas Leung , Chuck Rosenberg , Jinbin Wang , James Philbin , Bo Chen , Ying Wu

How to develop slim and accurate deep neural networks has become crucial for real- world applications, especially for those employed in embedded systems. Though previous work along this research line has shown some promising results, most…

Neural and Evolutionary Computing · Computer Science 2019-10-02 Xin Dong , Shangyu Chen , Sinno Jialin Pan

In this paper, we aim at providing an introduction to the gradient descent based optimization algorithms for learning deep neural network models. Deep learning models involving multiple nonlinear projection layers are very challenging to…

Machine Learning · Computer Science 2019-03-12 Jiawei Zhang

Deep neural networks have become a foundational tool for addressing imaging inverse problems. They are typically trained for a specific task, with a supervised loss to learn a mapping from the observations to the image to recover. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Matthieu Terris , Thomas Moreau

The last decade has shown a tremendous success in solving various computer vision problems with the help of deep learning techniques. Lately, many works have demonstrated that learning-based approaches with suitable network architectures…

Machine Learning · Computer Science 2019-08-21 Michael Moeller , Thomas Möllenhoff , Daniel Cremers

Custom and natural lighting conditions can be emulated in images of the scene during post-editing. Extraordinary capabilities of the deep learning framework can be utilized for such purpose. Deep image relighting allows automatic photo…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Sourya Dipta Das , Nisarg A. Shah , Saikat Dutta , Himanshu Kumar

We propose a learnable variational model that learns the features and leverages complementary information from both image and measurement domains for image reconstruction. In particular, we introduce a learned alternating minimization…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Chi Ding , Qingchao Zhang , Ge Wang , Xiaojing Ye , Yunmei Chen

Owing to flexible architectures of deep convolutional neural networks (CNNs), CNNs are successfully used for image denoising. However, they suffer from the following drawbacks: (i) deep network architecture is very difficult to train. (ii)…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chunwei Tian , Yong Xu , Lunke Fei , Junqian Wang , Jie Wen , Nan Luo

Despite the remarkable success of deep learning in pattern recognition, deep network models face the problem of training a large number of parameters. In this paper, we propose and evaluate a novel multi-path wavelet neural network…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 D. D. N. De Silva , H. W. M. K. Vithanage , K. S. D. Fernando , I. T. S. Piyatilake

In this paper we use deep feedforward artificial neural networks to approximate solutions to partial differential equations in complex geometries. We show how to modify the backpropagation algorithm to compute the partial derivatives of the…

Machine Learning · Statistics 2018-08-28 Jens Berg , Kaj Nyström

In this paper, we aim to develop an efficient and compact deep network for RGB-D salient object detection, where the depth image provides complementary information to boost performance in complex scenarios. Starting from a coarse initial…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Shuhan Chen , Yun Fu

Deep learning methods have been successfully applied to various computer vision tasks. However, existing neural network architectures do not per se incorporate domain knowledge about the addressed problem, thus, understanding what the model…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Iman Marivani , Evaggelia Tsiligianni , Bruno Cornelis , Nikos Deligiannis