English
Related papers

Related papers: Regularization Theory of the Analytic Deep Prior A…

200 papers

Deep Neural Networks (DNNs) are well-known to act as over-parameterized deep image priors (DIP) that regularize various image inverse problems. Meanwhile, researchers also proposed extremely compact, under-parameterized image priors (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Qiming Wu , Xiaohan Chen , Yifan Jiang , Zhangyang Wang

Flow based models such as Real NVP are an extremely powerful approach to density estimation. However, existing flow based models are restricted to transforming continuous densities over a continuous input space into similarly continuous…

Machine Learning · Computer Science 2020-08-27 Laurent Dinh , Jascha Sohl-Dickstein , Hugo Larochelle , Razvan Pascanu

Stable Diffusion (SD) often produces degraded outputs when the training dataset contains adversarial noise. Adversarial purification offers a promising solution by removing adversarial noise from contaminated data. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Li Zheng , Liangbin Xie , Jiantao Zhou , He YiMin

We consider the image denoising problem using total variation (TV) regularization. This problem can be computationally challenging to solve due to the non-differentiability and non-linearity of the regularization term. We propose an…

Optimization and Control · Mathematics 2014-08-26 Zhiwei Qin , Donald Goldfarb , Shiqian Ma

Dropout is an effective strategy for the regularization of deep neural networks. Applying tabu to the units that have been dropped in the recent epoch and retaining them for training ensures diversification in dropout. In this paper, we…

Building on the well-known total-variation (TV), this paper develops a general regularization technique based on nonlinear isotropic diffusion (NID) for inverse problems with piecewise smooth solutions. The novelty of our approach is to be…

Numerical Analysis · Mathematics 2021-08-25 Bernadette N. Hahn , Gael Rigaud , Richard Schmähl

Mixup is a recent regularizer for current deep classification networks. Through training a neural network on convex combinations of pairs of examples and their labels, it imposes locally linear constraints on the model's input space.…

Computation and Language · Computer Science 2021-09-16 Guang Liu , Yuzhao Mao , Hailong Huang , Weiguo Gao , Xuan Li

Unsupervised deep image prior (DIP) addresses shortcomings of training data requirements and limited generalization associated with supervised deep learning. The performance of DIP depends on the network architecture and the stopping point…

This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Thomas Oberlin , Mathieu Verm

Regularization approaches have demonstrated their effectiveness for solving ill-posed problems. However, in the context of variational restoration methods, a challenging question remains, which is how to find a good regularizer. While total…

Optimization and Control · Mathematics 2011-10-25 Nelly Pustelnik , Caroline Chaux , Jean-Christophe Pesquet

We propose and analyze an accelerated iterative dual diagonal descent algorithm for the solution of linear inverse problems with general regularization and data-fit functions. In particular, we develop an inertial approach of which we…

Optimization and Control · Mathematics 2023-12-25 Luca Calatroni , Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

As data-driven technologies advance swiftly, maintaining strong privacy measures becomes progressively difficult. Conventional $(\epsilon, \delta)$-differential privacy, while prevalent, exhibits limited adaptability for many applications.…

Cryptography and Security · Computer Science 2025-07-03 Yifeng Liu , Zehua Wang

This paper introduces a new strategy for setting the regularization parameter when solving large-scale discrete ill-posed linear problems by means of the Arnoldi-Tikhonov method. This new rule is essentially based on the discrepancy…

Numerical Analysis · Mathematics 2013-07-02 Silvia Gazzola , Paolo Novati , Maria Rosaria Russo

Dual gradient descent combined with early stopping represents an efficient alternative to the Tikhonov variational approach when the regularizer is strongly convex. However, for many relevant applications, it is crucial to deal with…

Optimization and Control · Mathematics 2023-05-12 Vassilis Apidopoulos , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

Regularization is one of the crucial ingredients of deep learning, yet the term regularization has various definitions, and regularization methods are often studied separately from each other. In our work we present a systematic, unifying…

Machine Learning · Computer Science 2017-10-31 Jan Kukačka , Vladimir Golkov , Daniel Cremers

REgularization by Denoising (RED) is an attractive framework for solving inverse problems by incorporating state-of-the-art denoising algorithms as the priors. A drawback of this approach is the high computational complexity of denoisers,…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Tao Hong , Irad Yavneh , Michael Zibulevsky

While deep neural networks have proven to be a powerful tool for many recognition and classification tasks, their stability properties are still not well understood. In the past, image classifiers have been shown to be vulnerable to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Rima Alaifari , Giovanni S. Alberti , Tandri Gauksson

Deep neural networks are the default choice of learning models for computer vision tasks. Extensive work has been carried out in recent years on explaining deep models for vision tasks such as classification. However, recent work has shown…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Anindya Sarkar , Anirban Sarkar , Vineeth N Balasubramanian

We introduce `atomic flows': they are graphs obtained from derivations by tracing atom occurrences and forgetting the logical structure. We study simple manipulations of atomic flows that correspond to complex reductions on derivations.…

Logic · Mathematics 2015-07-01 Alessio Guglielmi , Tom Gundersen

We consider the two problems of predicting links in a dynamic graph sequence and predicting functions defined at each node of the graph. In many applications, the solution of one problem is useful for solving the other. Indeed, if these…

Machine Learning · Computer Science 2012-03-27 Emile Richard , Andreas Argyriou , Theodoros Evgeniou , Nicolas Vayatis