English
Related papers

Related papers: Bilevel Optimization, Deep Learning and Fractional…

200 papers

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

Joint network topology inference represents a canonical problem of jointly learning multiple graph Laplacian matrices from heterogeneous graph signals. In such a problem, a widely employed assumption is that of a simple common component…

Statistics Theory · Mathematics 2021-07-09 Yanli Yuan , De Wen Soh , Xiao Yang , Kun Guo , Tony Q. S. Quek

Regularizing the gradient norm of the output of a neural network with respect to its inputs is a powerful technique, rediscovered several times. This paper presents evidence that gradient regularization can consistently improve…

Machine Learning · Computer Science 2018-05-28 Dániel Varga , Adrián Csiszárik , Zsolt Zombori

Deep learning and (deep) neural networks are emerging tools to address inverse problems and image reconstruction tasks. Despite outstanding performance, the mathematical analysis for solving inverse problems by neural networks is mostly…

Numerical Analysis · Mathematics 2019-10-01 Johannes Schwab , Stephan Antholzer , Markus Haltmeier

We propose to learn non-convex regularizers with a prescribed upper bound on their weak-convexity modulus. Such regularizers give rise to variational denoisers that minimize a convex energy. They rely on few parameters (less than 15,000)…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Alexis Goujon , Sebastian Neumayer , Michael Unser

Deep learning-based methods have recently demonstrated promising results in deformable image registration for a wide range of medical image analysis tasks. However, existing deep learning-based methods are usually limited to small…

Image and Video Processing · Electrical Eng. & Systems 2020-07-01 Tony C. W. Mok , Albert C. S. Chung

Many challenging image processing tasks can be described by an ill-posed linear inverse problem: deblurring, deconvolution, inpainting, compressed sensing, and superresolution all lie in this framework. Traditional inverse problem solvers…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Davis Gilton , Greg Ongie , Rebecca Willett

In recent literature there are plenty of works that combine handcrafted and learnable regularizers to solve inverse imaging problems. While this hybrid approach has demonstrated promising results, the motivation for combining handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Alexandros Gkillas , Dimitris Ampeliotis , Kostas Berberidis

Inverse Problems in medical imaging and computer vision are traditionally solved using purely model-based methods. Among those variational regularization models are one of the most popular approaches. We propose a new framework for applying…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Sebastian Lunz , Ozan Öktem , Carola-Bibiane Schönlieb

Underpinning the success of deep learning is effective regularizations that allow a variety of priors in data to be modeled. For example, robustness to adversarial perturbations, and correlations between multiple modalities. However, most…

Machine Learning · Computer Science 2020-06-16 Mao Li , Yingyi Ma , Xinhua Zhang

Low-dose computed tomography (LDCT) reconstruction faces a critical tradeoff between reconstruction quality and resource requirements. While recent deep learning methods achieve state-of-the-art performance, they typically rely on over…

Image and Video Processing · Electrical Eng. & Systems 2026-05-26 Veera Varuni Radhakrishnan , Chinthaka Dinesh , Qurat-ul-Ain Azim

A supervised learning approach is proposed for regularization of large inverse problems where the main operator is built from noisy data. This is germane to superresolution imaging via the sampling indicators of the inverse scattering…

Numerical Analysis · Mathematics 2025-08-22 Fatemeh Pourahmadian , Yang Xu

In the graph signal processing (GSP) literature, it has been shown that signal-dependent graph Laplacian regularizer (GLR) can efficiently promote piecewise constant (PWC) signal reconstruction for various image restoration tasks. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-06-21 Fei Chen , Gene Cheung , Xue Zhang

Proper regularization is crucial in inverse problems to achieve high-quality reconstruction, even with an ill-conditioned measurement system. This is particularly true for three-dimensional photoacoustic tomography, which is computationally…

Optimization and Control · Mathematics 2024-09-26 Chao Wang , Alexandre H. Thiery

Although much research has been devoted to the problem of restoring Poissonian images, namely in the fields of medical and astronomical imaging, applying the state of the art regularizers (such as those based on wavelets or total variation)…

Optimization and Control · Mathematics 2009-05-01 Mario A. T. Figueiredo , Jose M. Bioucas-Dias

In this work, we propose a framework to learn a local regularization model for solving general image restoration problems. This regularizer is defined with a fully convolutional neural network that sees the image through a receptive field…

Image and Video Processing · Electrical Eng. & Systems 2021-02-12 Jean Prost , Antoine Houdard , Andrés Almansa , Nicolas Papadakis

Overfitting is one of the most critical challenges in deep neural networks, and there are various types of regularization methods to improve generalization performance. Injecting noises to hidden units during training, e.g., dropout, is…

Machine Learning · Computer Science 2017-11-10 Hyeonwoo Noh , Tackgeun You , Jonghwan Mun , Bohyung Han

Pre-trained representation is one of the key elements in the success of modern deep learning. However, existing works on continual learning methods have mostly focused on learning models incrementally from scratch. In this paper, we explore…

Machine Learning · Computer Science 2022-08-18 Hyounguk Shon , Janghyeon Lee , Seung Hwan Kim , Junmo Kim

Low rank approximation is a commonly occurring problem in many computer vision and machine learning applications. There are two common ways of optimizing the resulting models. Either the set of matrices with a given rank can be explicitly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Marcus Valtonen Örnhag , Carl Olsson , Anders Heyden

Recently, deep learning based methods appeared as a new paradigm for solving inverse problems. These methods empirically show excellent performance but lack of theoretical justification; in particular, no results on the regularization…

Numerical Analysis · Mathematics 2019-01-30 Johannes Schwab , Stephan Antholzer , Markus Haltmeier
‹ Prev 1 4 5 6 7 8 10 Next ›