English
Related papers

Related papers: Theory and Fast Learned Solver for $\ell^1$-TV Reg…

200 papers

We study the problem of machine unlearning and identify a notion of algorithmic stability, Total Variation (TV) stability, which we argue, is suitable for the goal of exact unlearning. For convex risk minimization problems, we design…

Machine Learning · Computer Science 2021-03-01 Enayat Ullah , Tung Mai , Anup Rao , Ryan Rossi , Raman Arora

The $\ell_{1\text{-}2}$ regularization method has a strong sparsity promoting capability in approaching sparse solutions of linear inverse problems and gained successful applications in various mathematics and applied science fields. This…

Optimization and Control · Mathematics 2026-03-04 Yaohua Hu , Hao Wang , Xiaoqi Yang

We consider the problem of learning a sparse graph under the Laplacian constrained Gaussian graphical models. This problem can be formulated as a penalized maximum likelihood estimation of the Laplacian constrained precision matrix. Like in…

Machine Learning · Computer Science 2023-09-06 Jiaxi Ying , José Vinícius de M. Cardoso , Daniel P. Palomar

We study the problem of recovering piecewise-polynomial periodic functions from their low-frequency information. This means that we only have access to possibly corrupted versions of the Fourier samples of the ground truth up to a maximum…

Optimization and Control · Mathematics 2022-02-11 Thomas Debarre , Quentin Denoyelle , Julien Fageot

Variational methods have become an important kind of methods in signal and image restoration - a typical inverse problem. One important minimization model consists of the squared $\ell_2$ data fidelity (corresponding to Gaussian noise) and…

Numerical Analysis · Mathematics 2018-06-15 Chunlin Wu , Zhifang Liu , Shuang Wen

This paper presents a regularization technique incorporating a non-convex and non-smooth term, $\ell_{1}^{2}-\eta\ell_{2}^{2}$, with parameters $0<\eta\leq 1$ designed to address ill-posed linear problems that yield sparse solutions. We…

Optimization and Control · Mathematics 2025-06-16 Long Li , Liang Ding

This paper presents an efficient algorithm to solve total variation (TV) regularizations of images contaminated by a both blur and noise. The unconstrained structure of the problem suggests that one can solve a constrained optimization…

Numerical Analysis · Computer Science 2018-02-13 A. Bentbib , M. El Guide , K. Jbilou

The objectives of this chapter are: (i) to introduce a concise overview of regularization; (ii) to define and to explain the role of a particular type of regularization called total variation norm (TV-norm) in computer vision tasks; (iii)…

Computer Vision and Pattern Recognition · Computer Science 2016-04-01 Vania V. Estrela , Hermes Aguiar Magalhaes , Osamu Saotome

In this paper, we consider the efficient numerical minimization of Tikhonov functionals resulting from total-variation (TV) regularization of linear inverse problems. Since the TV penalty is non-smooth, this is typically done either via…

Numerical Analysis · Mathematics 2026-05-13 Helmut Gfrerer , Simon Hubmer , Stefan Kindermann , Jaakko Kultima , Ronny Ramlau , Tanja Tarvainen

Image restoration requires a careful balance between noise suppression and structure preservation. While first-order total variation (TV) regularization effectively preserves edges, it often introduces staircase artifacts, whereas…

Numerical Analysis · Mathematics 2025-11-13 Liang Luo , Lei Zhang

This paper presents a sparse Bayesian learning algorithm for inverse problems in signal and image processing with a total variation (TV) sparsity prior. Because of the prior used, and the fact that the prior parameters are estimated…

Signal Processing · Electrical Eng. & Systems 2019-05-06 Victor Churchill , Anne Gelb

A class of mixed-order \emph{PDE}-constraint regularizer for image processing problem is proposed, generalizing the standard first order total variation $(TV)$. A semi-supervised (bilevel) training scheme, which provides a simultaneous…

Analysis of PDEs · Mathematics 2019-03-19 Pan Liu

While medical imaging typically provides massive amounts of data, the extraction of relevant information for predictive diagnosis remains a difficult challenge. Functional MRI (fMRI) data, that provide an indirect measure of task-related or…

Computer Vision and Pattern Recognition · Computer Science 2011-02-22 Vincent Michel , Alexandre Gramfort , Gaël Varoquaux , Evelyn Eger , Bertrand Thirion

Sparsification of neural networks is one of the effective complexity reduction methods to improve efficiency and generalizability. We consider the problem of learning a one hidden layer convolutional neural network with ReLU activation…

Optimization and Control · Mathematics 2020-02-26 Thu Dinh , Jack Xin

Sparse reconstruction approaches using the re-weighted l1-penalty have been shown, both empirically and theoretically, to provide a significant improvement in recovering sparse signals in comparison to the l1-relaxation. However, numerical…

Machine Learning · Statistics 2013-12-06 Dmitry Malioutov , Aleksandr Aravkin

We propose a new fast algorithm for solving one of the standard formulations of image restoration and reconstruction which consists of an unconstrained optimization problem where the objective includes an $\ell_2$ data-fidelity term and a…

Optimization and Control · Mathematics 2015-05-14 Manya V. Afonso , José M. Bioucas-Dias , Mário A. T. Figueiredo

Total Variation (TV) and related extensions have been popular in image restoration due to their robust performance and wide applicability. While the original formulation is still relevant after two decades of extensive research, its…

Image and Video Processing · Electrical Eng. & Systems 2021-06-02 Sanjay Viswanath , Simon de Beco , Maxime Dahan , Muthuvel Arigovindan

Inference and learning for probabilistic generative networks is often very challenging and typically prevents scalability to as large networks as used for deep discriminative approaches. To obtain efficiently trainable, large-scale and well…

Machine Learning · Statistics 2017-02-08 Dennis Forster , Jörg Lücke

The Extreme Learning Machine (ELM) technique is a machine learning approach for constructing feed-forward neural networks with a single hidden layer and their models. The ELM model can be constructed while being trained by concurrently…

Optimization and Control · Mathematics 2024-01-30 Muideen Adegoke , Lateef O. Jolaoso , Mardiyyah Oduwole

Non-Local Total Variation (NLTV) has emerged as a useful tool in variational methods for image recovery problems. In this paper, we extend the NLTV-based regularization to multicomponent images by taking advantage of the Structure Tensor…

Computer Vision and Pattern Recognition · Computer Science 2014-12-11 Giovanni Chierchia , Nelly Pustelnik , Beatrice Pesquet-Popescu , Jean-Christophe Pesquet