English
Related papers

Related papers: Parameter Selection for HOTV Regularization

200 papers

We use convex relaxation techniques to provide a sequence of solutions to the matrix completion problem. Using the nuclear norm as a regularizer, we provide simple and very efficient algorithms for minimizing the reconstruction error…

Machine Learning · Statistics 2009-06-12 Rahul Mazumder , Trevor Hastie , Rob Tibshirani

Recently, sparsity-based algorithms are proposed for super-resolution spectrum estimation. However, to achieve adequately high resolution in real-world signal analysis, the dictionary atoms have to be close to each other in frequency,…

Machine Learning · Statistics 2015-06-05 Yiyuan She , Huanghuang Li , Jiangping Wang , Dapeng Wu

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

Tensor decomposition methods allow us to learn the parameters of latent variable models through decomposition of low-order moments of data. A significant limitation of these algorithms is that there exists no general method to regularize…

Machine Learning · Statistics 2019-05-28 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez

We introduce a novel regulariser based on the natural vector field operations gradient, divergence, curl and shear. For suitable choices of the weighting parameters contained in our model it generalises well-known first- and second-order…

Numerical Analysis · Mathematics 2018-11-01 Eva-Maria Brinkmann , Martin Burger , Joana Sarah Grah

Flash X-ray computed tomography (CT) is an important imaging modality for characterization of high-speed dynamic events, such as Kolsky bar impact experiments for the study of mechanical properties of materials subjected to impulsive…

Image and Video Processing · Electrical Eng. & Systems 2024-06-27 Maliha Hossain , Charles A. Bouman , Brendt Wohlberg

Flexible sparsity regularization means stably approximating sparse solutions of operator equations by using coefficient-dependent penalizations. We propose and analyse a general nonconvex approach in this respect, from both theoretical and…

Optimization and Control · Mathematics 2021-11-12 Daria Ghilli , Dirk A. Lorenz , Elena Resmerita

We consider a minimization problem whose objective function is the sum of a fidelity term, not necessarily convex, and a regularization term defined by a positive regularization parameter $\lambda$ multiple of the $\ell_0$ norm composed…

Optimization and Control · Mathematics 2021-11-17 Yuesheng Xu

We propose an algorithm for exploring the entire regularization path of asymmetric-cost linear support vector machines. Empirical evidence suggests the predictive power of support vector machines depends on the regularization parameters of…

Machine Learning · Computer Science 2016-10-13 Daniel Wesierski

In this paper, we develop a regularized higher-order Taylor based method for solving composite (e.g., nonlinear least-squares) problems. At each iteration, we replace each smooth component of the objective function by a higher-order Taylor…

Optimization and Control · Mathematics 2025-03-05 Yassine Nabou , Ion Necoara

During the inversion of discrete linear systems noise in data can be amplified and result in meaningless solutions. To combat this effect, characteristics of solutions that are considered desirable are mathematically implemented during…

Numerical Analysis · Mathematics 2023-02-07 Michael J. Byrne , Rosemary A. Renaut

The $\ell^1$ and total variation (TV) penalties have been used successfully in many areas, and the combination of the $\ell^1$ and TV penalties can lead to further improved performance. In this work, we investigate the mathematical theory…

Numerical Analysis · Mathematics 2024-12-05 Xinling Liu , Jianjun Wang , Bangti Jin

LSTD is a popular algorithm for value function approximation. Whenever the number of features is larger than the number of samples, it must be paired with some form of regularization. In particular, L1-regularization methods tend to perform…

Machine Learning · Computer Science 2012-07-03 Matthieu Geist , Bruno Scherrer , Alessandro Lazaric , Mohammad Ghavamzadeh

Total variation (TV) is a widely used function for regularizing imaging inverse problems that is particularly appropriate for images whose underlying structure is piecewise constant. TV regularized optimization problems are typically solved…

Image and Video Processing · Electrical Eng. & Systems 2025-08-26 Edward P. Chandler , Shirin Shoushtari , Brendt Wohlberg , Ulugbek S. Kamilov

We study the inverse problem of parameter identification in non-coercive variational problems that commonly appear in applied models. We examine the differentiability of the set-valued parameter-to-solution map by using the first-order and…

Optimization and Control · Mathematics 2018-08-08 Christian Clason , Akhtar A. Khan , Miguel Sama , Christiane Tammer

Image restoration requires a careful balance between noise suppression and structure preservation. While first-order total variation (TV) regularization effectively preserves edges, it often introduces staircase artifacts, whereas…

Numerical Analysis · Mathematics 2025-11-13 Liang Luo , Lei Zhang

We apply the recently proposed superiorization methodology (SM) to the inverse planning problem in radiation therapy. The inverse planning problem is represented here as a constrained minimization problem of the total variation (TV) of the…

Optimization and Control · Mathematics 2014-02-07 R. Davidi , Y. Censor , R. W. Schulte , S. Geneser , L. Xing

Ill-posed inverse problems are common in astronomy, and their solutions are unstable with respect to noise in the data. Solutions of such problems are typically found using two classes of methods: parametrization and fitting the data…

Instrumentation and Methods for Astrophysics · Physics 2021-12-17 Damir Gasymov , Ivan Katkov

For many algorithms, parameter tuning remains a challenging and critical task, which becomes tedious and infeasible in a multi-parameter setting. Multi-penalty regularization, successfully used for solving undetermined sparse regression of…

Machine Learning · Statistics 2017-10-12 Markus Grasmair , Timo Klock , Valeriya Naumova

We propose a framework to perform streaming covariance selection. Our approach employs regularization constraints where a time-varying sparsity parameter is iteratively estimated via stochastic gradient descent. This allows for the…

Machine Learning · Statistics 2016-11-03 Ricardo Pio Monti , Romy Lorenz , Robert Leech , Christoforos Anagnostopoulos , Giovanni Montana