English
Related papers

Related papers: Regularised unfolding with a discrete-valued penal…

200 papers

Topological loss based on persistent homology has shown promise in various applications. A topological loss enforces the model to achieve certain desired topological property. Despite its empirical success, less is known about the…

Machine Learning · Computer Science 2022-06-14 Yikai Zhang , Jiachen Yao , Yusu Wang , Chao Chen

Regularization methods allow one to handle a variety of inferential problems where there are more covariates than cases. This allows one to consider a potentially enormous number of covariates for a problem. We exploit the power of these…

Methodology · Statistics 2012-10-03 Yoonkyung Lee , Steven N. MacEachern , Yoonsuh Jung

Motivated by the desire to numerically calculate rigorous upper and lower bounds on deviation probabilities over large classes of probability distributions, we present an adaptive algorithm for the reconstruction of increasing real-valued…

Numerical Analysis · Mathematics 2021-08-12 L. Bonnet , J. -L. Akian , É. Savin , T. J. Sullivan

In this note, we make some observations about the equivalences between regularized estimating equations, fixed-point problems and variational inequalities. A summary of our findings is given below: (a) A regularized estimating equation is…

Methodology · Statistics 2021-11-03 Yi Yang , Yuwen Gu , Yue Zhao , Jun Fan

Many works on inverse problems in the imaging sciences consider regularization via one or more penalty functions or constraint sets. When the models/images are not easily described using one or a few penalty functions/constraints, additive…

Image and Video Processing · Electrical Eng. & Systems 2019-03-12 Bas Peters , Felix J. Herrmann

Vector tomography methods intend to reconstruct and visualize vector fields in restricted domains by measuring line integrals of projections of these vector fields. Here, we deal with the reconstruction of irrotational vector functions from…

Quantitative Methods · Quantitative Biology 2017-05-03 Alexandra Koulouri

We consider a statistical inverse learning problem, where the task is to estimate a function $f$ based on noisy point evaluations of $Af$, where $A$ is a linear operator. The function $Af$ is evaluated at i.i.d. random design points $u_n$,…

Machine Learning · Statistics 2021-11-02 Tatiana A. Bubba , Martin Burger , Tapio Helin , Luca Ratti

We present an adaptive regularization algorithm that can be effectively applied to the optimization problem in deep learning framework. Our regularization algorithm aims to take into account the fitness of data to the current state of model…

Machine Learning · Computer Science 2019-09-02 Junghee Cho , Junseok Kwon , Byung-Woo Hong

Rate-independent systems arise in a number of applications. Usually, weak solutions to such problems with potentially very low regularity are considered, requiring mathematical techniques capable of handling nonsmooth functions. In this…

Analysis of PDEs · Mathematics 2017-08-18 Filip Rindler , Sebastian Schwarzacher , Endre Süli

Regularization is a critical technique for ensuring well-posedness in solving inverse problems with incomplete measurement data. Traditionally, the regularization term is designed based on prior knowledge of the unknown signal's…

Numerical Analysis · Mathematics 2024-12-16 Bosu Choi , Jihun Han , Yoonsang Lee

In this paper, a new regularization term is proposed to solve mathematical image problems. By using difference operators in the four directions; horizontal, vertical and two diagonal directions, an estimation of derivative amplitude is…

Numerical Analysis · Mathematics 2022-09-14 Alireza Hosseini

This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Thomas Oberlin , Mathieu Verm

Regularization techniques are necessary to compute meaningful solutions to discrete ill-posed inverse problems. The well-known 2-norm Tikhonov regularization method equipped with a discretization of the gradient operator as regularization…

Numerical Analysis · Mathematics 2024-06-05 Silvia Gazzola , Ali Gholami

We establish a general principle which states that regularizing an inverse problem with a convex function yields solutions which are convex combinations of a small number of atoms. These atoms are identified with the extreme points and…

Optimization and Control · Mathematics 2018-11-27 Claire Boyer , Antonin Chambolle , Yohann De Castro , Vincent Duval , Frédéric De Gournay , Pierre Weiss

Regularization-based approaches for injecting constraints in Machine Learning (ML) were introduced to improve a predictive model via expert knowledge. We tackle the issue of finding the right balance between the loss (the accuracy of the…

Machine Learning · Computer Science 2020-05-22 Michele Lombardi , Federico Baldo , Andrea Borghesi , Michela Milano

These lecture notes evolve around mathematical concepts arising in inverse problems. We start by introducing inverse problems through examples such as differentiation, deconvolution, computed tomography and phase retrieval. This then leads…

Numerical Analysis · Mathematics 2025-08-26 Danielle Bednarski , Tim Roith

This paper considers a large class of linear operator equations, including linear boundary value problems for partial differential equations, and treats them as linear recovery problems for objects from their data. Well-posedness of the…

Numerical Analysis · Mathematics 2014-03-17 Robert Schaback

The purpose of this work is to develop and study a distributed strategy for Pareto optimization of an aggregate cost consisting of regularized risks. Each risk is modeled as the expectation of some loss function with unknown probability…

Optimization and Control · Mathematics 2019-09-23 Stefan Vlaski , Lieven Vandenberghe , Ali H. Sayed

We consider minimization of functions that are compositions of convex or prox-regular functions (possibly extended-valued) with smooth vector functions. A wide variety of important optimization problems fall into this framework. We describe…

Optimization and Control · Mathematics 2015-04-24 A. S. Lewis , S. J. Wright

We consider the problem of supervised learning with convex loss functions and propose a new form of iterative regularization based on the subgradient method. Unlike other regularization approaches, in iterative regularization no constraint…

Machine Learning · Statistics 2015-04-02 Junhong Lin , Lorenzo Rosasco , Ding-Xuan Zhou