English
Related papers

Related papers: Regularization Graphs -- A unified framework for v…

200 papers

During the past years there has been an explosion of interest in learning methods based on sparsity regularization. In this paper, we discuss a general class of such methods, in which the regularizer can be expressed as the composition of a…

Machine Learning · Computer Science 2013-03-26 Andreas Argyriou , Luca Baldassarre , Charles A. Micchelli , Massimiliano Pontil

Learning a smooth graph signal from partially observed data is a well-studied task in graph-based machine learning. We consider this task from the perspective of optimal recovery, a mathematical framework for learning a function from…

Machine Learning · Computer Science 2023-05-31 Simon Foucart , Chunyang Liao , Nate Veldt

Regularization plays a pivotal role when facing the challenge of solving ill-posed inverse problems, where the number of observations is smaller than the ambient dimension of the object to be estimated. A line of recent work has studied…

Optimization and Control · Mathematics 2014-07-03 Samuel Vaiter , Mohammad Golbabaee , Jalal M. Fadili , Gabriel Peyré

We propose a regularization scheme for image reconstruction that leverages the power of deep learning while hinging on classic sparsity-promoting models. Many deep-learning-based models are hard to interpret and cumbersome to analyze…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Mehrsa Pourya , Sebastian Neumayer , Michael Unser

We propose a novel framework for learning stabilizable nonlinear dynamical systems for continuous control tasks in robotics. The key contribution is a control-theoretic regularizer for dynamics fitting rooted in the notion of…

Optimization and Control · Mathematics 2019-08-01 Sumeet Singh , Spencer M. Richards , Vikas Sindhwani , Jean-Jacques E. Slotine , Marco Pavone

We tackle the problem of building adaptive estimation procedures for ill-posed inverse problems. For general regularization methods depending on tuning parameters, we construct a penalized method that selects the optimal smoothing sequence…

Statistics Theory · Mathematics 2008-07-31 Jean-Michel Loubes , Carenne Ludeña

We deal with the shape reconstruction of inclusions in elastic bodies. For solving this inverse problem in practice, data fitting functionals are used. Those work better than the rigorous monotonicity methods from [5], but have no…

Numerical Analysis · Mathematics 2022-12-13 Sarah Eberle , Bastian Harrach

Inverse problems are characterized by their inherent non-uniqueness and sensitivity with respect to data perturbations. Their stable solution requires the application of regularization methods including variational and iterative…

Numerical Analysis · Mathematics 2023-10-17 Aviv Gibali , Markus Haltmeier

Inverse problems are inherently ill-posed and therefore require regularization techniques to achieve a stable solution. While traditional variational methods have well-established theoretical foundations, recent advances in machine learning…

Numerical Analysis · Mathematics 2023-09-15 Simon Göppel , Jürgen Frikel , Markus Haltmeier

In this paper, we consider optimal low-rank regularized inverse matrix approximations and their applications to inverse problems. We give an explicit solution to a generalized rank-constrained regularized inverse approximation problem,…

Numerical Analysis · Mathematics 2016-03-21 Julianne Chung , Matthias Chung

A central theme in classical algorithms for the reconstruction of discontinuous functions from observational data is perimeter regularization via the use of the total variation. On the other hand, sparse or noisy data often demands a…

Optimization and Control · Mathematics 2020-04-13 Oliver R. A. Dunbar , Matthew M. Dunlop , Charles M. Elliott , Viet Ha Hoang , Andrew M. Stuart

One fundamental problem when solving inverse problems is how to find regularization parameters. This article considers solving this problem using data-driven bilevel optimization, i.e. we consider the adaptive learning of the regularization…

Statistics Theory · Mathematics 2021-01-08 Neil K. Chada , Claudia Schillings , Xin T. Tong , Simon Weissmann

Regularization plays a pivotal role in integrating prior information into inverse problems. While many deep learning methods have been proposed to solve inverse problems, determining where to apply regularization remains a crucial…

Numerical Analysis · Mathematics 2024-03-22 Ke Chen , Chunmei Wang , Haizhao Yang

The standard approach for dealing with the ill-posedness of the training problem in machine learning and/or the reconstruction of a signal from a limited number of measurements is regularization. The method is applicable whenever the…

Optimization and Control · Mathematics 2020-07-13 Michael Unser

Multiple kernel learning (MKL), structured sparsity, and multi-task learning have recently received considerable attention. In this paper, we show how different MKL algorithms can be understood as applications of either regularization on…

Machine Learning · Statistics 2011-03-03 Ryota Tomioka , Taiji Suzuki

We use convex relaxation techniques to provide a sequence of solutions to the matrix completion problem. Using the nuclear norm as a regularizer, we provide simple and very efficient algorithms for minimizing the reconstruction error…

Machine Learning · Statistics 2009-06-12 Rahul Mazumder , Trevor Hastie , Rob Tibshirani

We propose to learn non-convex regularizers with a prescribed upper bound on their weak-convexity modulus. Such regularizers give rise to variational denoisers that minimize a convex energy. They rely on few parameters (less than 15,000)…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Alexis Goujon , Sebastian Neumayer , Michael Unser

A wide range of graph learning tasks, such as structure discovery, temporal graph analysis, and combinatorial optimization, focus on inferring graph structures from data, rather than making predictions on given graphs. However, the…

We investigate a level-set type method for solving ill-posed problems, with the assumption that the solutions are piecewise, but not necessarily constant functions with unknown level sets and unknown level values. In order to get stable…

Numerical Analysis · Mathematics 2012-10-30 Adriano De Cezaro

In this work, we study the well-posedness of certain sparse regularized linear regression problems, i.e., the existence, uniqueness and continuity of the solution map with respect to the data. We focus on regularization functions that are…

Statistics Theory · Mathematics 2024-09-06 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen