English
Related papers

Related papers: The Geometry and Well-Posedness of Sparse Regulari…

200 papers

When solving rank-deficient or discrete ill-posed problems by regularization methods, the choice of the regularization parameter is crucial. It is also of interest, the regularization norm used in the selection of the solution. In this…

Numerical Analysis · Mathematics 2024-10-30 Ibrahima Dione

There is growing body of learning problems for which it is natural to organize the parameters into matrix, so as to appropriately regularize the parameters under some matrix norm (in order to impose some more sophisticated prior knowledge).…

Machine Learning · Computer Science 2010-10-19 Sham M. Kakade , Shai Shalev-Shwartz , Ambuj Tewari

We propose a general convex optimization problem for computing regularized geodesic distances. We show that under mild conditions on the regularizer the problem is well posed. We propose three different regularizers and provide analytical…

Graphics · Computer Science 2023-05-23 Michal Edelstein , Nestor Guillen , Justin Solomon , Mirela Ben-Chen

In this paper we present a general convex optimization approach for solving high-dimensional multiple response tensor regression problems under low-dimensional structural assumptions. We consider using convex and weakly decomposable…

Statistics Theory · Mathematics 2017-04-17 Garvesh Raskutti , Ming Yuan , Han Chen

Linear optimization problems are investigated whose parameters are uncertain. We apply coherent distortion risk measures to capture the possible violation of a restriction. Each risk constraint induces an uncertainty set of coefficients,…

Methodology · Statistics 2017-12-18 Karl Mosler , Pavel Bazovkin

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

Compressed sensing seeks to invert an underdetermined linear system by exploiting additional knowledge of the true solution. Over the last decade, several instances of compressed sensing have been studied for various applications, and for…

Information Theory · Computer Science 2014-08-20 Jameson Cahill , Dustin G. Mixon

In this paper, we focus on the exploration of solution uniqueness, sharpness, and robust recovery in sparse regularization with a gauge $J$. Based on the criteria for the uniqueness of Lagrange multipliers in the dual problem, we give a…

Optimization and Control · Mathematics 2024-05-10 Jiahuan He , Chao Kan , Wen Song

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

Optimization and Control · Mathematics 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran

Regularization is a critical technique for ensuring well-posedness in solving inverse problems with incomplete measurement data. Traditionally, the regularization term is designed based on prior knowledge of the unknown signal's…

Numerical Analysis · Mathematics 2024-12-16 Bosu Choi , Jihun Han , Yoonsang Lee

This paper studies the formulation, well-posedness, and numerical solution of Bayesian inverse problems on metric graphs, in which the edges represent one-dimensional wires connecting vertices. We focus on the inverse problem of recovering…

Analysis of PDEs · Mathematics 2026-03-30 David Bolin , Wenwen Li , Daniel Sanz-Alonso

Graphs are naturally sparse objects that are used to study many problems involving networks, for example, distributed learning and graph signal processing. In some cases, the graph is not given, but must be learned from the problem and…

Machine Learning · Statistics 2017-08-31 Martin Sundin , Arun Venkitaraman , Magnus Jansson , Saikat Chatterjee

There is a basic paradigm, called here the radius of well-posedness, which quantifies the "distance" from a given well-posed problem to the set of ill-posed problems of the same kind. In variational analysis, well-posedness is often…

Optimization and Control · Mathematics 2022-06-17 Asen L. Dontchev , Helmut Gfrerer , Alexander Y. Kruger , Jiří V. Outrata

This thesis is devoted to the study of well-posedness properties of some geometric variational problems: existence, regularity and uniqueness of solutions. We study two specific problems arising in the context of geometric calculus of…

Differential Geometry · Mathematics 2022-12-23 Gianmarco Caldini

We consider the problem of supervised learning with convex loss functions and propose a new form of iterative regularization based on the subgradient method. Unlike other regularization approaches, in iterative regularization no constraint…

Machine Learning · Statistics 2015-04-02 Junhong Lin , Lorenzo Rosasco , Ding-Xuan Zhou

Global radial basis function (RBF) collocation methods with inifinitely smooth basis functions for partial differential equations (PDEs) work in general geometries, and can have exponential convergence properties for smooth solution…

Numerical Analysis · Mathematics 2020-01-31 Elisabeth Larsson , Ulrika Sundin

Geometric quantiles are popular location functionals to build rank-based statistical procedures in multivariate settings. They are obtained through the minimization of a non-smooth convex objective function. As a result, the singularity of…

Statistics Theory · Mathematics 2026-02-11 Dimitri Konen , Gilles Stupfler

Finding an unconstrained and statistically interpretable reparameterization of a covariance matrix is still an open problem in statistics. Its solution is of central importance in covariance estimation, particularly in the recent…

Methodology · Statistics 2012-02-09 Mohsen Pourahmadi

The convolutional sparse model has recently gained increasing attention in the signal and image processing communities, and several methods have been proposed for solving the pursuit problem emerging from it -- in particular its convex…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

Generalized linear regressions, such as logistic regressions or Poisson regressions, are long-studied regression analysis approaches, and their applications are widely employed in various classification problems. Our study considers a…

Machine Learning · Statistics 2024-01-17 Vu Duc Anh , Tran Anh Tuan , Tran Ngoc Thang , Nguyen Thi Ngoc Anh