English
Related papers

Related papers: The Convex Geometry of Linear Inverse Problems

200 papers

We consider the variational reconstruction framework for inverse problems and propose to learn a data-adaptive input-convex neural network (ICNN) as the regularization functional. The ICNN-based convex regularizer is trained adversarially…

This letter proposes to estimate low-rank matrices by formulating a convex optimization problem with non-convex regularization. We employ parameterized non-convex penalty functions to estimate the non-zero singular values more accurately…

Computer Vision and Pattern Recognition · Computer Science 2016-04-14 Ankit Parekh , Ivan W. Selesnick

Line spectral estimation is the problem of recovering the frequencies and amplitudes of a mixture of a few sinusoids from equispaced samples. However, in a variety of signal processing problems arising in imaging, radar, and localization we…

Information Theory · Computer Science 2016-09-28 Reinhard Heckel , Mahdi Soltanolkotabi

Concave regularization methods provide natural procedures for sparse recovery. However, they are difficult to analyze in the high dimensional setting. Only recently a few sparse recovery results have been established for some specific local…

Machine Learning · Statistics 2012-02-14 Cun-Hui Zhang , Tong Zhang

In this paper we investigate panel regression models with interactive fixed effects. We propose two new estimation methods that are based on minimizing convex objective functions. The first method minimizes the sum of squared residuals with…

Econometrics · Economics 2026-02-10 Hyungsik Roger Moon , Martin Weidner

Any solid object can be decomposed into a collection of convex polytopes (in short, convexes). When a small number of convexes are used, such a decomposition can be thought of as a piece-wise approximation of the geometry. This…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Boyang Deng , Kyle Genova , Soroosh Yazdani , Sofien Bouaziz , Geoffrey Hinton , Andrea Tagliasacchi

In this paper we present a new algorithmic realization of a projection-based scheme for general convex constrained optimization problem. The general idea is to transform the original optimization problem to a sequence of feasibility…

Optimization and Control · Mathematics 2019-11-12 Aviv Gibali , Karl-Heinz Küfer , Daniel Reem , Philipp Süss

The determination of solutions of many inverse problems usually requires a set of measurements which leads to solving systems of ill-posed equations. In this paper we propose the Landweber iteration of Kaczmarz type with general uniformly…

Numerical Analysis · Mathematics 2013-07-17 Qinian Jin , Wei Wang

Minimization of the nuclear norm is often used as a surrogate, convex relaxation, for finding the minimum rank completion (recovery) of a partial matrix. The minimum nuclear norm problem can be solved as a trace minimization semidefinite…

Optimization and Control · Mathematics 2016-08-16 Shimeng Huang , Henry Wolkowicz

We provide an overview of recent progress in statistical inverse problems with random experimental design, covering both linear and nonlinear inverse problems. Different regularization schemes have been studied to produce robust and stable…

Statistics Theory · Mathematics 2023-12-27 Abhishake , Tapio Helin , Nicole Mücke

Many statistical $M$-estimators are based on convex optimization problems formed by the combination of a data-dependent loss function with a norm-based regularizer. We analyze the convergence rates of projected gradient and composite…

Machine Learning · Statistics 2012-07-26 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

We propose and analyse primal-dual interior-point algorithms for convex optimization problems in conic form. The families of algorithms we analyse are so-called short-step algorithms and they match the current best iteration complexity…

Optimization and Control · Mathematics 2014-11-11 Tor Myklebust , Levent Tunçel

We consider the question of estimating a solution to a system of equations that involve convex nonlinearities, a problem that is common in machine learning and signal processing. Because of these nonlinearities, conventional estimators…

Machine Learning · Computer Science 2018-08-14 Sohail Bahmani , Justin Romberg

In this paper, a parametric level set method for reconstruction of obstacles in general inverse problems is considered. General evolution equations for the reconstruction of unknown obstacles are derived in terms of the underlying level set…

Analysis of PDEs · Mathematics 2011-10-07 Alireza Aghasi , Misha Kilmer , Eric L. Miller

Statistical decision problems lie at the heart of statistical machine learning. The simplest problems are binary and multiclass classification and class probability estimation. Central to their definition is the choice of loss function,…

Machine Learning · Computer Science 2023-08-21 Robert C. Williamson , Zac Cranko

We propose a novel method to accurately reconstruct a set of images representing a single scene from few linear multi-view measurements. Each observed image is modeled as the sum of a background image and a foreground one. The background…

Computer Vision and Pattern Recognition · Computer Science 2013-09-19 Gilles Puy , Pierre Vandergheynst

Many inverse problems in nuclear fusion and high-energy astrophysics research, such as the optimization of tokamak reactor geometries or the inference of black hole parameters from interferometric images, necessitate high-dimensional…

Machine Learning · Computer Science 2025-05-09 Jonathan Gorard , Ammar Hakim , Hong Qin , Kyle Parfrey , Shantenu Jha

Approximations of optimization problems arise in computational procedures and sensitivity analysis. The resulting effect on solutions can be significant, with even small approximations of components of a problem translating into large…

Optimization and Control · Mathematics 2022-08-10 Johannes O. Royset

Procrustes problems are matrix approximation problems searching for a~transformation of the given dataset to fit another dataset. They find applications in numerous areas, such as factor and multivariate analysis, computer vision,…

Optimization and Control · Mathematics 2023-05-01 Terézia Fulová , Mária Trnovská

The problem of minimizing a (nonconvex) quadratic form over the unit simplex, referred to as a standard quadratic program, admits an exact convex conic formulation over the computationally intractable cone of completely positive matrices.…

Optimization and Control · Mathematics 2020-03-02 Y. Gorkem Gokmen , E. Alper Yildirim