English
Related papers

Related papers: Optimal Spectral Initialization for Signal Recover…

200 papers

Recently there has been significant theoretical progress on understanding the convergence and generalization of gradient-based methods on nonconvex losses with overparameterized models. Nevertheless, many aspects of optimization and…

Machine Learning · Computer Science 2022-09-27 Dominik Stöger , Mahdi Soltanolkotabi

We study a sample complexity vs. conditioning tradeoff in modern signal recovery problems (including sparse recovery, low-rank matrix sensing, covariance estimation, and abstract phase retrieval), where convex optimization problems are…

Optimization and Control · Mathematics 2024-07-19 Lijun Ding , Alex L. Wang

We consider the robust phase retrieval problem of recovering the unknown signal from the magnitude-only measurements, where the measurements can be contaminated by both sparse arbitrary corruption and bounded random noise. We propose a new…

Machine Learning · Statistics 2018-01-08 Jinghui Chen , Lingxiao Wang , Xiao Zhang , Quanquan Gu

Frame design for phaseless reconstruction is now part of the broader problem of nonlinear reconstruction and is an emerging topic in harmonic analysis. The problem of phaseless reconstruction can be simply stated as follows. Given the…

Functional Analysis · Mathematics 2016-01-15 Radu Balan

We consider a variant of the phase retrieval problem, where vectors are replaced by unitary matrices, i.e., the unknown signal is a unitary matrix U, and the measurements consist of squared inner products |Tr(C*U)|^2 with unitary matrices C…

Quantum Physics · Physics 2018-03-07 Shelby Kimmel , Yi-Kai Liu

PhaseLift is a noted convex optimization technique for phase retrieval that can recover a signal exactly from amplitude measurements only, with high probability. Conventional PhaseLift requires a relatively large number of samples that…

Signal Processing · Electrical Eng. & Systems 2022-04-27 Zhe Zhang , Zhi Tian

The optimization problem behind neural networks is highly non-convex. Training with stochastic gradient descent and variants requires careful parameter tuning and provides no guarantee to achieve the global optimum. In contrast we show…

Machine Learning · Computer Science 2016-10-31 Antoine Gautier , Quynh Nguyen , Matthias Hein

We establish the optimal nonergodic sublinear convergence rate of the proximal point algorithm for maximal monotone inclusion problems. First, the optimal bound is formulated by the performance estimation framework, resulting in an infinite…

Optimization and Control · Mathematics 2019-07-15 Guoyong Gu , Junfeng Yang

Recovering an unknown but structured signal from its measurements is a challenging problem with significant applications in fields such as imaging restoration, wireless communications, and signal processing. In this paper, we consider the…

Information Theory · Computer Science 2026-01-09 Yijun Zhong , Yi Shen

We address the problem of signal reconstruction from intensity measurements with respect to a measurement frame. This non-convex inverse problem is known as phase retrieval. The case considered in this paper concerns phaseless measurements…

Functional Analysis · Mathematics 2019-02-13 Goetz E. Pfander , Palina Salanevich

Convex optimization problems with staged structure appear in several contexts, including optimal control, verification of deep neural networks, and isotonic regression. Off-the-shelf solvers can solve these problems but may scale poorly. We…

Optimization and Control · Mathematics 2020-10-28 Rudy Bunel , Oliver Hinder , Srinadh Bhojanapalli , Krishnamurthy , Dvijotham

We present a refinement of the Spectral Method by incorporating an optimization method into it and generalize it to two space dimensions. We then apply this Refined Spectral Method as an extremely accurate technique for finding the bound…

Mathematical Physics · Physics 2007-05-23 P. Pedram , M. Mirzaei , S. S. Gousheh

We propose a convex and fast signal reconstruction method for block sparsity under arbitrary linear transform with unknown block structure. The proposed method is a generalization of the similar existing method and can reconstruct signals…

Machine Learning · Computer Science 2024-02-14 Takanobu Furuhashi , Hidekata Hontani , Tatsuya Yokota

We consider simultaneously identifying the membership and locations of point sources that are convolved with different band-limited point spread functions, from the observation of their superpositions. This problem arises in…

Information Theory · Computer Science 2017-03-22 Yuanxin Li , Yuejie Chi

Signal recovery is one of the key techniques of Compressive sensing (CS). It reconstructs the original signal from the linear sub-Nyquist measurements. Classical methods exploit the sparsity in one domain to formulate the L0 norm…

Information Theory · Computer Science 2012-06-05 Yipeng Liu , Ivan Gligorijevic , Vladimir Matic , Maarten De Vos , Sabine Van Huffel

This paper proposes an intrinsic pseudospectral convexification framework for optimal control problems with manifold constraints. While successive pseudospectral convexification combines spectral collocation with successive convexification,…

Optimization and Control · Mathematics 2025-12-11 Tatsuya Narumi , Shin-ichiro Sakai

This paper proposes a precise signal recovery method with multilayered non-convex regularization, enhancing sparsity/low-rankness for high-dimensional signals including images and videos. In optimization-based signal recovery, multilayered…

Signal Processing · Electrical Eng. & Systems 2024-09-24 Akari Katsuma , Seisuke Kyochi , Shunsuke Ono , Ivan Selesnick

We study phase retrieval from magnitude measurements of an unknown signal as an algebraic estimation problem. Indeed, phase retrieval from rank-one and more general linear measurements can be treated in an algebraic way. It is verified that…

Functional Analysis · Mathematics 2014-02-18 Franz J Király , Martin Ehler

It was recently shown [7, 9] that "properly built" linear and polyhedral estimates nearly attain minimax accuracy bounds in the problem of recovery of unknown signal from noisy observations of linear images of the signal when the signal set…

Optimization and Control · Mathematics 2023-12-25 Yannis Bekri , Anatoli Juditsky , Arkadi Nemirovski

We consider the problem of finding optimally stable polynomial approximations to the exponential for application to one-step integration of initial value ordinary and partial differential equations. The objective is to find the largest…

Numerical Analysis · Mathematics 2013-01-10 David I. Ketcheson , Aron J. Ahmadia