English
Related papers

Related papers: An Oracle Gradient Regularized Newton Method for Q…

200 papers

This paper introduces a nonconvex approach for sparse signal recovery, proposing a novel model termed the $\tau_2$-model, which utilizes the squared $\ell_1/\ell_2$ norms for this purpose. Our model offers an advancement over the $\ell_0$…

Optimization and Control · Mathematics 2024-09-02 Jianqing Jia , Ashley Prater-Bennette , Lixin Shen , Erin E. Tripp

Gradient-based optimizers have been proposed for training variational quantum circuits in settings such as quantum neural networks (QNNs). The task of gradient estimation, however, has proven to be challenging, primarily due to distinctive…

We present a novel numerical method to the time-harmonic inverse medium scattering problem of recovering the refractive index from near-field scattered data. The approach consists of two stages, one pruning step of detecting the scatterer…

Numerical Analysis · Mathematics 2015-06-05 Kazufumi Ito , Bangti Jin , Jun Zou

This paper investigates the recovery of a spectrally sparse signal from its partially revealed noisy entries within the framework of spectral compressive sensing. Nonconvex optimization approaches have recently been proposed based on…

Information Theory · Computer Science 2022-01-25 Xunmeng Wu , Zai Yang , Zongben Xu

We consider the minimization of non-convex quadratic forms regularized by a cubic term, which exhibit multiple saddle points and poor local minima. Nonetheless, we prove that, under mild assumptions, gradient descent approximates the…

Optimization and Control · Mathematics 2022-08-31 Yair Carmon , John C. Duchi

Estimating unknown rotations from noisy measurements is an important step in SfM and other 3D vision tasks. Typically, local optimization methods susceptible to returning suboptimal local minima are used to solve the rotation averaging…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Matthew Giamou , Filip Maric , Valentin Peretroukhin , Jonathan Kelly

In phase retrieval, the goal is to recover a signal $\mathbf{x}\in\mathbb{C}^N$ from the magnitudes of linear measurements $\mathbf{Ax}\in\mathbb{C}^M$. While recent theory has established that $M\approx 4N$ intensity measurements are…

Information Theory · Computer Science 2015-06-19 Philip Schniter , Sundeep Rangan

This paper proposes a stochastic variant of a classic algorithm---the cubic-regularized Newton method [Nesterov and Polyak 2006]. The proposed algorithm efficiently escapes saddle points and finds approximate local minima for general…

Machine Learning · Computer Science 2017-12-07 Nilesh Tripuraneni , Mitchell Stern , Chi Jin , Jeffrey Regier , Michael I. Jordan

We present a method for reconstructing resonant interactions in weakly coupled phase oscillator systems from noisy time series. Instead of attempting to recover the full phase equations, which may be non-identifiable in the presence of…

Chaotic Dynamics · Physics 2026-05-12 Bengi Dönmez , Bob Rink

Reconstructing a signal from squared linear (rank-one quadratic) measurements is a challenging problem with important applications in optics and imaging, where it is known as phase retrieval. This paper proposes two new phase retrieval…

Information Theory · Computer Science 2016-09-21 Cheng Qian , Nicholas D. Sidiropoulos , Kejun Huang , Lei Huang , H. C. So

We consider the problem of recovering the surface wave profile from noisy bottom pressure measurements with (\textit{a priori} unknown) arbitrary pressure at the surface. Without noise, the direct approach developed in…

Fluid Dynamics · Physics 2024-02-14 Joris Labarbe , Alexandre Vieira , Didier Clamond

We consider the robust phase retrieval problem of recovering the unknown signal from the magnitude-only measurements, where the measurements can be contaminated by both sparse arbitrary corruption and bounded random noise. We propose a new…

Machine Learning · Statistics 2018-01-08 Jinghui Chen , Lingxiao Wang , Xiao Zhang , Quanquan Gu

The phase retrieval problem is a fundamental problem in many fields, which is appealing for investigation. It is to recover the signal vector $\tilde{x}\in\mathbb{C}^d$ from a set of $N$ measurements $b_n=|f^*_n\tilde{x}|^2,\ n=1,\cdots,…

Optimization and Control · Mathematics 2017-08-30 Jian-Feng Cai , Haixia Liu , Yang Wang

We propose an efficient protocol to fully reconstruct a set of high-fidelity quantum gates. Usually, the efficiency of reconstructing high-fidelity quantum gates is limited by the sampling noise. Our protocol is based on a perturbative…

Quantum Physics · Physics 2021-03-24 Ruyu Yang , Ying Li

Low rank matrix recovery problems, including matrix completion and matrix sensing, appear in a broad range of applications. In this work we present GNMR -- an extremely simple iterative algorithm for low rank matrix recovery, based on a…

Optimization and Control · Mathematics 2022-04-28 Pini Zilber , Boaz Nadler

Many recent problems in signal processing and machine learning such as compressed sensing, image restoration, matrix/tensor recovery, and non-negative matrix factorization can be cast as constrained optimization. Projected gradient descent…

Optimization and Control · Mathematics 2022-09-07 Trung Vu , Raviv Raich

In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only noisy gradient and…

Optimization and Control · Mathematics 2018-03-12 Andre Milzarek , Xiantao Xiao , Shicong Cen , Zaiwen Wen , Michael Ulbrich

We consider the phase retrieval problem, which involves recovering a rank-one positive semidefinite matrix from rank-one measurements. A recently proposed algorithm based on Bures-Wasserstein gradient descent (BWGD) exhibits superlinear…

Machine Learning · Statistics 2025-08-01 Tyler Maunu , Gabriel Abreu

Gradient regularization, as described in \citet{barrett2021implicit}, is a highly effective technique for promoting flat minima during gradient descent. Empirical evidence suggests that this regularization technique can significantly…

Machine Learning · Statistics 2023-04-03 Xuran Meng , Yuan Cao , Difan Zou

Cubic regularized Newton (CRN) methods have attracted signiffcant research interest because they offer stronger solution guarantees and lower iteration complexity. With the rise of the big-data era, there is growing interest in developing…

Optimization and Control · Mathematics 2025-07-18 Yiming Yang , Chuan He , Xiao Wang , Zheng Peng
‹ Prev 1 8 9 10 Next ›