English
Related papers

Related papers: Fast Cadzow's Algorithm and a Gradient Variant

200 papers

The Kaczmarz algorithm is a well known iterative method for solving overdetermined linear systems. Its randomized version yields provably exponential convergence in expectation. In this paper, we propose two new methods to speed up the…

Numerical Analysis · Computer Science 2016-08-02 Tengfei Ma

Variational quantum algorithms rely on the optimization of parameterized quantum circuits in noisy settings. The commonly used back-propagation procedure in classical machine learning is not directly applicable in this setting due to the…

Quantum Physics · Physics 2024-08-27 Zhiyan Ding , Taehee Ko , Jiahao Yao , Lin Lin , Xiantao Li

Rank deficient Hankel matrices are at the core of several applications. However, in practice, the coefficients of these matrices are noisy due to e.g. measurements errors and computational errors, so generically the involved matrices are…

Numerical Analysis · Mathematics 2020-12-15 Antonio Fazzi , Nicola Guglielmi , Ivan Markovsky

The low-rank matrix recovery problem seeks to reconstruct an unknown $n_1 \times n_2$ rank-$r$ matrix from $m$ linear measurements, where $m\ll n_1n_2$. This problem has been extensively studied over the past few decades, leading to a…

Machine Learning · Statistics 2026-04-02 Zhenxuan Li , Meng Huang

We consider a separation problem where the observation consists of the sum of a high amplitude smooth signal and a low amplitude transient signal. We propose a method for decomposition that relies on solving instances of a `constrained…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Ilker Bayram

Semidefinite programming (SDP) is a central topic in mathematical optimization with extensive studies on its efficient solvers. In this paper, we present a proof-of-principle sublinear-time algorithm for solving SDPs with low-rank…

Data Structures and Algorithms · Computer Science 2020-08-07 Nai-Hui Chia , Tongyang Li , Han-Hsuan Lin , Chunhao Wang

This paper studies distributed nonconvex optimization problems with stochastic gradients for a multi-agent system, in which each agent aims to minimize the sum of all agents' cost functions by using local compressed information exchange. We…

Optimization and Control · Mathematics 2024-03-05 Antai Xie , Xinlei Yi , Xiaofan Wang , Ming Cao , Xiaoqiang Ren

We develop the theory of Energy Conserving Descent (ECD) and introduce ECDSep, a gradient-based optimization algorithm able to tackle convex and non-convex optimization problems. The method is based on the novel ECD framework of…

Machine Learning · Computer Science 2023-06-02 G. Bruno De Luca , Alice Gatti , Eva Silverstein

We present a computationally-efficient method for recovering sparse signals from a series of noisy observations, known as the problem of compressed sensing (CS). CS theory requires solving a convex constrained minimization problem. We…

Information Theory · Computer Science 2010-06-22 Avishy Carmi , Pini Gurfil

Quantum machine learning and optimization are exciting new areas that have been brought forward by the breakthrough quantum algorithm of Harrow, Hassidim and Lloyd for solving systems of linear equations. The utility of {classical} linear…

Quantum Physics · Physics 2021-03-02 Iordanis Kerenidis , Anupam Prakash

This paper describes a fast algorithm for recovering low-rank matrices from their linear measurements contaminated with Poisson noise: the Poisson noise Maximum Likelihood Singular Value thresholding (PMLSV) algorithm. We propose a convex…

Machine Learning · Statistics 2014-12-22 Yang Cao , Yao Xie

The goal of a denoising algorithm is to reconstruct a signal from its noise-corrupted observations. Perfect reconstruction is seldom possible and performance is measured under a given fidelity criterion. In a recent work, the authors…

Information Theory · Computer Science 2009-11-11 George Gemelos , Styrmir Sigurjonsson , Tsachy Weissman

This work develops a novel set of algorithms, alternating Gradient Descent (GD) and minimization for MRI (altGDmin-MRI1 and altGDmin-MRI2), for accelerated dynamic MRI by assuming an approximate low-rank (LR) model on the matrix formed by…

Image and Video Processing · Electrical Eng. & Systems 2024-11-13 Silpa Babu , Sajan Goud Lingala , Namrata Vaswani

In machine learning approach to image denoising a network is trained to recover a clean image from a noisy one. In this paper a novel structure is proposed based on training multiple specialized networks as opposed to existing structures…

Image and Video Processing · Electrical Eng. & Systems 2020-12-01 Seyed Mohsen Hosseini

This work proposes a decentralized, iterative, Bayesian algorithm called CB-DSBL for in-network estimation of multiple jointly sparse vectors by a network of nodes, using noisy and underdetermined linear measurements. The proposed algorithm…

Machine Learning · Computer Science 2016-11-15 Saurabh Khanna , Chandra R. Murthy

The Randomized Kaczmarz Algorithm is a randomized method which aims at solving a consistent system of over determined linear equations. This note discusses how to find an optimized randomization scheme for this algorithm, which is related…

Systems and Control · Computer Science 2016-11-17 Liang Dai , Mojtaba Soltanalian , Kristiaan Pelckmans

Compressive covariance estimation has arisen as a class of techniques whose aim is to obtain second-order statistics of stochastic processes from compressive measurements. Recently, these methods have been used in various image processing…

Image and Video Processing · Electrical Eng. & Systems 2022-07-27 Jonathan Monsalve , Juan Ramirez , Iñaki Esnaola , Henry Arguello

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

Numerical Analysis · Computer Science 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

Turbo compressed sensing (Turbo-CS) is an efficient iterative algorithm for sparse signal recovery with partial orthogonal sensing matrices. In this paper, we extend the Turbo-CS algorithm to solve compressed sensing problems involving more…

Information Theory · Computer Science 2017-03-28 Zhipeng Xue , Junjie Ma , Xiaojun Yuan

Stepwise signals are ubiquitous in single-molecule detections, where abrupt changes in signal levels typically correspond to molecular conformational changes or state transitions. However, these features are inevitably obscured by noise,…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Xingdi Tong , Chenyu Wen