English
Related papers

Related papers: Fast Cadzow's Algorithm and a Gradient Variant

200 papers

Graph signal processing is a ubiquitous task in many applications such as sensor, social, transportation and brain networks, point cloud processing, and graph neural networks. Often, graph signals are corrupted in the sensing process, thus…

Signal Processing · Electrical Eng. & Systems 2022-07-27 Masatoshi Nagahama , Koki Yamada , Yuichi Tanaka , Stanley H. Chan , Yonina C. Eldar

We present a fast randomized algorithm that computes a low rank LU decomposition. Our algorithm uses random projections type techniques to efficiently compute a low rank approximation of large matrices. The randomized LU algorithm can be…

Numerical Analysis · Mathematics 2016-02-02 Gil Shabat , Yaniv Shmueli , Yariv Aizenbud , Amir Averbuch

This paper introduces a novel approach for recovering sparse signals using sorted L1/L2 minimization. The proposed method assigns higher weights to indices with smaller absolute values and lower weights to larger values, effectively…

Numerical Analysis · Mathematics 2023-08-09 Chao Wang , Ming Yan , Junjie Yu

Video denoising for raw image has always been the difficulty of camera image processing. On the one hand, image denoising performance largely determines the image quality, moreover denoising effect in raw image will affect the accuracy of…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Bin Ma , Yueli Hu , Xianxian Lv , Kai Li

We present a novel optimization-based decoding algorithm for LDPC codes that is suitable for hardware architectures specialized to feed-forward neural networks. The algorithm is based on the projected gradient descent algorithm with a…

Information Theory · Computer Science 2019-01-16 Tadashi Wadayama , Satoshi Takabe

Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training…

Machine Learning · Computer Science 2021-03-03 Yasaman Esfandiari , Aditya Balu , Keivan Ebrahimi , Umesh Vaidya , Nicola Elia , Soumik Sarkar

This paper considers the problem of reconstructing sparse or compressible signals from one-bit quantized measurements. We study a new method that uses a log-sum penalty function, also referred to as the Gaussian entropy, for sparse signal…

Information Theory · Computer Science 2012-10-17 Jun Fang , Yanning Shen , Hongbin Li

Coded compressed sensing is an algorithmic framework tailored to sparse recovery in very large dimensional spaces. This framework is originally envisioned for the unsourced multiple access channel, a wireless paradigm attuned to…

Information Theory · Computer Science 2019-10-23 Vamsi K. Amalladinne , Jean-Francois Chamberland , Krishna R. Narayanan

Image denoising is a classical problem in low level computer vision. Model-based optimization methods and deep learning approaches have been the two main strategies for solving the problem. Model-based optimization methods are flexible for…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Chang Liu , Zhaowei Shang , Anyong Qin

Nuclear Magnetic Resonance (NMR) spectroscopy, which is modeled as the sum of damped exponential signals, has become an indispensable tool in various scenarios, such as the structure and function determination, chemical analysis, and…

Medical Physics · Physics 2020-11-17 Tianyu Qiu , Wenjing Liao , Di Guo , Dongbao Liu , Xin Wang , Jian-Feng Cai , Xiaobo Qu

Finite rate of innovation (FRI) is a powerful reconstruction framework enabling the recovery of sparse Dirac streams from uniform low-pass filtered samples. An extension of this framework, called generalised FRI (genFRI), has been recently…

Optimization and Control · Mathematics 2021-01-12 Matthieu Simeoni , Adrien Besson , Paul Hurley , Martin Vetterli

We study distributed optimization problems over a network when the communication between the nodes is constrained, and so information that is exchanged between the nodes must be quantized. Recent advances using the distributed gradient…

Optimization and Control · Mathematics 2019-05-14 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

A fast non-convex low-rank matrix decomposition method for potential field data separation is proposed. The singular value decomposition of the large size trajectory matrix, which is also a block Hankel matrix, is obtained using a fast…

Geophysics · Physics 2022-08-16 Dan Zhu , Rosemary Renaut , Hongwei Li , Tianyou Liu

In this paper, we consider lasso problems with zero-sum constraint, commonly required for the analysis of compositional data in high-dimensional spaces. A novel algorithm is proposed to solve these problems, combining a tailored active-set…

Optimization and Control · Mathematics 2022-09-26 Andrea Cristofari

This paper presents a randomized algorithm for computing the near-optimal low-rank dynamic mode decomposition (DMD). Randomized algorithms are emerging techniques to compute low-rank matrix approximations at a fraction of the cost of…

Numerical Analysis · Mathematics 2019-11-28 N. Benjamin Erichson , Lionel Mathelin , Steven L. Brunton , J. Nathan Kutz

Based on the methodological similarity between sparse signal reconstruction and system identification, a new approach for sparse signal reconstruction in compressive sensing (CS) is proposed in this paper. This approach employs a stochastic…

Information Theory · Computer Science 2015-06-15 Jian Jin , Yuantao Gu , Shunliang Mei

We develop an efficient stochastic variance reduced gradient descent algorithm to solve the affine rank minimization problem consists of finding a matrix of minimum rank from linear measurements. The proposed algorithm as a stochastic…

Optimization and Control · Mathematics 2022-11-08 Ningning Han , Juan Nie , Jian Lu , Michael K. Ng

This paper introduces a new method for minimizing matrix-smooth non-convex objectives through the use of novel Compressed Gradient Descent (CGD) algorithms enhanced with a matrix-valued stepsize. The proposed algorithms are theoretically…

Optimization and Control · Mathematics 2024-04-23 Hanmin Li , Avetik Karagulyan , Peter Richtárik

The Landweber algorithm defined on complex/real Hilbert spaces is a gradient descent algorithm for linear inverse problems. Our contribution is to present a novel method for accelerating convergence of the Landweber algorithm. In this…

Information Theory · Computer Science 2020-01-20 Tadashi Wadayama , Satoshi Takabe

Low-dose computed tomography (LDCT) is an important topic in the field of radiology over the past decades. LDCT reduces ionizing radiation-induced patient health risks but it also results in a low signal-to-noise ratio (SNR) and a potential…

Image and Video Processing · Electrical Eng. & Systems 2022-10-03 Wenjun Xia , Qing Lyu , Ge Wang