English
Related papers

Related papers: A Preconditioner for a Primal-Dual Newton Conjugat…

200 papers

We study the solution of large symmetric positive-definite linear systems in a matrix-free setting with a limited iteration budget. We focus on the preconditioned conjugate gradient (PCG) method with spectral preconditioning. Spectral…

Numerical Analysis · Mathematics 2026-04-01 Youssef Diouane , Selime Gürol , Oussama Mouhtal , Dominique Orban

Compressed sensing (CS) is a powerful method routinely employed to accelerate image acquisition. It is particularly suited to situations when the image under consideration is sparse but can be sampled in a basis where it is non-sparse. Here…

Image and Video Processing · Electrical Eng. & Systems 2022-07-18 Xudong Lv , Ashok Ajoy

Recent years have witnessed the success of deep networks in compressed sensing (CS), which allows for a significant reduction in sampling cost and has gained growing attention since its inception. In this paper, we propose a new practical…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Bin Chen , Jian Zhang

The Strong Constraint 4D Variational (SC-4DVAR) data assimilation method is widely used in climate and weather applications. SC-4DVAR involves solving a minimization problem to compute the maximum a posteriori estimate, which we tackle…

Numerical Analysis · Mathematics 2025-06-16 Amit N. Subrahmanya , Vishwas Rao , Arvind K. Saibaba

Compressive Sensing (CS) theory asserts that sparse signal reconstruction is possible from a small number of linear measurements. Although CS enables low-cost linear sampling, it requires non-linear and costly reconstruction. Recent…

Machine Learning · Computer Science 2018-10-16 Aysen Degerli , Sinem Aslan , Mehmet Yamac , Bulent Sankur , Moncef Gabbouj

Purpose: Design of a preconditioner for fast and efficient parallel imaging and compressed sensing reconstructions. Theory: Parallel imaging and compressed sensing reconstructions become time consuming when the problem size or the number of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Kirsten Koolstra , Jeroen van Gemert , Peter Börnert , Andrew Webb , Rob Remis

The observed and expected continued growth in the number of nodes in large-scale parallel computers gives rise to two major challenges: global communication operations are becoming major bottlenecks due to their limited scalability, and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-03 Markus Levonyak , Christina Pacher , Wilfried N. Gansterer

We address the problem of preconditioning a sequence of saddle point linear systems arising in the solution of PDE-constrained optimal control problems via active-set Newton methods, with control and (regularized) state constraints. We…

Numerical Analysis · Mathematics 2015-05-25 Margherita Porcelli , Valeria Simoncini , Mattia Tani

Reliable and energy-efficient wireless data transmission remains a major challenge in resource-constrained wireless neural recording tasks, where data compression is generally adopted to relax the burdens on the wireless data link.…

Information Theory · Computer Science 2016-02-02 Biao Sun , Wenfeng Zhao , Xinshan Zhu

Compressed sensing (CS) is an innovative technique allowing to represent signals through a small number of their linear projections. In this paper we address the application of CS to the scenario of progressive acquisition of 2D visual…

Information Theory · Computer Science 2014-03-06 Giulio Coluccia , Enrico Magli

Nonlinear conjugate gradient (NLCG) based optimizers have shown superior loss convergence properties compared to gradient descent based optimizers for traditional optimization problems. However, in Deep Neural Network (DNN) training, the…

Machine Learning · Computer Science 2019-11-21 Saurabh Adya , Vinay Palakkode , Oncel Tuzel

As a paradigm to recover the sparse signal from a small set of linear measurements, compressed sensing (CS) has stimulated a great deal of interest in recent years. In order to apply the CS techniques to wireless communication systems,…

Information Theory · Computer Science 2016-12-21 Jun Won Choi , Byonghyo Shim , Yacong Ding , Bhaskar Rao , Dong In Kim

Compressed sensing (CS) is an emerging paradigm for acquisition of compressed representations of a sparse signal. Its low complexity is appealing for resource-constrained scenarios like sensor networks. However, such scenarios are often…

Information Theory · Computer Science 2015-03-31 Diego Valsesia , Giulio Coluccia , Enrico Magli

This paper introduces the Nystr\"om PCG algorithm for solving a symmetric positive-definite linear system. The algorithm applies the randomized Nystr\"om method to form a low-rank approximation of the matrix, which leads to an efficient…

Numerical Analysis · Mathematics 2021-12-20 Zachary Frangella , Joel A. Tropp , Madeleine Udell

This work focuses on a class of general decentralized constraint-coupled optimization problems. We propose a novel nested primal-dual gradient algorithm (NPGA), which can achieve linear convergence under the weakest known condition, and its…

Optimization and Control · Mathematics 2025-05-06 Jingwang Li , Housheng Su

The numerical solution of partial differential equations on high-dimensional domains gives rise to computationally challenging linear systems. When using standard discretization techniques, the size of the linear system grows exponentially…

Numerical Analysis · Mathematics 2015-08-13 Daniel Kressner , Michael Steinlechner , Bart Vandereycken

A new polynomial preconditioner for symmetric complex linear systems based on Hermitian and skew-Hermitian splitting (HSS) for complex symmetric linear systems is herein presented. It applies to Conjugate Orthogonal Conjugate Gradient…

Numerical Analysis · Mathematics 2016-04-18 Enrico Bertolazzi , Marco Frego

Compressed sensing (CS) is a promising tool for reducing sampling costs. Current deep neural network (NN)-based CS methods face the challenges of collecting labeled measurement-ground truth (GT) data and generalizing to real applications.…

Signal Processing · Electrical Eng. & Systems 2024-08-15 Bin Chen , Xuanyu Zhang , Shuai Liu , Yongbing Zhang , Jian Zhang

The conjugate gradient solver (CG) is a prevalent method for solving symmetric and positive definite linear systems Ax=b, where effective preconditioners are crucial for fast convergence. Traditional preconditioners rely on prescribed…

Machine Learning · Computer Science 2025-11-03 Zherui Yang , Zhehao Li , Kangbo Lyu , Yixuan Li , Tao Du , Ligang Liu

The projected gradient descent (PGD) method has shown to be effective in recovering compressed signals described in a data-driven way by a generative model, i.e., a generator which has learned the data distribution. Further reconstruction…

Machine Learning · Computer Science 2021-09-03 Muhammad Fadli Damara , Gregor Kornhardt , Peter Jung