English
Related papers

Related papers: Sampled Limited Memory Methods for Massive Linear …

200 papers

Compressed sensing has a wide range of applications that include error correction, imaging, radar and many more. Given a sparse signal in a high dimensional space, one wishes to reconstruct that signal accurately and efficiently from a…

Numerical Analysis · Mathematics 2009-05-28 Deanna Needell

This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each…

Numerical Analysis · Mathematics 2024-04-24 Fatemeh P. A. Beik , Michele Benzi , Mehdi Najafi-Kalyani

Generative models based on flow matching have attracted significant attention for their simplicity and superior performance in high-resolution image synthesis. By leveraging the instantaneous change-of-variables formula, one can directly…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Yasi Zhang , Peiyu Yu , Yaxuan Zhu , Yingshan Chang , Feng Gao , Ying Nian Wu , Oscar Leong

Randomized subspace embedding methods have had a great impact on the solution of a linear least squares (LS) problem by reducing its row dimension, leading to a randomized or sketched LS (sLS) problem, and use the solution of the sLS…

Numerical Analysis · Mathematics 2026-02-12 Zhongxiao Jia , Xinyuan Wan

Randomized Kaczmarz methods form a family of linear system solvers which converge by repeatedly projecting their iterates onto randomly sampled equations. While effective in some contexts, such as highly over-determined least squares,…

Numerical Analysis · Mathematics 2025-07-30 Michał Dereziński , Deanna Needell , Elizaveta Rebrova , Jiaming Yang

Real-time magnetic resonance imaging (MRI) methods generally shorten the measuring time by acquiring less data than needed according to the sampling theorem. In order to obtain a proper image from such undersampled data, the reconstruction…

Numerical Analysis · Mathematics 2013-12-05 Housen Li , Markus Haltmeier , Shuo Zhang , Jens Frahm , Axel Munk

This work studies an inverse scattering problem when limited-aperture data are available that are from just one or a few incident fields. This inverse problem is highly ill-posed due to the limited receivers and a few incident fields…

Numerical Analysis · Mathematics 2024-10-08 Jianfeng Ning , Jun Zou

We study randomized sketching methods for approximately solving least-squares problem with a general convex constraint. The quality of a least-squares approximation can be assessed in different ways: either in terms of the value of the…

Optimization and Control · Mathematics 2014-11-04 Mert Pilanci , Martin J. Wainwright

Developing large-scale distributed methods that are robust to the presence of adversarial or corrupted workers is an important part of making such methods practical for real-world problems. Here, we propose an iterative approach that is…

Machine Learning · Computer Science 2022-03-02 Xia Li , Longxiu Huang , Deanna Needell

The choice of the sensing matrix is crucial in compressed sensing. Random Gaussian sensing matrices satisfy the restricted isometry property, which is crucial for solving the sparse recovery problem using convex optimization techniques.…

Signal Processing · Electrical Eng. & Systems 2023-12-29 Kartheek Kumar Reddy Nareddy , Abijith Jagannath Kamath , Chandra Sekhar Seelamantula

Many inverse problems involve two or more sets of variables that represent different physical quantities but are tightly coupled with each other. For example, image super-resolution requires joint estimation of the image and motion…

Numerical Analysis · Mathematics 2019-06-26 James Herring , James Nagy , Lars Ruthotto

We study three fundamental problems of Linear Algebra, lying in the heart of various Machine Learning applications, namely: 1)"Low-rank Column-based Matrix Approximation". We are given a matrix A and a target rank k. The goal is to select a…

Data Structures and Algorithms · Computer Science 2011-05-05 Christos Boutsidis

Critical aspects of computational imaging systems, such as experimental design and image priors, can be optimized through deep networks formed by the unrolled iterations of classical model-based reconstructions (termed physics-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Michael Kellman , Kevin Zhang , Jon Tamir , Emrah Bostan , Michael Lustig , Laura Waller

We propose a deep learning approach to the obstacle problem inspired by the first-order system least-squares (FOSLS) framework. This method reformulates the problem as a convex minimization task; by simultaneously approximating the…

Numerical Analysis · Mathematics 2025-08-28 Gabriel Acosta , Eugenia Belén , Francisco M. Bersetche , Juan Pablo Borthagaray

The objective of this paper is to develop methods for solving image recovery problems subject to constraints on the solution. More precisely, we will be interested in problems which can be formulated as the minimization over a closed convex…

Optimization and Control · Mathematics 2012-12-12 Caroline Chaux , Jean-Christophe Pesquet , Nelly Pustelnik

One of the main computational drawbacks in the application of 3-D iterative inversion techniques is the requirement of solving the field quantities for the updated contrast in every iteration. In this paper, the 3-D electromagnetic inverse…

Signal Processing · Electrical Eng. & Systems 2019-06-27 Shilong Sun , Bert Jan Kooij , Alexander G. Yarovoy

Iterative algorithms are ubiquitous in the field of data mining. Widely known examples of such algorithms are the least mean square algorithm, backpropagation algorithm of neural networks. Our contribution in this paper is an improvement…

Machine Learning · Computer Science 2013-10-09 Rangeet Mitra , Amit Kumar Mishra

Diffusion models have recently emerged as powerful generative priors for solving inverse problems. However, training diffusion models in the pixel space are both data-intensive and computationally demanding, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Bowen Song , Soo Min Kwon , Zecheng Zhang , Xinyu Hu , Qing Qu , Liyue Shen

We propose iterative projection methods for solving square or rectangular consistent linear systems Ax = b. Existing projection methods use sketching matrices (possibly randomized) to generate a sequence of small projected subproblems, but…

Numerical Analysis · Mathematics 2023-12-13 Johannes J. Brust , Michael A. Saunders

We propose a novel sparse sliced inverse regression method based on random projections in a large $p$ small $n$ setting. Embedded in a generalized eigenvalue framework, the proposed approach finally reduces to parallel execution of…

Methodology · Statistics 2023-08-04 Jia Zhang , Runxiong Wu , Xin Chen