English
Related papers

Related papers: Compression Approaches for the Regularized Solutio…

200 papers

The high-order relations between the content in social media sharing platforms are frequently modeled by a hypergraph. Either hypergraph Laplacian matrix or the adjacency matrix is a big matrix. Randomized algorithms are used for low-rank…

Social and Information Networks · Computer Science 2019-08-23 Georgios Karantaidis , Ioannis Sarridis , Constantine Kotropoulos

This paper develops a general framework for solving a variety of convex cone problems that frequently arise in signal processing, machine learning, statistics, and other fields. The approach works as follows: first, determine a conic…

Optimization and Control · Mathematics 2011-12-20 Stephen R. Becker , Emmanuel J. Candès , Michael Grant

We introduce a family of numerical algorithms for the solution of linear system in higher dimensions with the matrix and right hand side given and the solution sought in the tensor train format. The proposed methods are rank--adaptive and…

Numerical Analysis · Mathematics 2014-10-07 Sergey V. Dolgov , Dmitry V. Savostyanov

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

We propose an algebraic combinatorial method for solving large sparse linear systems of equations locally - that is, a method which can compute single evaluations of the signal without computing the whole signal. The method scales only in…

Statistics Theory · Mathematics 2014-03-05 Franz J Király , Louis Theran

This paper introduces a preconditioned method designed to comprehensively address the saddle point system with the aim of improving convergence efficiency. In the preprocessor construction phase, a technical approach for solving the…

Numerical Analysis · Mathematics 2024-04-10 Juan Zhang , Yiyi Luo

How can we compute the pseudoinverse of a sparse feature matrix efficiently and accurately for solving optimization problems? A pseudoinverse is a generalization of a matrix inverse, which has been extensively utilized as a fundamental…

Machine Learning · Computer Science 2020-11-10 Jinhong Jung , Lee Sael

We introduce a new general purpose multiresolution preconditioner for symmetric linear systems. Most existing multiresolution preconditioners use some standard wavelet basis that relies on knowledge of the geometry of the underlying domain.…

Numerical Analysis · Mathematics 2017-07-10 Pramod Kaushik Mudrakarta , Risi Kondor

We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant…

Numerical Analysis · Mathematics 2016-02-11 Namgil Lee , Andrzej Cichocki

The paper deals with the problem of finding sparse solutions to systems of polynomial equations possibly perturbed by noise. In particular, we show how these solutions can be recovered from group-sparse solutions of a derived system of…

Information Theory · Computer Science 2014-07-17 Fabien Lauer , Henrik Ohlsson

We consider the recovery of a low rank and jointly sparse matrix from under sampled measurements of its columns. This problem is highly relevant in the recovery of dynamic MRI data with high spatio-temporal resolution, where each column of…

Numerical Analysis · Computer Science 2015-06-03 Sampurna Biswas , Sunrita Poddar , Soura Dasgupta , Raghuraman Mudumbai , Mathews Jacob

Compressive sensing (CS) reconstructs images from sub-Nyquist measurements by solving a sparsity-regularized inverse problem. Traditional CS solvers use iterative optimizers with hand crafted sparsifiers, while early data-driven methods…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Pamuditha Somarathne , Tharindu Wickremasinghe , Amashi Niwarthana , A. Thieshanthan , Chamira U. S. Edussooriya , Dushan N. Wadduwage

We propose a method to reconstruct and cluster incomplete high-dimensional data lying in a union of low-dimensional subspaces. Exploring the sparse representation model, we jointly estimate the missing data while imposing the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 João Carvalho , Manuel Marques , João P. Costeira

In covariance matrix estimation, one of the challenges lies in finding a suitable model and an efficient estimation method. Two commonly used modelling approaches in the literature involve imposing linear restrictions on the covariance…

Statistics Theory · Mathematics 2024-05-09 Piotr Zwiernik

Low-order linear System IDentification (SysID) addresses the challenge of estimating the parameters of a linear dynamical system from finite samples of observations and control inputs with minimal state representation. Traditional…

Systems and Control · Electrical Eng. & Systems 2025-06-05 Uday Kiran Reddy Tadipatri , Benjamin D. Haeffele , Joshua Agterberg , Ingvar Ziemann , René Vidal

When given a generalized matrix separation problem, which aims to recover a low rank matrix $L_0$ and a sparse matrix $S_0$ from $M_0=L_0+HS_0$, the work \cite{CW25} proposes a novel convex optimization problem whose objective function is…

Optimization and Control · Mathematics 2026-05-05 Xuemei Chen , Owen Deen

In this paper we show how to recover a spectral approximations to broad classes of structured matrices using only a polylogarithmic number of adaptive linear measurements to either the matrix or its inverse. Leveraging this result we obtain…

Data Structures and Algorithms · Computer Science 2018-12-18 Arun Jambulapati , Kirankumar Shiragur , Aaron Sidford

Many problems can be formulated as recovering a low-rank tensor. Although an increasingly common task, tensor recovery remains a challenging problem because of the delicacy associated with the decomposition of higher order tensors. To…

Machine Learning · Statistics 2014-05-09 Ming Yuan , Cun-Hui Zhang

This paper studies the problem of sampling vector and tensor signals, which is the process of choosing sites in vectors and tensors to place sensors for better recovery. A small core tensor and multiple factor matrices can be used to…

Optimization and Control · Mathematics 2024-07-03 Hao Li , Dong Liang , Zixi Zhou , Zheng Xie

The theory of (tight) wavelet frames has been extensively studied in the past twenty years and they are currently widely used for image restoration and other image processing and analysis problems. The success of wavelet frame based models,…

Computer Vision and Pattern Recognition · Computer Science 2011-10-31 Yong Zhang , Bin Dong , Zhaosong Lu