English
Related papers

Related papers: An Algorithm for Integer Least-squares with Equali…

200 papers

Low-rank learning has attracted much attention recently due to its efficacy in a rich variety of real-world tasks, e.g., subspace segmentation and image categorization. Most low-rank methods are incapable of capturing low-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2016-11-16 Ping Li , Jun Yu , Meng Wang , Luming Zhang , Deng Cai , Xuelong Li

We consider the Low Rank Approximation problem, where the input consists of a matrix $A \in \mathbb{R}^{n_R \times n_C}$ and an integer $k$, and the goal is to find a matrix $B$ of rank at most $k$ that minimizes $\| A - B \|_0$, which is…

Data Structures and Algorithms · Computer Science 2023-11-03 Vincent Cohen-Addad , Chenglin Fan , Suprovat Ghoshal , Euiwoong Lee , Arnaud de Mesmay , Alantha Newman , Tony Chang Wang

Low rank approximation is an important tool used in many applications of signal processing and machine learning. Recently, randomized sketching algorithms were proposed to effectively construct low rank approximations and obtain approximate…

Information Theory · Computer Science 2018-09-11 Shashanka Ubaru , Arya Mazumdar , Yousef Saad

This paper presents novel adaptive space-time reduced-rank interference suppression least squares algorithms based on joint iterative optimization of parameter vectors. The proposed space-time reduced-rank scheme consists of a joint…

Information Theory · Computer Science 2013-01-15 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

We compute a \emph{sparse} solution to the classical least-squares problem $\min_x||A x -b||,$ where $A$ is an arbitrary matrix. We describe a novel algorithm for this sparse least-squares problem. The algorithm operates as follows: first,…

Data Structures and Algorithms · Computer Science 2013-12-31 Christos Boutsidis , Malik Magdon-Ismail

Solving an integer least squares (ILS) problem usually consists of two stages: reduction and search. This thesis is concerned with the reduction process for the ordinary ILS problem and the ellipsoid-constrained ILS problem. For the…

Optimization and Control · Mathematics 2015-03-17 Mazen Al Borno

Solving very large linear systems of equations is a key computational task in science and technology. In many cases, the coefficient matrix of the linear system is rank-deficient, leading to systems that may be underdetermined,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-13 Mónica Chillarón , Gregorio Quintana-Ortí , Vicente Vidal , Per-Gunnar Martinsson

As a means to solve optimization problems using quantum computers, the problem is typically recast into a Ising spin model whose ground-state is the solution of the optimization problem. An alternative to the Ising formulation is the…

Quantum Physics · Physics 2021-09-22 Martin Lanthaler , Wolfgang Lechner

We study efficient solution methods for stochastic eigenvalue problems arising from discretization of self-adjoint partial differential equations with random data. With the stochastic Galerkin approach, the solutions are represented as…

Numerical Analysis · Mathematics 2018-03-13 Howard C. Elman , Tengfei Su

In this paper, we propose three methods to solve the PageRank problem for the transition matrices with both row and column sparsity. Our methods reduce the PageRank problem to the convex optimization problem over the simplex. The first…

Optimization and Control · Mathematics 2020-12-22 Anton Anikin , Alexander Gasnikov , Alexander Gornov , Dmitry Kamzolov , Yury Maximov , Yurii Nesterov

In this paper, we propose a lower rank quaternion decomposition algorithm and apply it to color image inpainting. We introduce a concise form for the gradient of a real function in quaternion matrix variables. The optimality conditions of…

Optimization and Control · Mathematics 2020-09-30 Yannan Chen , Liqun Qi , Xinzhen Zhang , Yuwei Xu

Matrix rank minimization problems are gaining a plenty of recent attention in both mathematical and engineering fields. This class of problems, arising in various and across-discipline applications, is known to be NP-hard in general. In…

Optimization and Control · Mathematics 2010-10-06 Yun-Bin Zhao

We consider the problem of learning a low-rank matrix, constrained to lie in a linear subspace, and introduce a novel factorization for modeling such matrices. A salient feature of the proposed factorization scheme is it decouples the…

Machine Learning · Statistics 2018-06-18 Pratik Jawanpuria , Bamdev Mishra

We present a new algorithm and the corresponding convergence analysis for the regularization of linear inverse problems with sparsity constraints, applied to a new generalized sparsity promoting functional. The algorithm is based on the…

Numerical Analysis · Mathematics 2016-12-30 Sergey Voronin , Ingrid Daubechies

Given an input matrix polynomial whose coefficients are floating point numbers, we consider the problem of finding the nearest matrix polynomial which has rank at most a specified value. This generalizes the problem of finding a nearest…

Symbolic Computation · Computer Science 2017-12-13 Mark Giesbrecht , Joseph Haraldson , George Labahn

The paper introduces particle swarm optimization as a viable strategy to find numerical solution of Diophantine equation, for which there exists no general method of finding solutions. The proposed methodology uses a population of integer…

Neural and Evolutionary Computing · Computer Science 2010-03-16 Siby Abraham , Sugata Sanyal , Mukund Sanglikar

We propose a deep learning approach to the obstacle problem inspired by the first-order system least-squares (FOSLS) framework. This method reformulates the problem as a convex minimization task; by simultaneously approximating the…

Numerical Analysis · Mathematics 2025-08-28 Gabriel Acosta , Eugenia Belén , Francisco M. Bersetche , Juan Pablo Borthagaray

In our work, we consider the linear least squares problem for $m\times n$-systems of linear equations $Ax = b$, $m\geq n$, such that the matrix $A$ and right-hand side vector $b$ can vary within an interval $m\times n$-matrix and an…

Numerical Analysis · Mathematics 2020-01-22 Sergey P. Shary , Behnam Moradi

We give sparsity results and present algorithms for calculating minimum (vector) 1-norm universal solvers connected to least-squares problems. In particular, besides universal least-squares solvers, we consider minimum-rank universal…

Optimization and Control · Mathematics 2025-09-05 Ananias Sousa Machado , Marcia Fampa , Jon Lee

We overcome two major bottlenecks in the study of low rank approximation by assuming the low rank factors themselves are sparse. Specifically, (1) for low rank approximation with spectral norm error, we show how to improve the best known…

Data Structures and Algorithms · Computer Science 2021-11-02 David P. Woodruff , Taisuke Yasuda