English
Related papers

Related papers: Minimal L2-Consistent Data-Transmission

200 papers

We characterize the first-order sensitivity of approximately recovering a low-rank matrix from linear measurements, a standard problem in compressed sensing. A special case covered by our analysis is approximating an incomplete matrix by a…

Numerical Analysis · Mathematics 2024-07-02 Paul Breiding , Nick Vannieuwenhoven

We consider the problem of learning a low-rank matrix, constrained to lie in a linear subspace, and introduce a novel factorization for modeling such matrices. A salient feature of the proposed factorization scheme is it decouples the…

Machine Learning · Statistics 2018-06-18 Pratik Jawanpuria , Bamdev Mishra

Reducing parameter redundancies in neural network architectures is crucial for achieving feasible computational and memory requirements during training and inference phases. Given its easy implementation and flexibility, one promising…

Machine Learning · Computer Science 2025-08-22 Emanuele Zangrando , Steffen Schotthöfer , Gianluca Ceruti , Jonas Kusch , Francesco Tudisco

Modeling spatial-temporal interactions among neighboring agents is at the heart of multi-agent problems such as motion forecasting and crowd navigation. Despite notable progress, it remains unclear to which extent modern representations can…

Machine Learning · Computer Science 2025-06-12 Ahmad Rahimi , Po-Chien Luan , Yuejiang Liu , Frano Rajič , Alexandre Alahi

This paper studies the problem of recovering a signal vector and the corrupted noise vector from a collection of corrupted linear measurements through the solution of a l1 minimization, where the sensing matrix is a partial Fourier matrix…

Information Theory · Computer Science 2016-01-25 Dongcai Su

Many applications require recovering a ground truth low-rank matrix from noisy observations of the entries, which in practice is typically formulated as a weighted low-rank approximation problem and solved by non-convex optimization…

Machine Learning · Computer Science 2016-12-09 Yuanzhi Li , Yingyu Liang , Andrej Risteski

Many problems encountered in science and engineering can be formulated as estimating a low-rank object (e.g., matrices and tensors) from incomplete, and possibly corrupted, linear measurements. Through the lens of matrix and tensor…

Machine Learning · Computer Science 2023-10-11 Cong Ma , Xingyu Xu , Tian Tong , Yuejie Chi

In this manuscript, we research on the behaviors of surrogates for the rank function on different image processing problems and their optimization algorithms. We first propose a novel nonconvex rank surrogate on the general rank…

Machine Learning · Computer Science 2024-09-23 Cho-Ying Wu , Jian-Jiun Ding

Low-rank approximation of a matrix by means of random sampling has been consistently efficient in its empirical studies by many scientists who applied it with various sparse and structured multipliers, but adequate formal support for this…

Numerical Analysis · Mathematics 2016-06-07 Victor Y. Pan , Liang Zhao

Low rank matrix recovery problems, including matrix completion and matrix sensing, appear in a broad range of applications. In this work we present GNMR -- an extremely simple iterative algorithm for low rank matrix recovery, based on a…

Optimization and Control · Mathematics 2022-04-28 Pini Zilber , Boaz Nadler

When factorizing binary matrices, we often have to make a choice between using expensive combinatorial methods that retain the discrete nature of the data and using continuous methods that can be more efficient but destroy the discrete…

Discrete Mathematics · Computer Science 2016-10-07 Stefan Neumann , Rainer Gemulla , Pauli Miettinen

This letter proposes to estimate low-rank matrices by formulating a convex optimization problem with non-convex regularization. We employ parameterized non-convex penalty functions to estimate the non-zero singular values more accurately…

Computer Vision and Pattern Recognition · Computer Science 2016-04-14 Ankit Parekh , Ivan W. Selesnick

A primary interest in dynamic inverse problems is to identify the underlying temporal behaviour of the system from outside measurements. In this work we consider the case, where the target can be represented by a decomposition of spatial…

Numerical Analysis · Mathematics 2020-06-09 Simon Arridge , Pascal Fernsel , Andreas Hauptmann

The importance of accurate recommender systems has been widely recognized by academia and industry. However, the recommendation quality is still rather low. Recently, a linear sparse and low-rank representation of the user-item matrix has…

Information Retrieval · Computer Science 2016-02-29 Zhao Kang , Qiang Cheng

In this paper, we tackle two important problems in low-rank learning, which are partial singular value decomposition and numerical rank estimation of huge matrices. By using the concepts of Krylov subspaces such as Golub-Kahan…

Machine Learning · Statistics 2021-09-07 Reza Godaz , Reza Monsefi , Faezeh Toutounian , Reshad Hosseini

The extension of ab initio quantum many-body theory to higher accuracy and larger systems is intrinsically limited by the handling of large data objects in form of wave-function expansions and/or many-body operators. In this work we present…

Nuclear Theory · Physics 2021-09-27 A. Tichai , P. Arthuis , K. Hebeler , M. Heinz , J. Hoppe , A. Schwenk

Given a matrix $M\in \mathbb{R}^{m\times n}$, the low rank matrix completion problem asks us to find a rank-$k$ approximation of $M$ as $UV^\top$ for $U\in \mathbb{R}^{m\times k}$ and $V\in \mathbb{R}^{n\times k}$ by only observing a few…

Machine Learning · Computer Science 2024-04-03 Yuzhou Gu , Zhao Song , Junze Yin , Lichen Zhang

Missing data is a pervasive issue in both scientific and engineering tasks, especially for the modeling of spatiotemporal data. This problem attracts many studies to contribute to data-driven solutions. Existing imputation solutions mainly…

Machine Learning · Computer Science 2024-07-26 Tong Nie , Guoyang Qin , Wei Ma , Yuewen Mei , Jian Sun

In this paper we study the problem of recovering a low-rank matrix from a number of random linear measurements that are corrupted by outliers taking arbitrary values. We consider a nonsmooth nonconvex formulation of the problem, in which we…

Information Theory · Computer Science 2019-07-16 Xiao Li , Zhihui Zhu , Anthony Man-Cho So , Rene Vidal

Many tasks in data mining and related fields can be formalized as matching between objects in two heterogeneous domains, including collaborative filtering, link prediction, image tagging, and web search. Machine learning techniques,…

Machine Learning · Computer Science 2014-10-24 Jingbo Shang , Tianqi Chen , Hang Li , Zhengdong Lu , Yong Yu