English
Related papers

Related papers: Robust Volume Minimization-Based Matrix Factorizat…

200 papers

Factor analysis, a classical multivariate statistical technique is popularly used as a fundamental tool for dimensionality reduction in statistics, econometrics and data science. Estimation is often carried out via the Maximum Likelihood…

Optimization and Control · Mathematics 2018-01-19 Koulik Khamaru , Rahul Mazumder

Boolean Matrix Factorization (BMF) aims to find an approximation of a given binary matrix as the Boolean product of two low-rank binary matrices. Binary data is ubiquitous in many fields, and representing data by binary matrices is common…

Machine Learning · Computer Science 2022-07-26 Fedor Fomin , Fahad Panolan , Anurag Patil , Adil Tanveer

Creating accurate and low-noise covariance matrices represents a formidable challenge in modern-day cosmology. We present a formalism to compress arbitrary observables into a small number of bins by projection into a model-specific subspace…

Cosmology and Nongalactic Astrophysics · Physics 2021-02-10 Oliver H. E. Philcox , Mikhail M. Ivanov , Matias Zaldarriaga , Marko Simonovic , Marcel Schmittfull

On the heels of compressed sensing, a remarkable new field has very recently emerged. This field addresses a broad range of problems of significant practical interest, namely, the recovery of a data matrix from what appears to be…

Information Theory · Computer Science 2009-03-19 Emmanuel J. Candes , Yaniv Plan

Randomized sampling has recently been demonstrated to be an efficient technique for computing approximate low-rank factorizations of matrices for which fast methods for computing matrix vector products are available. This paper describes an…

Numerical Analysis · Mathematics 2008-06-17 Per-Gunnar Martinsson

Motivated by the needs of estimating the proximity clustering with partial distance measurements from vantage points or landmarks for remote networked systems, we show that the proximity clustering problem can be effectively formulated as…

Machine Learning · Computer Science 2020-08-11 Yongquan Fu

Robust parameter estimation is a crucial task in several 3D computer vision pipelines such as Structure from Motion (SfM). State-of-the-art algorithms for robust estimation, however, still suffer from difficulties in converging to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Huu Le , Christopher Zach

Maximizing a monotone submodular function is a fundamental task in machine learning. In this paper, we study the deletion robust version of the problem under the classic matroids constraint. Here the goal is to extract a small size summary…

Data Structures and Algorithms · Computer Science 2024-02-20 Paul Dütting , Federico Fusco , Silvio Lattanzi , Ashkan Norouzi-Fard , Morteza Zadimoghaddam

Nonnegative matrix factorization (NMF) has been widely used to dimensionality reduction in machine learning. However, the traditional NMF does not properly handle outliers, so that it is sensitive to noise. In order to improve the…

Machine Learning · Computer Science 2022-06-08 Tingting Shen , Junhang Li , Can Tong , Qiang He , Chen Li , Yudong Yao , Yueyang Teng

Low-rank representation~(LRR) has been a significant method for segmenting data that are generated from a union of subspaces. It is, however, known that solving the LRR program is challenging in terms of time complexity and memory…

Machine Learning · Statistics 2017-10-24 Jie Shen , Ping Li , Huan Xu

The components underpinning PLMs -- large weight matrices -- were shown to bear considerable redundancy. Matrix factorization, a well-established technique from matrix theory, has been utilized to reduce the number of parameters in PLM.…

Computation and Language · Computer Science 2023-06-27 Siyu Ren , Kenny Q. Zhu

Given a matrix $M$ (not necessarily nonnegative) and a factorization rank $r$, semi-nonnegative matrix factorization (semi-NMF) looks for a matrix $U$ with $r$ columns and a nonnegative matrix $V$ with $r$ rows such that $UV$ is the best…

Numerical Analysis · Mathematics 2015-10-28 Nicolas Gillis , Abhishek Kumar

Nonnegative matrix factorization (NMF) is a powerful tool for data mining. However, the emergence of `big data' has severely challenged our ability to compute this fundamental decomposition using deterministic algorithms. This paper…

Machine Learning · Statistics 2018-05-02 N. Benjamin Erichson , Ariana Mendible , Sophie Wihlborn , J. Nathan Kutz

Nonnegative matrix factorization (NMF) is a linear dimensionality reduction technique for analyzing nonnegative data. A key aspect of NMF is the choice of the objective function that depends on the noise model (or statistics of the noise)…

Machine Learning · Computer Science 2021-02-10 Nicolas Gillis , Le Thi Khanh Hien , Valentin Leplat , Vincent Y. F. Tan

Matrix factorization (MF) discovers latent features from observations, which has shown great promises in the fields of collaborative filtering, data compression, feature extraction, word embedding, etc. While many problem-specific…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-14 Wei Tan , Shiyu Chang , Liana Fong , Cheng Li , Zijun Wang , Liangliang Cao

Multiple rotation averaging plays a crucial role in computer vision and robotics domains. The conventional optimization-based methods optimize a nonlinear cost function based on certain noise assumptions, while most previous learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Shiqi Li , Jihua Zhu , Yifan Xie , Naiwen Hu , Mingchen Zhu , Zhongyu Li , Di Wang

In this paper, we propose a provably correct algorithm for convolutive nonnegative matrix factorization (CNMF) under separability assumptions. CNMF is a convolutive variant of nonnegative matrix factorization (NMF), which functions as an…

Machine Learning · Computer Science 2019-11-15 Anthony Degleris , Nicolas Gillis

Sequence model based NLP applications can be large. Yet, many applications that benefit from them run on small devices with very limited compute and storage capabilities, while still having run-time constraints. As a result, there is a need…

Computation and Language · Computer Science 2020-10-08 Urmish Thakker , Jesse Beu , Dibakar Gope , Ganesh Dasika , Matthew Mattina

Boolean matrix factorization (BMF) has many applications in data mining, bioinformatics, and network analysis. The goal of BMF is to decompose a given binary matrix as the Boolean product of two smaller binary matrices, revealing underlying…

Commutative Algebra · Mathematics 2025-09-12 Juliann Geraci , Alexander B. Kunin , Alexandra Seceleanu

Approximate matrix factorization techniques with both nonnegativity and orthogonality constraints, referred to as orthogonal nonnegative matrix factorization (ONMF), have been recently introduced and shown to work remarkably well for…

Optimization and Control · Mathematics 2015-03-19 Filippo Pompili , Nicolas Gillis , P. -A. Absil , François Glineur