English
Related papers

Related papers: On the minimum FLOPs problem in the sparse Cholesk…

200 papers

Matrix factorization is a popular approach for large-scale matrix completion. The optimization formulation based on matrix factorization can be solved very efficiently by standard algorithms in practice. However, due to the non-convexity…

Machine Learning · Computer Science 2016-11-18 Ruoyu Sun , Zhi-Quan Luo

We consider a discrete optimization formulation for learning sparse classifiers, where the outcome depends upon a linear combination of a small subset of features. Recent work has shown that mixed integer programming (MIP) can be used to…

Machine Learning · Statistics 2021-06-08 Antoine Dedieu , Hussein Hazimeh , Rahul Mazumder

We propose an algorithmic framework for convex minimization problems of a composite function with two terms: a self-concordant function and a possibly nonsmooth regularization term. Our method is a new proximal Newton algorithm that…

Machine Learning · Statistics 2013-03-20 Quoc Tran Dinh , Anastasios Kyrillidis , Volkan Cevher

Nonnegative matrix factorization (NMF) has an established reputation as a useful data analysis technique in numerous applications. However, its usage in practical situations is undergoing challenges in recent years. The fundamental factor…

Machine Learning · Computer Science 2016-05-04 Mariano Tepper , Guillermo Sapiro

Techniques involving factorization are found in a wide range of applications and have enjoyed significant empirical success in many fields. However, common to a vast majority of these problems is the significant disadvantage that the…

Numerical Analysis · Computer Science 2015-06-26 Benjamin D. Haeffele , Rene Vidal

Matrix factorization (MF) has been widely used to discover the low-rank structure and to predict the missing entries of data matrix. In many real-world learning systems, the data matrix can be very high-dimensional but sparse. This poses an…

Information Retrieval · Computer Science 2019-01-08 Xiangnan He , Jinhui Tang , Xiaoyu Du , Richang Hong , Tongwei Ren , Tat-Seng Chua

Probabilistic approach to Boolean matrix factorization can provide solutions robustagainst noise and missing values with linear computational complexity. However,the assumption about latent factors can be problematic in real world…

Machine Learning · Statistics 2019-05-31 Lifan Liang , Songjian Lu

We consider the problem of finding the minimal-size factorization of the provenance of self-join-free conjunctive queries, i.e., we want to find a formula that minimizes the number of variable repetitions. This problem is equivalent to…

Databases · Computer Science 2024-05-15 Neha Makhija , Wolfgang Gatterbauer

It is well known that matrices with low Hessenberg-structured displacement rank enjoy fast algorithms for certain matrix factorizations. We show how $n\times n$ principal finite sections of the Gram matrix for the orthogonal polynomial…

Numerical Analysis · Mathematics 2024-12-24 Karim Gumerov , Samantha Rigg , Richard Mikael Slevinsky

Some new rigorous perturbation bounds for the generalized Cholesky factorization with normwise or componentwise perturbations in the given matrix are obtained, where the componentwise perturbation has the form of backward rounding error for…

Numerical Analysis · Mathematics 2014-09-23 Hanyu Li , Yanfei Yang

We explore the connection between the factorisation of virtual corrections to multi-particle massless gauge theory amplitudes and the problem of subtraction at NNLO and beyond. Taking inspiration from virtual factorisation, we provide a set…

High Energy Physics - Phenomenology · Physics 2018-01-22 Lorenzo Magnea , Ezio Maina , Paolo Torrielli , Sandro Uccirati

Compressed sensing of simultaneously sparse and low-rank matrices enables recovery of sparse signals from a few linear measurements of their bilinear form. One important question is how many measurements are needed for a stable…

Information Theory · Computer Science 2016-07-01 Kiryung Lee , Yihong Wu , Yoram Bresler

Five new algorithms were proposed in order to optimize well conditioning of structural matrices. Along with decreasing the size and duration of analyses, minimizing analytical errors is a critical factor in the optimal computer analysis of…

Numerical Analysis · Mathematics 2021-09-21 Farzad S. Dizaji , Mehrdad S. Dizaji

Symmetric nonnegative matrix factorization has found abundant applications in various domains by providing a symmetric low-rank decomposition of nonnegative matrices. In this paper we propose a Frank-Wolfe (FW) solver to optimize the…

Machine Learning · Computer Science 2018-06-27 Han Zhao , Geoff Gordon

This article introduces new multiplicative updates for nonnegative matrix factorization with the $\beta$-divergence and sparse regularization of one of the two factors (say, the activation matrix). It is well known that the norm of the…

Machine Learning · Computer Science 2024-03-13 Arthur Marmin , José Henrique de Morais Goulart , Cédric Févotte

We propose a penalized likelihood framework for estimating multiple precision matrices from different classes. Most existing methods either incorporate no information on relationships between the precision matrices, or require this…

Machine Learning · Statistics 2020-03-03 Bradley S. Price , Aaron J. Molstad , Ben Sherwood

We address a problem of covariance selection, where we seek a trade-off between a high likelihood against the number of non-zero elements in the inverse covariance matrix. We solve a maximum likelihood problem with a penalty term given by…

Computational Engineering, Finance, and Science · Computer Science 2007-05-23 Onureena Banerjee , Alexandre d'Aspremont , Laurent El Ghaoui

This survey describes probabilistic algorithms for linear algebra computations, such as factorizing matrices and solving linear systems. It focuses on techniques that have a proven track record for real-world problem instances. The paper…

Numerical Analysis · Mathematics 2021-03-17 Per-Gunnar Martinsson , Joel Tropp

Scientific workloads are often described as directed acyclic task graphs. In this paper, we focus on the multifrontal factorization of sparse matrices, whose task graph is structured as a tree of parallel tasks. Among the existing models…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-05 Abdou Guermouche , Loris Marchal , Bertrand Simon , Frédéric Vivien

Nonnegative matrix factorization (NMF) is a powerful tool for data mining. However, the emergence of `big data' has severely challenged our ability to compute this fundamental decomposition using deterministic algorithms. This paper…

Machine Learning · Statistics 2018-05-02 N. Benjamin Erichson , Ariana Mendible , Sophie Wihlborn , J. Nathan Kutz