English
Related papers

Related papers: Matrix factorization with neural networks

200 papers

Deep learning models have proven to be exceptionally useful in performing many machine learning tasks. However, for each new dataset, choosing an effective size and structure of the model can be a time-consuming process of trial and error.…

Machine Learning · Computer Science 2019-08-08 Roozbeh Yousefzadeh , Dianne P O'Leary

The Kronecker product is an invaluable tool for data-sparse representations of large networks and matrices with countless applications in machine learning, graph theory and numerical linear algebra. In some instances, the sparsity pattern…

Numerical Analysis · Mathematics 2025-10-30 Yannis Voet , Leonardo De Novellis

Optimization problems with rank constraints arise in many applications, including matrix regression, structured PCA, matrix completion and matrix decomposition problems. An attractive heuristic for solving such problems is to factorize the…

Statistics Theory · Mathematics 2015-09-11 Yudong Chen , Martin J. Wainwright

Factorization of matrices where the rank of the two factors diverges linearly with their sizes has many applications in diverse areas such as unsupervised representation learning, dictionary learning or sparse coding. We consider a setting…

Disordered Systems and Neural Networks · Physics 2022-08-11 Antoine Maillard , Florent Krzakala , Marc Mézard , Lenka Zdeborová

Identifying discrete patterns in binary data is an important dimensionality reduction tool in machine learning and data mining. In this paper, we consider the problem of low-rank binary matrix factorisation (BMF) under Boolean arithmetic.…

Optimization and Control · Mathematics 2021-08-05 Reka A. Kovacs , Oktay Gunluk , Raphael A. Hauser

In this work, we introduce a highly efficient algorithm to address the nonnegative matrix underapproximation (NMU) problem, i.e., nonnegative matrix factorization (NMF) with an additional underapproximation constraint. NMU results are…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Mariano Tepper , Guillermo Sapiro

This note discusses an interesting matrix factorization called the CUR Decomposition. We illustrate various viewpoints of this method by comparing and contrasting them in different situations. Additionally, we offer a new characterization…

Numerical Analysis · Mathematics 2019-09-05 Keaton Hamm , Longxiu Huang

Multiresolution Matrix Factorization (MMF) is unusual amongst fast matrix factorization algorithms in that it does not make a low rank assumption. This makes MMF especially well suited to modeling certain types of graphs with complex…

Machine Learning · Computer Science 2021-11-04 Truong Son Hy , Risi Kondor

Nonnegative matrix factorization (NMF) is a relatively new unsupervised learning algorithm that decomposes a nonnegative data matrix into a parts-based, lower dimensional, linear representation of the data. NMF has applications in image…

Machine Learning · Statistics 2020-12-08 Matthew Corsetti , Ernest Fokoué

Nonnegative Matrix Factorization (NMF) has been a popular representation method for pattern classification problem. It tries to decompose a nonnegative matrix of data samples as the product of a nonnegative basic matrix and a nonnegative…

Machine Learning · Statistics 2013-12-06 Jim Jing-Yan Wang

Matrix factorization (MF), a cornerstone of recommender systems, decomposes user-item interaction matrices into latent representations. Traditional MF approaches, however, employ a two-stage, non-end-to-end paradigm, sequentially performing…

Information Retrieval · Computer Science 2025-04-22 Shangde Gao , Ke Liu , Yichao Fu , Hongxia Xu , Jian Wu

Most data for evaluating and training recommender systems is subject to selection biases, either through self-selection by the users or through the actions of the recommendation system itself. In this paper, we provide a principled approach…

Machine Learning · Computer Science 2016-05-30 Tobias Schnabel , Adith Swaminathan , Ashudeep Singh , Navin Chandak , Thorsten Joachims

Non-negative Matrix Factorization (NMF) asks to decompose a (entry-wise) non-negative matrix into the product of two smaller-sized nonnegative matrices, which has been shown intractable in general. In order to overcome this issue, the…

Data Structures and Algorithms · Computer Science 2019-07-15 Zhihuai Chen , Yinan Li , Xiaoming Sun , Pei Yuan , Jialin Zhang

Multi-view clustering is an important yet challenging task in machine learning and data mining community. One popular strategy for multi-view clustering is matrix factorization which could explore useful feature representations at…

Machine Learning · Computer Science 2021-05-04 Chen Zhang , Siwei Wang , Wenxuan Tu , Pei Zhang , Xinwang Liu , Changwang Zhang , Bo Yuan

Recommendation Systems apply Information Retrieval techniques to select the online information relevant to a given user. Collaborative Filtering is currently most widely used approach to build Recommendation System. CF techniques uses the…

Information Retrieval · Computer Science 2015-03-26 Dheeraj kumar Bokde , Sheetal Girase , Debajyoti Mukhopadhyay

We show how to construct highly symmetric algorithms for matrix multiplication. In particular, we consider algorithms which decompose the matrix multiplication tensor into a sum of rank-1 tensors, where the decomposition itself consists of…

Computational Complexity · Computer Science 2016-12-13 Joshua A. Grochow , Cristopher Moore

Knowledge tracing is a sequence prediction problem where the goal is to predict the outcomes of students over questions as they are interacting with a learning platform. By tracking the evolution of the knowledge of some student, one can…

Information Retrieval · Computer Science 2018-11-16 Jill-Jênn Vie , Hisashi Kashima

The Boolean matrix factorization problem consists in approximating a matrix by the Boolean product of two smaller Boolean matrices. To obtain optimal solutions when the matrices to be factorized are small, we propose SAT and MaxSAT…

Machine Learning · Computer Science 2021-06-21 Florent Avellaneda , Roger Villemaire

Matrix Factorization is a widely adopted technique in the field of recommender system. Matrix Factorization techniques range from SVD, LDA, pLSA, SVD++, MatRec, Zipf Matrix Factorization and Item2Vec. In recent years, distributed word…

Information Retrieval · Computer Science 2022-04-28 Hao Wang

With the recent success of representation learning methods, which includes deep learning as a special case, there has been considerable interest in developing techniques that incorporate known physical constraints into the learned…

Machine Learning · Computer Science 2024-01-02 Harsha Vardhan Tetali , Joel B. Harley , Benjamin D. Haeffele