English
Related papers

Related papers: Neural Factorization Machines for Sparse Predictiv…

200 papers

Matrix factorization is a key tool in data analysis; its applications include recommender systems, correlation analysis, signal processing, among others. Binary matrices are a particular case which has received significant attention for…

Machine Learning · Statistics 2019-01-30 Ignacio Ramirez

Conventional diffusion models typically relies on a fixed forward process, which implicitly defines complex marginal distributions over latent variables. This can often complicate the reverse process' task in learning generative…

Machine Learning · Statistics 2025-06-10 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

Federated Learning (FL) enables multiple resource-constrained edge devices with varying levels of heterogeneity to collaboratively train a global model. However, devices with limited capacity can create bottlenecks and slow down model…

Machine Learning · Computer Science 2025-04-08 Afsaneh Mahanipour , Hana Khamfroush

We propose an efficient distributed out-of-memory implementation of the Non-negative Matrix Factorization (NMF) algorithm for heterogeneous high-performance-computing (HPC) systems. The proposed implementation is based on prior work on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-14 Ismael Boureima , Manish Bhattarai , Maksim Eren , Erik Skau , Philip Romero , Stephan Eidenbenz , Boian Alexandrov

Nonnegative matrix factorization (NMF) has become a ubiquitous tool for data analysis. An important variant is the sparse NMF problem which arises when we explicitly require the learnt features to be sparse. A natural measure of sparsity is…

Machine Learning · Computer Science 2013-03-20 Vamsi K. Potluru , Sergey M. Plis , Jonathan Le Roux , Barak A. Pearlmutter , Vince D. Calhoun , Thomas P. Hayes

Deep neural networks (NNs) are known to lack uncertainty estimates and struggle to incorporate new data. We present a method that mitigates these issues by converting NNs from weight space to function space, via a dual parameterization.…

Machine Learning · Statistics 2023-09-06 Aidan Scannell , Riccardo Mereu , Paul Chang , Ella Tamir , Joni Pajarinen , Arno Solin

Nonnegative Matrix Factorization (NMF) is the problem of approximating a nonnegative matrix with the product of two low-rank nonnegative matrices and has been shown to be particularly useful in many applications, e.g., in text mining, image…

Optimization and Control · Mathematics 2012-08-13 Nicolas Gillis , François Glineur

Matrix factorization (MF) can extract the low-rank features and integrate the information of the data manifold distribution from high-dimensional data, which can consider the nonlinear neighbourhood information. Thus, MF has drawn wide…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-24 Zixuan Li , Hao Li , Kenli Li , Fan Wu , Lydia Chen , Keqin Li

With the rapid development of information technology, "information overload" has become the main theme that plagues people's online life. As an effective tool to help users quickly search for useful information, a personalized…

Information Retrieval · Computer Science 2022-06-03 Peiyu Liu , Junping Du , Zhe Xue , Ang Li

Whereas CNNs have demonstrated immense progress in many vision problems, they suffer from a dependence on monumental amounts of labeled training data. On the other hand, dictionary learning does not scale to the size of problems that CNNs…

Computer Vision and Pattern Recognition · Computer Science 2016-12-15 Parker Koch , Jason J. Corso

By combining related objects, unsupervised machine learning techniques aim to reveal the underlying patterns in a data set. Non-negative Matrix Factorization (NMF) is a data mining technique that splits data matrices by imposing…

Artificial Intelligence · Computer Science 2023-08-10 Yasser Khalafaoui , Nistor Grozavu , Basarab Matei , Laurent-Walter Goix

Nonnegative matrix factorization (NMF) is a popular method used to reduce dimensionality in data sets whose elements are nonnegative. It does so by decomposing the data set of interest, $\mathbf{X}$, into two lower rank nonnegative matrices…

Methodology · Statistics 2021-07-05 Phillip Shreeves , Jeffrey L. Andrews , Xinchen Deng , Ramie Ali-Adeeb , Andrew Jirasek

Time series forecasting is crucial in many fields, yet current deep learning models struggle with noise, data sparsity, and capturing complex multi-scale patterns. This paper presents MFF-FTNet, a novel framework addressing these challenges…

Machine Learning · Computer Science 2024-11-27 Yangyang Shi , Qianqian Ren , Yong Liu , Jianguo Sun

Nonnegative matrix factorization (NMF) is a linear dimensionality reduction technique for analyzing nonnegative data. A key aspect of NMF is the choice of the objective function that depends on the noise model (or statistics of the noise)…

Machine Learning · Computer Science 2021-02-10 Nicolas Gillis , Le Thi Khanh Hien , Valentin Leplat , Vincent Y. F. Tan

This paper proposes to learn high-performance deep ConvNets with sparse neural connections, referred to as sparse ConvNets, for face recognition. The sparse ConvNets are learned in an iterative way, each time one additional layer is…

Computer Vision and Pattern Recognition · Computer Science 2015-12-08 Yi Sun , Xiaogang Wang , Xiaoou Tang

A robust algorithm for non-negative matrix factorization (NMF) is presented in this paper with the purpose of dealing with large-scale data, where the separability assumption is satisfied. In particular, we modify the Linear Programming…

Machine Learning · Statistics 2014-01-10 Jason Gejie Liu , Shuchin Aeron

For various applications, the relations between the dependent and independent variables are highly nonlinear. Consequently, for large scale complex problems, neural networks and regression trees are commonly preferred over linear models…

Machine Learning · Computer Science 2017-05-23 Samet Oymak , Mehrdad Mahdavi , Jiasi Chen

Linear dimensionality reduction techniques are powerful tools for image analysis as they allow the identification of important features in a data set. In particular, nonnegative matrix factorization (NMF) has become very popular as it is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-07 Gabriella Casalino , Nicolas Gillis

Fuzzy rough feature selection (FRFS) is an effective means of addressing the curse of dimensionality in high-dimensional data. By removing redundant and irrelevant features, FRFS helps mitigate classifier overfitting, enhance generalization…

Machine Learning · Computer Science 2025-05-22 Suping Xu , Lin Shang , Keyu Liu , Hengrong Ju , Xibei Yang , Witold Pedrycz

Dimensionality Reduction plays a pivotal role in improving feature learning accuracy and reducing training time by eliminating redundant features, noise, and irrelevant data. Nonnegative Matrix Factorization (NMF) has emerged as a popular…

Machine Learning · Computer Science 2024-05-07 Farid Saberi-Movahed , Kamal Berahman , Razieh Sheikhpour , Yuefeng Li , Shirui Pan