English
Related papers

Related papers: Federated Non-negative Matrix Factorization for Sh…

200 papers

Non-negative matrix factorization (NMF) is a prob- lem with many applications, ranging from facial recognition to document clustering. However, due to the variety of algorithms that solve NMF, the randomness involved in these algorithms,…

Numerical Analysis · Mathematics 2018-12-17 Connor Sell , Jeremy Kepner

Coupled Matrix Tensor Factorization (CMTF) facilitates the integration and analysis of multiple data sources and helps discover meaningful information. Nonnegative CMTF (N-CMTF) has been employed in many applications for identifying latent…

Machine Learning · Computer Science 2020-03-10 Thirunavukarasu Balasubramaniam , Richi Nayak , Chau Yuen

Nonnegative matrix factorization (NMF) has been widely used to learn low-dimensional representations of data. However, NMF pays the same attention to all attributes of a data point, which inevitably leads to inaccurate representation. For…

Machine Learning · Computer Science 2021-11-30 Jiao Wei , Can Tong , Bingxue Wu , Qiang He , Shouliang Qi , Yudong Yao , Yueyang Teng

The emerging neural topic models make topic modeling more easily adaptable and extendable in unsupervised text mining. However, the existing neural topic models is difficult to retain representative information of the documents within the…

Computation and Language · Computer Science 2022-03-15 Kang Xu , Xiaoqiu Lu , Yuan-fang Li , Tongtong Wu , Guilin Qi , Ning Ye , Dong Wang , Zheng Zhou

Non-negative matrix factorization (NMF) is widely used for dimensionality reduction and interpretable analysis, but standard formulations are unsupervised and cannot directly exploit class labels. Existing supervised or semi-supervised…

Machine Learning · Computer Science 2025-10-14 Kenichi Satoh

Identifying recurring patterns in high-dimensional time series data is an important problem in many scientific domains. A popular model to achieve this is convolutive nonnegative matrix factorization (CNMF), which extends classic…

Machine Learning · Computer Science 2019-07-02 Anthony Degleris , Ben Antin , Surya Ganguli , Alex H Williams

We propose a novel model for a topic-aware chatbot by combining the traditional Recurrent Neural Network (RNN) encoder-decoder model with a topic attention layer based on Nonnegative Matrix Factorization (NMF). After learning topic vectors…

Computation and Language · Computer Science 2019-12-05 Yuchen Guo , Nicholas Hanoian , Zhexiao Lin , Nicholas Liskij , Hanbaek Lyu , Deanna Needell , Jiahao Qu , Henry Sojico , Yuliang Wang , Zhe Xiong , Zhenhong Zou

Nonnegative matrix factorization (NMF) is a popular dimension reduction technique that produces interpretable decomposition of the data into parts. However, this decompostion is not generally identifiable (even up to permutation and…

Machine Learning · Computer Science 2016-04-05 W. Pan , F. Doshi-Velez

Non-negative Matrix Factorization (NMF) has already been applied to learn speaker characterizations from single or non-simultaneous speech for speaker recognition applications. It is also known for its good performance in (blind) source…

Sound · Computer Science 2016-05-02 Jeroen Zegers , Hugo Van hamme

Federated Learning aims to learn machine learning models from multiple decentralized edge devices (e.g. mobiles) or servers without sacrificing local data privacy. Recent Natural Language Processing techniques rely on deep learning and…

Computation and Language · Computer Science 2021-07-28 Ming Liu , Stella Ho , Mengqi Wang , Longxiang Gao , Yuan Jin , He Zhang

Nonnegative matrix factorization (NMF) is a popular data embedding technique. Given a nonnegative data matrix $X$, it aims at finding two lower dimensional matrices, $W$ and $H$, such that $X\approx WH$, where the factors $W$ and $H$ are…

Machine Learning · Computer Science 2026-02-06 Olivier Vu Thanh , Nicolas Gillis

Federated learning (FL) is a privacy-preserving paradigm where multiple participants jointly solve a machine learning problem without sharing raw data. Unlike traditional distributed learning, a unique characteristic of FL is statistical…

Machine Learning · Computer Science 2022-06-14 Kai Yue , Richeng Jin , Ryan Pilgrim , Chau-Wai Wong , Dror Baron , Huaiyu Dai

In federated learning, models trained on local clients are distilled into a global model. Due to the permutation invariance arises in neural networks, it is necessary to match the hidden neurons first when executing federated learning with…

Machine Learning · Computer Science 2022-10-04 Peng Xiao , Samuel Cheng

Given a collection of data points, non-negative matrix factorization (NMF) suggests to express them as convex combinations of a small set of `archetypes' with non-negative entries. This decomposition is unique only if the true archetypes…

Machine Learning · Statistics 2017-05-09 Hamid Javadi , Andrea Montanari

Low dimensional nonlinear structure abounds in datasets across computer vision and machine learning. Kernelized matrix factorization techniques have recently been proposed to learn these nonlinear structures for denoising, classification,…

Machine Learning · Computer Science 2021-06-01 Jicong Fan , Chengrun Yang , Madeleine Udell

Nonnegative matrix factorization (NMF) was popularized as a tool for data mining by Lee and Seung in 1999. NMF attempts to approximate a matrix with nonnegative entries by a product of two low-rank matrices, also with nonnegative entries.…

Information Retrieval · Computer Science 2008-05-02 Michael Biggs , Ali Ghodsi , Stephen Vavasis

Intelligible speech is produced by creating varying internal local muscle groupings -- i.e., functional units -- that are generated in a systematic and coordinated manner. There are two major challenges in characterizing and analyzing…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Jonghye Woo , Fangxu Xing , Jerry L. Prince , Maureen Stone , Arnold Gomez , Timothy G. Reese , Van J. Wedeen , Georges El Fakhri

We introduce federated marginal personalization (FMP), a novel method for continuously updating personalized neural network language models (NNLMs) on private devices using federated learning (FL). Instead of fine-tuning the parameters of…

Computation and Language · Computer Science 2020-12-03 Zhe Liu , Fuchun Peng

Large scale contextual representation models have significantly advanced NLP in recent years, understanding the semantics of text to a degree never seen before. However, they need to process large amounts of data to achieve high-quality…

Computation and Language · Computer Science 2021-05-04 Daniel Garcia Bernal , Lodovico Giaretta , Sarunas Girdzijauskas , Magnus Sahlgren

In our study, we propose a self-supervised neural topic model (NTM) that combines the power of NTMs and regularized self-supervised learning methods to improve performance. NTMs use neural networks to learn latent topics hidden behind the…

Machine Learning · Computer Science 2025-02-27 Weiran Xu , Kengo Hirami , Koji Eguchi