English
Related papers

Related papers: A Flexible Optimization Framework for Regularized …

200 papers

A theoretical framework for non-negative matrix factorization based on generalized dual Kullback-Leibler divergence, which includes members of the exponential family of models, is proposed. A family of algorithms is developed using this…

Machine Learning · Statistics 2019-05-20 Karthik Devarajan

Collaborative filtering (CF) has been successfully used to provide users with personalized products and services. However, dealing with the increasing sparseness of user-item matrix still remains a challenge. To tackle such issue, hybrid CF…

Information Retrieval · Computer Science 2017-06-14 Shuai Zhang , Lina Yao , Xiwei Xu

Nonnegative Matrix Factorization (NMF) is a widely-used data analysis technique, and has yielded impressive results in many real-world tasks. Generally, existing NMF methods represent each sample with several centroids, and find the optimal…

Image and Video Processing · Electrical Eng. & Systems 2021-03-26 Mulin Chen , Xuelong Li

We propose a novel framework for fast integral operations by uncovering hidden geometries in the row and column structures of the underlying operators. This is accomplished through the \texttt{Questionnaire} algorithm, an iterative…

Numerical Analysis · Mathematics 2026-02-27 Pei-Chun Su , Ronald R. Coifman

A robust algorithm for non-negative matrix factorization (NMF) is presented in this paper with the purpose of dealing with large-scale data, where the separability assumption is satisfied. In particular, we modify the Linear Programming…

Machine Learning · Statistics 2014-01-10 Jason Gejie Liu , Shuchin Aeron

We propose SMMF (Square-Matricized Momentum Factorization), a memory-efficient optimizer that reduces the memory requirement of the widely used adaptive learning rate optimizers, such as Adam, by up to 96%. SMMF enables flexible and…

Machine Learning · Computer Science 2025-05-01 Kwangryeol Park , Seulki Lee

This paper is concerned with multi-modal data fusion (MMDF) under unexpected modality failures in nonlinear non-Gaussian dynamic processes. An efficient framework to tackle this problem is proposed. In particular, a notion termed modality…

Machine Learning · Computer Science 2021-11-24 Bin Liu

Various factorization-based methods have been proposed to leverage second-order, or higher-order cross features for boosting the performance of predictive models. They generally enumerate all the cross features under a predefined maximum…

Machine Learning · Computer Science 2020-06-25 Weiyu Cheng , Yanyan Shen , Linpeng Huang

Statistical heterogeneity is a root cause of tension among accuracy, fairness, and robustness of federated learning (FL), and is key in paving a path forward. Personalized FL (PFL) is an approach that aims to reduce the impact of…

Machine Learning · Computer Science 2024-07-24 Shengkun Zhu , Jinshan Zeng , Sheng Wang , Yuan Sun , Xiaodong Li , Yuan Yao , Zhiyong Peng

Nonnegative matrix factorization (NMF) has been successfully applied to many areas for classification and clustering. Commonly-used NMF algorithms mainly target on minimizing the $l_2$ distance or Kullback-Leibler (KL) divergence, which may…

Information Retrieval · Computer Science 2014-10-07 Le Li , Jianjun Yang , Yang Xu , Zhen Qin , Honggang Zhang

Learning from multiple-relational data which contains noise, ambiguities, or duplicate entities is essential to a wide range of applications such as statistical inference based on Web Linked Data, recommender systems, computational biology,…

Machine Learning · Statistics 2016-04-05 Lucas Drumond , Ernesto Diaz-Aviles , Lars Schmidt-Thieme

We develop new approximation algorithms and data structures for representing and computing with multivariate functions using the functional tensor-train (FT), a continuous extension of the tensor-train (TT) decomposition. The FT represents…

Numerical Analysis · Mathematics 2018-12-13 Alex A. Gorodetsky , Sertac Karaman , Youssef M. Marzouk

The rapidly changing landscapes of modern optimization problems require algorithms that can be adapted in real-time. This paper introduces an Adaptive Metaheuristic Framework (AMF) designed for dynamic environments. It is capable of…

Artificial Intelligence · Computer Science 2024-04-19 Bestoun S. Ahmed

This paper investigates, from information theoretic grounds, a learning problem based on the principle that any regularity in a given dataset can be exploited to extract compact features from data, i.e., using fewer bits than needed to…

Machine Learning · Statistics 2018-11-14 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

Boolean matrix factorization is a natural and a popular technique for summarizing binary matrices. In this paper, we study a problem of Boolean matrix factorization where we additionally require that the factor matrices have consecutive…

Data Structures and Algorithms · Computer Science 2019-05-16 Nikolaj Tatti , Pauli Miettinen

The nonnegative matrix factorization is a widely used, flexible matrix decomposition, finding applications in biology, image and signal processing and information retrieval, among other areas. Here we present a related matrix factorization.…

Machine Learning · Statistics 2017-12-12 David W Dreisigmeyer

Nonnegative matrix factorization (NMF) factorizes a non-negative matrix into product of two non-negative matrices, namely a signal matrix and a mixing matrix. NMF suffers from the scale and ordering ambiguities. Often, the source signals…

Machine Learning · Computer Science 2015-05-05 Nirav Bhatt , Arun Ayyar

Non-negative Matrix Factorisation (NMF) has been extensively used in machine learning and data analytics applications. Most existing variations of NMF only consider how each row/column vector of factorised matrices should be shaped, and…

Machine Learning · Computer Science 2019-07-09 Shuai Jiang , Kan Li , Richard Yida Xu

This paper describes a new approach, based on linear programming, for computing nonnegative matrix factorizations (NMFs). The key idea is a data-driven model for the factorization where the most salient features in the data are used to…

Optimization and Control · Mathematics 2013-02-05 Victor Bittorf , Benjamin Recht , Christopher Re , Joel A. Tropp

We consider the joint estimation of change point locations and the sparsity pattern of the variance covariance matrix, which is assumed to evolve in a piecewise constant manner. By applying Group Fused LASSO and LASSO penalties to the…

Methodology · Statistics 2026-05-14 Ying Lin , Benjamin Poignard