English
Related papers

Related papers: A Fast Gradient Method for Nonnegative Sparse Regr…

200 papers

Many imaging science tasks can be modeled as a discrete linear inverse problem. Solving linear inverse problems is often challenging, with ill-conditioned operators and potentially non-unique solutions. Embedding prior knowledge, such as…

Numerical Analysis · Mathematics 2023-12-07 Elizabeth Newman , Jack Michael Solomon , Matthias Chung

Motivated by the reconstruction and the prediction of electricity consumption, we extend Nonnegative Matrix Factorization~(NMF) to take into account side information (column or row features). We consider general linear measurement settings,…

Machine Learning · Statistics 2017-09-20 Jiali Mei , Yohann De Castro , Yannig Goude , Jean-Marc Azaïs , Georges Hébrail

Nonnegative matrix factorization (NMF), a dimensionality reduction and factor analysis method, is a special case in which factor matrices have low-rank nonnegative constraints. Considering the stochastic learning in NMF, we specifically…

Numerical Analysis · Computer Science 2018-04-05 Hiroyuki Kasai

Non-negative Matrix Factorisation (NMF) has been extensively used in machine learning and data analytics applications. Most existing variations of NMF only consider how each row/column vector of factorised matrices should be shaped, and…

Machine Learning · Computer Science 2019-07-09 Shuai Jiang , Kan Li , Richard Yida Xu

Symmetric nonnegative matrix factorization has found abundant applications in various domains by providing a symmetric low-rank decomposition of nonnegative matrices. In this paper we propose a Frank-Wolfe (FW) solver to optimize the…

Machine Learning · Computer Science 2018-06-27 Han Zhao , Geoff Gordon

This work proposes a new algorithm for automated and simultaneous phenotyping of multiple co-occurring medical conditions, also referred as comorbidities, using clinical notes from the electronic health records (EHRs). A basic latent factor…

Machine Learning · Statistics 2016-09-21 Shalmali Joshi , Suriya Gunasekar , David Sontag , Joydeep Ghosh

This paper provides a theoretical support for clustering aspect of the nonnegative matrix factorization (NMF). By utilizing the Karush-Kuhn-Tucker optimality conditions, we show that NMF objective is equivalent to graph clustering…

Machine Learning · Computer Science 2011-12-20 Andri Mirzal

Non-negative Matrix Factorization (NMF) is a popular tool for data exploration. Bayesian NMF promises to also characterize uncertainty in the factorization. Unfortunately, current inference approaches such as MCMC mix slowly and tend to get…

Machine Learning · Statistics 2016-10-28 M. Arjumand Masood , Finale Doshi-Velez

The nonnegative matrix factorization is a widely used, flexible matrix decomposition, finding applications in biology, image and signal processing and information retrieval, among other areas. Here we present a related matrix factorization.…

Machine Learning · Statistics 2017-12-12 David W Dreisigmeyer

This paper focuses on detection tasks in information extraction, where positive instances are sparsely distributed and models are usually evaluated using F-measure on positive classes. These characteristics often result in deficient…

Computation and Language · Computer Science 2018-05-29 Hongyu Lin , Yaojie Lu , Xianpei Han , Le Sun

In sparse recovery, the unique sparsest solution to an under-determined system of linear equations is of main interest. This scheme is commonly proposed to be applied to signal acquisition. In most cases, the signals are not sparse…

Information Theory · Computer Science 2013-07-16 Henning Zörlein , Faisal Akram , Martin Bossert

Audio segmentation is a key task for many speech technologies, most of which are based on neural networks, usually considered as black boxes, with high-level performances. However, in many domains, among which health or forensics, there is…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Martin Lebourdais , Théo Mariotte , Antonio Almudévar , Marie Tahon , Alfonso Ortega

Non-negative signals form an important class of sparse signals. Many algorithms have already beenproposed to recover such non-negative representations, where greedy and convex relaxed algorithms are among the most popular methods. One fast…

Signal Processing · Electrical Eng. & Systems 2020-06-09 Konstantinos Voulgaris , Mike E. Davies , Mehrdad Yaghoobi

Sparse learning is a very important tool for mining useful information and patterns from high dimensional data. Non-convex non-smooth regularized learning problems play essential roles in sparse learning, and have drawn extensive attentions…

Machine Learning · Computer Science 2020-10-22 Guannan Liang , Qianqian Tong , Jiahao Ding , Miao Pan , Jinbo Bi

In the dictionary learning (or sparse coding) problem, we are given a collection of signals (vectors in $\mathbb{R}^d$), and the goal is to find a "basis" in which the signals have a sparse (approximate) representation. The problem has…

Machine Learning · Computer Science 2019-05-30 Aditya Bhaskara , Wai Ming Tai

Matrix factorization techniques, especially Nonnegative Matrix Factorization (NMF), have been widely used for dimensionality reduction and interpretable data representation. However, existing NMF-based methods are inherently single-scale…

Machine Learning · Computer Science 2026-02-27 Jichao Zhang , Ran Miao , Limin Li

There is growing interest in learning Fourier domain sampling strategies (particularly for magnetic resonance imaging, MRI) using optimization approaches. For non-Cartesian sampling patterns, the system models typically involve non-uniform…

Image and Video Processing · Electrical Eng. & Systems 2023-02-07 Guanhua Wang , Jeffrey A. Fessler

I consider unsupervised extensions of the fast stepwise linear regression algorithm \cite{efroymson1960multiple}. These extensions allow one to efficiently identify highly-representative feature variable subsets within a given set of…

Machine Learning · Computer Science 2017-06-13 Jonathan Landy

Identifying discrete patterns in binary data is an important dimensionality reduction tool in machine learning and data mining. In this paper, we consider the problem of low-rank binary matrix factorisation (BMF) under Boolean arithmetic.…

Optimization and Control · Mathematics 2021-08-05 Reka A. Kovacs , Oktay Gunluk , Raphael A. Hauser

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates