English
Related papers

Related papers: Non-negative Factorization of the Occurrence Tenso…

200 papers

We study nonconvex distributed optimization in multi-agent networks with time-varying (nonsymmetric) connectivity. We introduce the first algorithmic framework for the distributed minimization of the sum of a smooth (possibly nonconvex and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-02 Paolo Di Lorenzo , Gesualdo Scutari

We consider the problem of finding the minimizer of a convex function $F: \mathbb R^d \rightarrow \mathbb R$ of the form $F(w) := \sum_{i=1}^n f_i(w) + R(w)$ where a low-rank factorization of $\nabla^2 f_i(w)$ is readily available. We…

Optimization and Control · Mathematics 2016-07-07 Peng Xu , Jiyan Yang , Farbod Roosta-Khorasani , Christopher Ré , Michael W. Mahoney

Non-negative Matrix Factorization (NMF) is an effective algorithm for multivariate data analysis, including applications to feature selection, pattern recognition, and computer vision. Its variant, Semi-Nonnegative Matrix Factorization…

Numerical Analysis · Mathematics 2024-10-23 Anthony Rhodes , Bin Jiang , Jenny Jiang

Recovering low-rank and sparse matrices from incomplete or corrupted observations is an important problem in machine learning, statistics, bioinformatics, computer vision, as well as signal and image processing. In theory, this problem can…

Machine Learning · Computer Science 2014-09-04 Fanhua Shang , Yuanyuan Liu , Hanghang Tong , James Cheng , Hong Cheng

Training neural networks is a challenging non-convex optimization problem, and backpropagation or gradient descent can get stuck in spurious local optima. We propose a novel algorithm based on tensor decomposition for guaranteed training of…

Machine Learning · Computer Science 2016-01-13 Majid Janzamin , Hanie Sedghi , Anima Anandkumar

Existing nonnegative matrix factorization methods focus on learning global structure of the data to construct basis and coefficient matrices, which ignores the local structure that commonly exists among data. In this paper, we propose a new…

Machine Learning · Computer Science 2019-07-10 Chong Peng , Zhao Kang , Chenglizhao Chen , Qiang Cheng

Nonnegative matrix factorization (NMF) is a popular method used to reduce dimensionality in data sets whose elements are nonnegative. It does so by decomposing the data set of interest, $\mathbf{X}$, into two lower rank nonnegative matrices…

Methodology · Statistics 2021-07-05 Phillip Shreeves , Jeffrey L. Andrews , Xinchen Deng , Ramie Ali-Adeeb , Andrew Jirasek

Decompositions of tensors into factor matrices, which interact through a core tensor, have found numerous applications in signal processing and machine learning. A more general tensor model which represents data as an ordered network of…

Numerical Analysis · Computer Science 2016-09-30 Anh-Huy Phan , Andrzej Cichocki , Andre Uschmajew , Petr Tichavsky , George Luta , Danilo Mandic

We introduce a probabilistic model with implicit norm regularization for learning nonnegative matrix factorization (NMF) that is commonly used for predicting missing values and finding hidden patterns in the data, in which the matrix…

Machine Learning · Computer Science 2022-08-23 Jun Lu , Christine P. Chai

Firms earning prediction plays a vital role in investment decisions, dividends expectation, and share price. It often involves multiple tensor-compatible datasets with non-linear multi-way relationships, spatiotemporal structures, and…

Machine Learning · Computer Science 2021-09-07 Ajim Uddin , Dan Zhou , Xinyuan Tao , Chia-Ching Chou , Dantong Yu

Non-negative matrix factorization (NMF) is the problem of determining two non-negative low rank factors $W$ and $H$, for the given input matrix $A$, such that $A \approx W H$. NMF is a useful tool for many applications in different domains…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-01 Ramakrishnan Kannan , Grey Ballard , Haesun Park

This work proposes a new algorithm for automated and simultaneous phenotyping of multiple co-occurring medical conditions, also referred as comorbidities, using clinical notes from the electronic health records (EHRs). A basic latent factor…

Machine Learning · Statistics 2016-09-21 Shalmali Joshi , Suriya Gunasekar , David Sontag , Joydeep Ghosh

Anomaly detection in road networks is vital for traffic management and emergency response. However, existing approaches do not directly address multiple anomaly types. We propose a tensor-based spatio-temporal model for detecting multiple…

Physics and Society · Physics 2019-10-31 Ming Xu , Jianping Wu , Haohan Wang , Mengxin Cao

Feature selection by maximizing high-order mutual information between the selected feature vector and a target variable is the gold standard in terms of selecting the best subset of relevant features that maximizes the performance of…

Machine Learning · Computer Science 2022-10-19 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

We study the problem of selecting limited features to observe such that models trained on them can perform well simultaneously across multiple subpopulations. This problem has applications in settings where collecting each feature is…

Machine Learning · Computer Science 2025-10-27 Maitreyi Swaroop , Tamar Krishnamurti , Bryan Wilder

This paper addresses the problem of localization, which is inherently non-convex and non-smooth in a federated setting where the data is distributed across a multitude of devices. Due to the decentralized nature of federated environments,…

Machine Learning · Computer Science 2023-09-04 Reza Mirzaeifard , Naveen K. D. Venkategowda , Stefan Werner

This paper aims to propose and theoretically analyze a new distributed scheme for sparse linear regression and feature selection. The primary goal is to learn the few causal features of a high-dimensional dataset based on noisy observations…

Machine Learning · Statistics 2021-11-05 Hanie Barghi , Amir Najafi , Seyed Abolfazl Motahari

We examine three non-negative matrix factorization techniques; L2-norm, L1-norm, and L2,1-norm. Our aim is to establish the performance of these different approaches, and their robustness in real-world applications such as feature selection…

Machine Learning · Computer Science 2021-06-07 Alex Díaz , Damian Steele

We consider convex and nonconvex constrained optimization with a partially separable objective function: agents minimize the sum of local objective functions, each of which is known only by the associated agent and depends on the variables…

Optimization and Control · Mathematics 2020-10-20 Loris Cannelli , Francisco Facchinei , Gesualdo Scutari , Vyacheslav Kungurtsev

In this paper, we study transfer learning for high-dimensional factor-augmented sparse linear models, motivated by applications in economics and finance where strongly correlated predictors and latent factor structures pose major challenges…

Methodology · Statistics 2026-03-23 Bo Fu , Dandan Jiang