中文
相关论文

相关论文: Memory-Efficient Convex Optimization for Self-Dict…

200 篇论文

In this paper, we consider the symmetric multi-type non-negative matrix tri-factorization problem (SNMTF), which attempts to factorize several symmetric non-negative matrices simultaneously. This can be considered as a generalization of the…

数据结构与算法 · 计算机科学 2020-12-14 Rok Hribar , Timotej Hrga , Gregor Papa , Gašper Petelin , Janez Povh , Nataša Pržulj , Vida Vukašinović

Nonnegative matrix factorization (NMF) is a popular model in the field of pattern recognition. It aims to find a low rank approximation for nonnegative data M by a product of two nonnegative matrices W and H. In general, NMF is NP-hard to…

机器学习 · 计算机科学 2021-09-07 Junjun Pan , Michael K. Ng

Nonnegative matrix factorization (NMF) has become a widely used tool for the analysis of high-dimensional data as it automatically extracts sparse and meaningful features from a set of nonnegative data vectors. We first illustrate this…

机器学习 · 统计学 2014-12-10 Nicolas Gillis

This paper considers distributed stochastic optimization, in which a number of agents cooperate to optimize a global objective function through local computations and information exchanges with neighbors over a network. Stochastic…

最优化与控制 · 数学 2022-08-09 Jie Hou , Xianlin Zeng , Gang Wang , Jian Sun , Jie Chen

We introduce a new projection-free (Frank-Wolfe) method for optimizing structured nonconvex functions that are expressed as a difference of two convex functions. This problem class subsumes smooth nonconvex minimization, positioning our…

最优化与控制 · 数学 2025-12-01 Hoomaan Maskan , Yikun Hou , Suvrit Sra , Alp Yurtsever

Non-negative Matrix Factorization (NMF) is a powerful technique for analyzing regularly-sampled data, i.e., data that can be stored in a matrix. For audio, this has led to numerous applications using time-frequency (TF) representations like…

音频与语音处理 · 电气工程与系统科学 2025-07-10 Krishna Subramani , Paris Smaragdis , Takuya Higuchi , Mehrez Souden

Frank-Wolfe algorithms for convex minimization have recently gained considerable attention from the Optimization and Machine Learning communities, as their properties make them a suitable choice in a variety of applications. However, as…

机器学习 · 统计学 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Johan Suykens

Symmetric nonnegative matrix factorization (SymNMF) has important applications in data analytics problems such as document clustering, community detection and image segmentation. In this paper, we propose a novel nonconvex variable…

最优化与控制 · 数学 2017-03-27 Songtao Lu , Mingyi Hong , Zhengdao Wang

In this paper, we provide novel algorithms with identifiability guarantees for simplex-structured matrix factorization (SSMF), a generalization of nonnegative matrix factorization. Current state-of-the-art algorithms that provide…

机器学习 · 计算机科学 2021-05-12 Maryam Abdolali , Nicolas Gillis

We investigate a class of nonconvex optimization problems characterized by a feasible set consisting of level-bounded nonconvex regularizers, with a continuously differentiable objective. We propose a novel hybrid approach to tackle such…

最优化与控制 · 数学 2024-10-28 Xiangyu Yang , Hao Wang , Yichen Zhu , Xiao Wang

We study Frank-Wolfe methods for nonconvex stochastic and finite-sum optimization problems. Frank-Wolfe methods (in the convex case) have gained tremendous recent interest in machine learning and optimization communities due to their…

最优化与控制 · 数学 2016-08-01 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola

A robust algorithm for non-negative matrix factorization (NMF) is presented in this paper with the purpose of dealing with large-scale data, where the separability assumption is satisfied. In particular, we modify the Linear Programming…

机器学习 · 统计学 2014-01-10 Jason Gejie Liu , Shuchin Aeron

The Frank-Wolfe (FW) method, which implements efficient linear oracles that minimize linear approximations of the objective function over a fixed compact convex set, has recently received much attention in the optimization and machine…

最优化与控制 · 数学 2024-01-19 Liaoyuan Zeng , Yongle Zhang , Guoyin Li , Ting Kei Pong , Xiaozhou Wang

Nonnegative Matrix Factorization (NMF) is a versatile and powerful tool for discovering latent structures in data matrices, with many variations proposed in the literature. Recently, Leplat et al.\@ (2019) introduced a minimum-volume NMF…

机器学习 · 统计学 2023-09-26 Duc Toan Nguyen , Eric C. Chi

Although many techniques have been applied to matrix factorization (MF), they may not fully exploit the feature structure. In this paper, we incorporate the grouping effect into MF and propose a novel method called Robust Matrix…

机器学习 · 计算机科学 2021-07-09 Haiyan Jiang , Shuyu Li , Luwei Zhang , Haoyi Xiong , Dejing Dou

Robust matrix factorization (RMF), which uses the $\ell_1$-loss, often outperforms standard matrix factorization using the $\ell_2$-loss, particularly when outliers are present. The state-of-the-art RMF solver is the RMF-MM algorithm,…

数值分析 · 计算机科学 2018-09-25 Quanming Yao , James T. Kwok

Recovering matrices from compressive and grossly corrupted observations is a fundamental problem in robust statistics, with rich applications in computer vision and machine learning. In theory, under certain conditions, this problem can be…

最优化与控制 · 数学 2017-05-31 Cun Mu , Yuqian Zhang , John Wright , Donald Goldfarb

Reducing the interference noise in a monaural noisy speech signal has been a challenging task for many years. Compared to traditional unsupervised speech enhancement methods, e.g., Wiener filtering, supervised approaches, such as algorithms…

声音 · 计算机科学 2017-09-19 Nasser Mohammadiha , Paris Smaragdis , Arne Leijon

Training a Support Vector Machine (SVM) requires the solution of a quadratic programming problem (QP) whose computational complexity becomes prohibitively expensive for large scale datasets. Traditional optimization methods cannot be…

机器学习 · 计算机科学 2014-01-29 Emanuele Frandi , Ricardo Nanculef , Maria Grazia Gasparo , Stefano Lodi , Claudio Sartori

Nonnegative matrix factorization (NMF) has been actively investigated and used in a wide range of problems in the past decade. A significant amount of attention has been given to develop NMF algorithms that are suitable to model time series…

机器学习 · 计算机科学 2017-09-04 Nasser Mohammadiha , Paris Smaragdis , Ghazaleh Panahandeh , Simon Doclo