English
Related papers

Related papers: Accelerating Block Coordinate Descent for Nonnegat…

200 papers

In this manuscript, we introduce a tensor-based approach to Non-Negative Tensor Factorization (NTF). The method entails tensor dimension reduction through the utilization of the Einstein product. To maintain the regularity and sparsity of…

Numerical Analysis · Mathematics 2024-06-18 Anas El Hachimi , Khalide Jbilou , Ahmed Ratnani

In this paper, we propose a general framework to accelerate significantly the algorithms for nonnegative matrix factorization (NMF). This framework is inspired from the extrapolation scheme used to accelerate gradient methods in convex…

Numerical Analysis · Computer Science 2020-01-14 Andersen Man Shun Ang , Nicolas Gillis

We propose inertial versions of block coordinate descent methods for solving non-convex non-smooth composite optimization problems. Our methods possess three main advantages compared to current state-of-the-art accelerated first-order…

Optimization and Control · Mathematics 2020-06-03 Le Thi Khanh Hien , Nicolas Gillis , Panagiotis Patrinos

In this paper, we present several descent methods that can be applied to nonnegative matrix factorization and we analyze a recently developped fast block coordinate method called Rank-one Residue Iteration (RRI). We also give a comparison…

Numerical Analysis · Computer Science 2009-08-25 Ngoc-Diep Ho , Paul Van Dooren , Vincent D. Blondel

Iterative algorithms based on thresholding, feedback and null space tuning (NST+HT+FB) for sparse signal recovery are exceedingly effective and fast, particularly for large scale problems. The core algorithm is shown to converge in finitely…

Numerical Analysis · Mathematics 2017-11-08 Ningning Han , Shidong Li , Zhanjie Song , Hong Wang

With the advancements in computing technology and web-based applications, data is increasingly generated in multi-dimensional form. This data is usually sparse due to the presence of a large number of users and fewer user interactions. To…

Machine Learning · Computer Science 2020-03-10 Thirunavukarasu Balasubramaniam , Richi Nayak , Chau Yuen

Nonnegative matrix factorization (NMF) is a powerful technique for dimension reduction, extracting latent factors and learning part-based representation. For large datasets, NMF performance depends on some major issues: fast algorithms,…

Optimization and Control · Mathematics 2015-07-01 Duy-Khuong Nguyen , Tu-Bao Ho

In this work we show that randomized (block) coordinate descent methods can be accelerated by parallelization when applied to the problem of minimizing the sum of a partially separable smooth convex function and a simple separable convex…

Optimization and Control · Mathematics 2013-11-27 Peter Richtárik , Martin Takáč

Tensor decomposition is an effective tool for learning multi-way structures and heterogeneous features from high-dimensional data, such as the multi-view images and multichannel electroencephalography (EEG) signals, are often represented by…

Machine Learning · Computer Science 2022-06-29 Wanguang Yin , Youzhi Qu , Zhengming Ma , Quanying Liu

This work presents a parallel variant of the algorithm introduced in [Acceleration of block coordinate descent methods with identification strategies Comput. Optim. Appl. 72(3):609--640, 2019] to minimize the sum of a partially separable…

Optimization and Control · Mathematics 2025-08-06 Ronaldo Lopes , Sandra A. Santos , Paulo J. S. Silva

Hindsight Experience Replay (HER) is one of the efficient algorithm to solve Reinforcement Learning tasks related to sparse rewarded environments.But due to its reduced sample efficiency and slower convergence HER fails to perform…

Machine Learning · Computer Science 2020-10-14 Dhuruva Priyan G M , Abhik Singla , Shalabh Bhatnagar

The estimation of correspondences between two images resp. point sets is a core problem in computer vision. One way to formulate the problem is graph matching leading to the quadratic assignment problem which is NP-hard. Several so called…

Computer Vision and Pattern Recognition · Computer Science 2015-05-01 Quynh Nguyen , Antoine Gautier , Matthias Hein

The block-term tensor decomposition model with multilinear rank-$(L_r,L_r,1)$ terms (or, the "LL1 tensor decomposition" in short) offers a valuable alternative for hyperspectral unmixing (HU) under the linear mixture model. Particularly,…

Signal Processing · Electrical Eng. & Systems 2022-05-10 Meng Ding , Xiao Fu , Xi-Le Zhao

The kernel herding algorithm is used to construct quadrature rules in a reproducing kernel Hilbert space (RKHS). While the computational efficiency of the algorithm and stability of the output quadrature formulas are advantages of this…

Numerical Analysis · Mathematics 2022-07-18 Kazuma Tsuji , Ken'ichiro Tanaka

Block coordinate descent is an optimization paradigm that iteratively updates one block of variables at a time, making it quite amenable to big data applications due to its scalability and performance. Its convergence behavior has been…

Optimization and Control · Mathematics 2023-10-13 Liangzu Peng , René Vidal

Best rank-one approximation is one of the most fundamental tasks in tensor computation. In order to fully exploit modern multi-core parallel computers, it is necessary to develop decoupling algorithms for computing the best rank-one…

Numerical Analysis · Mathematics 2024-03-05 Chuanfu Xiao , Zeyu Li , Chao Yang

For the high dimensional data representation, nonnegative tensor ring (NTR) decomposition equipped with manifold learning has become a promising model to exploit the multi-dimensional structure and extract the feature from tensor data.…

Machine Learning · Computer Science 2021-09-07 Xinhai Zhao , Yuyuan Yu , Guoxu Zhou , Qibin Zhao , Weijun Sun

This article utilizes the projected gradient method (PG) for a non-negative matrix factorization problem (NMF), where one or both matrix factors must have orthonormal columns or rows. We penalise the orthonormality constraints and apply the…

Optimization and Control · Mathematics 2020-03-24 Soodabeh Asadi , Janez Povh

Symmetric nonnegative matrix factorization (SNMF) is equivalent to computing a symmetric nonnegative low rank approximation of a data similarity matrix. It inherits the good data interpretability of the well-known nonnegative matrix…

Numerical Analysis · Computer Science 2017-10-11 Qingjiang Shi , Haoran Sun , Songtao Lu , Mingyi Hong , Meisam Razaviyayn

This paper studies the computational and statistical aspects of quantile and pseudo-Huber tensor decomposition. The integrated investigation of computational and statistical issues of robust tensor decomposition poses challenges due to the…

Statistics Theory · Mathematics 2023-09-07 Yinan Shen , Dong Xia
‹ Prev 1 2 3 10 Next ›