English
Related papers

Related papers: Sequential Dimensionality Reduction for Extracting…

200 papers

Nonnegative Matrix Factorization (NMF) with Kullback-Leibler Divergence (NMF-KL) is one of the most significant NMF problems and equivalent to Probabilistic Latent Semantic Indexing (PLSI), which has been successfully applied in many…

Optimization and Control · Mathematics 2016-04-15 Duy Khuong Nguyen , Tu Bao Ho

We consider the problem of accurately and efficiently querying a remote server to retrieve information about images captured by a mobile device. In addition to reduced transmission overhead and computational complexity, the retrieval…

Computer Vision and Pattern Recognition · Computer Science 2016-05-10 Jacob Chakareski , Immanuel Manohar , Shantanu Rane

Fully-supervised CNN-based approaches for learning local image descriptors have shown remarkable results in a wide range of geometric tasks. However, most of them require per-pixel ground-truth keypoint correspondence data which is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Iaroslav Melekhov , Zakaria Laskar , Xiaotian Li , Shuzhe Wang , Juho Kannala

In the large-scale image retrieval task, the two most important requirements are the discriminability of image representations and the efficiency in computation and storage of representations. Regarding the former requirement, Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Thanh-Toan Do , Tuan Hoang , Dang-Khoa Le Tan , Huu Le , Tam V. Nguyen , Ngai-Man Cheung

Non-negative matrix factorization (NMF) has proved effective in many clustering and classification tasks. The classic ways to measure the errors between the original and the reconstructed matrix are $l_2$ distance or Kullback-Leibler (KL)…

Computer Vision and Pattern Recognition · Computer Science 2014-05-12 Le Li , Jianjun Yang , Kaili Zhao , Yang Xu , Honggang Zhang , Zhuoyi Fan

Nonnegative matrix factorization (NMF) has found many applications including topic modeling and document analysis. Hierarchical NMF (HNMF) variants are able to learn topics at various levels of granularity and illustrate their hierarchical…

Machine Learning · Computer Science 2022-02-16 Joshua Vendrow , Jamie Haddock , Deanna Needell

Dimensionality reduction techniques play an essential role in data analytics, signal processing and machine learning. Dimensionality reduction is usually performed in a preprocessing stage that is separate from subsequent data analysis,…

Machine Learning · Computer Science 2016-12-21 Bo Yang , Xiao Fu , Nicholas D. Sidiropoulos

Generalized Category Discovery (GCD) aims to classify both base and novel images using labeled base data. However, current approaches inadequately address the intrinsic optimization of the co-occurrence matrix $\bar{A}$ based on cosine…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Zhong Ji , Shuo Yang , Jingren Liu , Yanwei Pang , Jungong Han

Bayesian Non-negative Matrix Factorization (NMF) is a promising approach for understanding uncertainty and structure in matrix data. However, a large volume of applied work optimizes traditional non-Bayesian NMF objectives that fail to…

Machine Learning · Statistics 2018-03-19 M. Arjumand Masood , Finale Doshi-Velez

Dimensionality reduction is a fundamental task in modern data science. Several projection methods specifically tailored to take into account the non-linearity of the data via local embeddings have been proposed. Such methods are often based…

Machine Learning · Statistics 2026-01-28 Antonio Di Noia , Federico Ravenda , Antonietta Mira

This paper provides a theoretical explanation on the clustering aspect of nonnegative matrix factorization (NMF). We prove that even without imposing orthogonality nor sparsity constraint on the basis and/or coefficient matrix, NMF still…

Machine Learning · Computer Science 2010-06-15 Andri Mirzal , Masashi Furukawa

We present a novel, domain-agnostic, model-independent, unsupervised, and universally applicable Machine Learning approach for dimensionality reduction based on the principles of algorithmic complexity. Specifically, but without loss of…

Data Structures and Algorithms · Computer Science 2025-05-06 Hector Zenil , Narsis A. Kiani , Alyssa Adams , Felipe S. Abrahão , Antonio Rueda-Toicen , Allan A. Zea , Luan Ozelim , Jesper Tegnér

Sparse matrix factorization is a popular tool to obtain interpretable data decompositions, which are also effective to perform data completion or denoising. Its applicability to large datasets has been addressed with online and randomized…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gaël Varoquaux

Non-negative Matrix Factorization (NMF) asks to decompose a (entry-wise) non-negative matrix into the product of two smaller-sized nonnegative matrices, which has been shown intractable in general. In order to overcome this issue, the…

Data Structures and Algorithms · Computer Science 2019-07-15 Zhihuai Chen , Yinan Li , Xiaoming Sun , Pei Yuan , Jialin Zhang

Nonnegative matrix factorization (NMF) has been widely studied in recent years due to its effectiveness in representing nonnegative data with parts-based representations. For NMF, a sparser solution implies better parts-based…

Machine Learning · Computer Science 2022-04-25 Chong Peng , Yiqun Zhang , Yongyong Chen , Zhao Kang , Chenglizhao Chen , Qiang Cheng

In this paper, we propose a data representation model that demonstrates hierarchical feature learning using nsNMF. We extend unit algorithm into several layers. Experiments with document and image data successfully discovered feature…

Machine Learning · Computer Science 2013-03-19 Hyun Ah Song , Soo-Young Lee

Few-shot learning (FSL) aims to classify images under low-data regimes, where the conventional pooled global feature is likely to lose useful local characteristics. Recent work has achieved promising performances by using deep descriptors.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Yang Liu , Tu Zheng , Jie Song , Deng Cai , Xiaofei He

The brain uses positive signals as a means of signaling. Forward interactions in the early visual cortex are also positive, realized by excitatory synapses. Only local interactions also include inhibition. Non-negative matrix factorization…

Machine Learning · Computer Science 2025-03-27 Mahbod Nouri , David Rotermund , Alberto Garcia-Ortiz , Klaus R. Pawelzik

Non-negative matrix factorization (NMF) is a popular unsupervised learning approach widely used in image clustering. However, in real-world clustering scenarios, most existing NMF methods are highly sensitive to noise corruption and are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Jingjing Liu , Nian Wu , Xianchao Xiu , Jianhua Zhang

Symmetric nonnegative matrix factorization (SNMF) is equivalent to computing a symmetric nonnegative low rank approximation of a data similarity matrix. It inherits the good data interpretability of the well-known nonnegative matrix…

Numerical Analysis · Computer Science 2017-10-11 Qingjiang Shi , Haoran Sun , Songtao Lu , Mingyi Hong , Meisam Razaviyayn