English
Related papers

Related papers: A Converged Algorithm for Tikhonov Regularized Non…

200 papers

Semi-supervised symmetric non-negative matrix factorization (SNMF) utilizes the available supervisory information (usually in the form of pairwise constraints) to improve the clustering ability of SNMF. The previous methods introduce the…

Machine Learning · Computer Science 2024-10-29 Yuheng Jia , Jia-Nan Li , Wenhui Wu , Ran Wang

Traditional nonnegative matrix factorization (NMF) learns a new feature representation on the whole data space, which means treating all features equally. However, a subspace is often sufficient for accurate representation in practical…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Junhang Li , Jiao Wei , Can Tong , Tingting Shen , Yuchen Liu , Chen Li , Shouliang Qi , Yudong Yao , Yueyang Teng

For approximately solving linear ill-posed problems in Hilbert spaces, we investigate the regularization properties of the aggregation method and the RatCG method. These recent algorithms use previously calculated solutions of Tikhonov…

Numerical Analysis · Mathematics 2026-01-16 Stefan Kindermann

In this work, we propose a new criterion for choosing the regularization parameter in Tikhonov regularization when the noise is white Gaussian. The criterion minimizes a lower bound of the predictive risk, when both data norm and noise…

Numerical Analysis · Mathematics 2020-06-24 Federico Benvenuto , Bangti Jin

We propose an efficient matrix rank reduction method for non-negative matrices, whose time complexity is quadratic in the number of rows or columns of a matrix. Our key insight is to formulate rank reduction as a mean-field approximation by…

Machine Learning · Statistics 2021-03-05 Kazu Ghalamkari , Mahito Sugiyama

Two new hybrid algorithms are proposed for large-scale linear discrete ill-posed problems in general-form regularization. They are both based on Krylov subspace inner-outer iterative algorithms. At each iteration, they need to solve a…

Numerical Analysis · Mathematics 2024-09-02 Yanfei Yang

Regularized kernel methods such as support vector machines (SVM) and support vector regression (SVR) constitute a broad and flexible class of methods which are theoretically well investigated and commonly used in nonparametric…

Methodology · Statistics 2013-05-07 Robert Hable

Fractional Tikhonov regularization methods have been recently proposed to reduce the oversmoothing property of the Tikhonov regularization in standard form, in order to preserve the details of the approximated solution. Their regularization…

Numerical Analysis · Mathematics 2020-09-07 Davide Bianchi , Alessandro Buccini , Marco Donatelli , Stefano Serra-Capizzano

Nonnegative matrix factorization (NMF) is a powerful tool in data exploratory analysis by discovering the hidden features and part-based patterns from high-dimensional data. NMF and its variants have been successfully applied into diverse…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Lihua Zhang , Shihua Zhang

We propose a new method to enforce priors on the solution of the nonnegative matrix factorization (NMF). The proposed algorithm can be used for denoising or single-channel source separation (SCSS) applications. The NMF solution is guided to…

Machine Learning · Computer Science 2013-03-01 Emad M. Grais , Hakan Erdogan

Non-negative matrix factorization (NMF) is a natural model of admixture and is widely used in science and engineering. A plethora of algorithms have been developed to tackle NMF, but due to the non-convex nature of the problem, there is…

Machine Learning · Computer Science 2015-07-09 Rong Ge , James Zou

We present a fundamentally new regularization method for the solution of the Fredholm integral equation of the first kind, in which we incorporate solutions corresponding to a range of Tikhonov regularizers into the end result. This method…

Methodology · Statistics 2022-01-24 Chuan Bi , Miao-jung Yvonne Ou , Mustapha Bouhrara , Richard G. Spencer

Referring back to the original text in the course of hierarchical learning is a common human trait that ensures the right direction of learning. The models developed based on the concept of Non-negative Matrix Factorization (NMF), in this…

Machine Learning · Computer Science 2024-05-24 Prasun Dutta , Rajat K. De

This paper derives a new class of adaptive regularization parameter choice strategies that can be effectively and efficiently applied when regularizing large-scale linear inverse problems by combining standard Tikhonov regularization and…

Numerical Analysis · Mathematics 2019-07-15 Silvia Gazzola , Malena Sabate Landman

Nonnegative matrix factorization (NMF) seeks a low-rank approximation $X \approx UV^T$ with nonnegative factors and is commonly solved using interior methods that enforce feasibility throughout optimization. We show that such…

Machine Learning · Computer Science 2026-05-20 Qiujing Lu , Tonmoy Monsoor , Ehsan Ebrahimzadeh , Kartik Sharma , Vwani Roychowdhury

In this paper, we investigate iterative methods that are based on sampling of the data for computing Tikhonov-regularized solutions. We focus on very large inverse problems where access to the entire data set is not possible all at once…

Numerical Analysis · Mathematics 2018-12-18 J. Tanner Slagel , Julianne Chung , Matthias Chung , David Kozak , Luis Tenorio

We propose a new variant of nonnegative matrix factorization (NMF), combining separability and sparsity assumptions. Separability requires that the columns of the first NMF factor are equal to columns of the input matrix, while sparsity…

Machine Learning · Computer Science 2020-06-16 Nicolas Nadisic , Arnaud Vandaele , Jeremy E. Cohen , Nicolas Gillis

To deal with the ill-posed nature of the inverse heat conduction problem (IHCP), the regularization parameter alpha can be incorporated into a minimization problem, which is known as Tikhonov regularization method, a popular technique to…

Numerical Analysis · Mathematics 2021-10-05 C. Ahn , C. Park , DI. Park , JG. Kim

Matrix factorization is a popular approach for large-scale matrix completion. The optimization formulation based on matrix factorization can be solved very efficiently by standard algorithms in practice. However, due to the non-convexity…

Machine Learning · Computer Science 2016-11-18 Ruoyu Sun , Zhi-Quan Luo

Non-Negative Matrix Factorization (NMF) is an unsupervised learning method offering low-rank representations across various domains such as audio processing, biomedical signal analysis, and image recognition. The incorporation of…

Machine Learning · Computer Science 2025-10-09 Yasaman Torabi , Shahram Shirani , James P. Reilly