English
Related papers

Related papers: Sparse multivariate factorization by mean of a few…

200 papers

In this paper, we develop a parameterized proximal point algorithm (P-PPA) for solving a class of separable convex programming problems subject to linear and convex constraints. The proposed algorithm is provable to be globally convergent…

Optimization and Control · Mathematics 2018-12-11 Jianchao Bai , Hongchao Zhang , Jicheng Li

Square matrices appear in many machine learning problems and models. Optimization over a large square matrix is expensive in memory and in time. Therefore an economic approximation is needed. Conventional approximation approaches factorize…

Machine Learning · Computer Science 2021-09-20 Ruslan Khalitov , Tong Yu , Lei Cheng , Zhirong Yang

The classical sparse parameter identification methods are usually based on the iterative basis selection such as greedy algorithms, or the numerical optimization of regularized cost functions such as LASSO and Bayesian posterior probability…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Yanxin Fu , Wenxiao Zhao

We prove a theorem on algebraic osculation and we apply our result to the Computer Algebra problem of polynomial factorization. We consider X a smooth completion of the complex plane and D an effective divisor supported on the boundary of…

Algebraic Geometry · Mathematics 2009-04-14 Martin Weimann

We present and analyze a simple, two-step algorithm to approximate the optimal solution of the sparse PCA problem. Our approach first solves a L1 penalized version of the NP-hard sparse PCA optimization problem and then uses a randomized…

Data Structures and Algorithms · Computer Science 2016-11-24 Kimon Fountoulakis , Abhisek Kundu , Eugenia-Maria Kontopoulou , Petros Drineas

We consider the problem of multivariate regression in a setting where the relevant predictors could be shared among different responses. We propose an algorithm which decomposes the coefficient matrix into the product of a long matrix and a…

Machine Learning · Statistics 2016-03-02 Milad Kharratzadeh , Mark Coates

Sparse linear regression, which entails finding a sparse solution to an underdetermined system of linear equations, can formally be expressed as an $l_0$-constrained least-squares problem. The Orthogonal Least-Squares (OLS) algorithm…

Machine Learning · Statistics 2016-08-01 Abolfazl Hashemi , Haris Vikalo

The works presented in this habilitation concern the algorithmics of polynomials. This is a central topic in computer algebra, with numerous applications both within and outside the field - cryptography, error-correcting codes, etc. For…

Symbolic Computation · Computer Science 2026-03-09 Bruno Grenet

We introduce a method and an algorithm for computing the weighted Moore-Penrose inverse of multiple-variable polynomial matrix and the related algorithm which is appropriated for sparse polynomial matrices. These methods and algorithms are…

Symbolic Computation · Computer Science 2011-04-12 Petković , M. D. , Stanimirović , P. S. , Tasić , M. B

In this paper, we consider the sparse eigenvalue problem wherein the goal is to obtain a sparse solution to the generalized eigenvalue problem. We achieve this by constraining the cardinality of the solution to the generalized eigenvalue…

Machine Learning · Statistics 2009-10-13 Bharath Sriperumbudur , David Torres , Gert Lanckriet

In this paper we propose a computationally efficient algorithm for on-line variable selection in multivariate regression problems involving high dimensional data streams. The algorithm recursively extracts all the latent factors of a…

Machine Learning · Statistics 2009-02-10 Brian McWilliams , Giovanni Montana

Sparse Principal Component Analysis (sPCA) is a cardinal technique for obtaining combinations of features, or principal components (PCs), that explain the variance of high-dimensional datasets in an interpretable manner. This involves…

Optimization and Control · Mathematics 2025-12-02 Ryan Cory-Wright , Jean Pauphilet

Dimension reduction algorithms aim to discover latent variables which describe underlying structures in high-dimensional data. Methods such as factor analysis and principal component analysis have the downside of not offering much…

Applications · Statistics 2021-12-23 Yong See Foo , Heejung Shim

An input- and output-sensitive GCD algorithm for multi-variate polynomials over finite fields is proposed by combining the modular method with the Ben-Or/Tiwari sparse interpolation. The bit complexity of the algorithm is given and is…

Symbolic Computation · Computer Science 2022-07-29 Qiao-Long Huang , Xiao-Shan Gao

Matrix factorization exploits the idea that, in complex high-dimensional data, the actual signal typically lies in lower-dimensional structures. These lower dimensional objects provide useful insight, with interpretability favored by sparse…

Methodology · Statistics 2022-12-14 Lorenzo Schiavon , Bernardo Nipoti , Antonio Canale

We consider the estimation of a sparse factor model where the factor loading matrix is assumed sparse. The estimation problem is reformulated as a penalized M-estimation criterion, while the restrictions for identifying the factor loading…

Statistics Theory · Mathematics 2025-01-23 Benjamin Poignard , Yoshikazu Terada

Sparse matrix factorization is the problem of approximating a matrix $\mathbf{Z}$ by a product of $J$ sparse factors $\mathbf{X}^{(J)} \mathbf{X}^{(J-1)} \ldots \mathbf{X}^{(1)}$. This paper focuses on identifiability issues that appear in…

Machine Learning · Computer Science 2021-11-18 Léon Zheng , Elisa Riccietti , Rémi Gribonval

In this paper we show how we can compute in a deterministic way the decomposition of a multivariate rational function with a recombination strategy. The key point of our recombination strategy is the used of Darboux polynomials. We study…

Symbolic Computation · Computer Science 2014-02-26 Guillaume Chèze

While existing algorithms may be used to solve a linear system over a general field in matrix-multiplication time, the complexity of constructing a symmetric triangular factorization (LDL) has received relatively little formal study. The…

Numerical Analysis · Mathematics 2025-06-26 Edgar Solomonik

This paper investigates the high-dimensional linear regression with highly correlated covariates. In this setup, the traditional sparsity assumption on the regression coefficients often fails to hold, and consequently many model selection…

Methodology · Statistics 2019-03-26 Jianqing Fan , Bai Jiang , Qiang Sun