English
Related papers

Related papers: Bayesian Extensive-Rank Matrix Factorization with …

200 papers

Factor analysis is a way to characterize the relationships between many manifest variables in terms of a smaller number of latent variables (i.e., factors). Particularly, in exploratory factor analysis (EFA), researchers consider various…

Methodology · Statistics 2025-05-06 Justin Philip Tuazon , Gia Mizrane Abubo , Joemari Olea

This work studies the strong duality of non-convex matrix factorization problems: we show that under certain dual conditions, these problems and its dual have the same optimum. This has been well understood for convex optimization, but…

Data Structures and Algorithms · Computer Science 2018-04-26 Maria-Florina Balcan , Yingyu Liang , David P. Woodruff , Hongyang Zhang

We study the matrix-variate regression problem $Y_i = \sum_{k} \beta_{1k} X_i \beta_{2k}^{\top} + E_i$ for $i=1,2\dots,n$ in the high dimensional regime wherein the response $Y_i$ are matrices whose dimensions $p_{1}\times p_{2}$ outgrow…

Machine Learning · Statistics 2024-05-01 Yin-Jen Chen , Minh Tang

The matrix factor model has drawn growing attention for its advantage in achieving two-directional dimension reduction simultaneously for matrix-structured observations. In this paper, we propose a simple iterative least squares algorithm…

Methodology · Statistics 2023-08-02 Yong He , Ran Zhao , Wen-Xin Zhou

The two-sided matrix regression model $Y = A^*X B^* +E$ aims at predicting $Y$ by taking into account both linear links between column features of $X$, via the unknown matrix $B^*$, and also among the row features of $X$, via the matrix…

Statistics Theory · Mathematics 2023-03-09 Nayel Bettache , Cristina Butucea

The ranking problem is to order a collection of units by some unobserved parameter, based on observations from the associated distribution. This problem arises naturally in a number of contexts, such as business, where we may want to rank…

Statistics Theory · Mathematics 2019-09-04 Toby Kenney

With the recent success of representation learning methods, which includes deep learning as a special case, there has been considerable interest in developing representation learning techniques that can incorporate known physical…

Machine Learning · Computer Science 2021-09-10 Harsha Vardhan Tetali , Joel B. Harley , Benjamin D. Haeffele

This work proposes a Bayesian inference method for the reduced-order modeling of time-dependent systems. Informed by the structure of the governing equations, the task of learning a reduced-order model from data is posed as a Bayesian…

Numerical Analysis · Mathematics 2023-01-18 Mengwu Guo , Shane A. McQuarrie , Karen E. Willcox

We introduce a covariance matrix estimator that both takes into account the heteroskedasticity of financial returns (by using an exponentially weighted moving average) and reduces the effective dimensionality of the estimation (and hence…

Statistical Mechanics · Physics 2008-12-02 Szilard Pafka , Marc Potters , Imre Kondor

Sparse matrix factorization is the problem of approximating a matrix $\mathbf{Z}$ by a product of $J$ sparse factors $\mathbf{X}^{(J)} \mathbf{X}^{(J-1)} \ldots \mathbf{X}^{(1)}$. This paper focuses on identifiability issues that appear in…

Machine Learning · Computer Science 2021-11-18 Léon Zheng , Elisa Riccietti , Rémi Gribonval

We build upon probabilistic models for Boolean Matrix and Boolean Tensor factorisation that have recently been shown to solve these problems with unprecedented accuracy and to enable posterior inference to scale to Billions of observation.…

Machine Learning · Statistics 2019-07-02 Tammo Rukat , Christopher Yau

We consider probabilistic PCA and related factor models from a Bayesian perspective. These models are in general not identifiable as the likelihood has a rotational symmetry. This gives rise to complicated posterior distributions with…

Machine Learning · Statistics 2019-05-14 Rajbir S. Nirwan , Nils Bertschinger

We study the performance of a Bayesian statistician who estimates a rank-one signal corrupted by non-symmetric rotationally invariant noise with a generic distribution of singular values. As the signal-to-noise ratio and the noise structure…

Information Theory · Computer Science 2023-02-09 Teng Fu , YuHao Liu , Jean Barbier , Marco Mondelli , ShanSuo Liang , TianQi Hou

Random butterfly matrices were introduced by Parker in 1995 to remove the need for pivoting when using Gaussian elimination. The growing applications of butterfly matrices have often eclipsed the mathematical understanding of how or why…

Numerical Analysis · Mathematics 2023-09-12 John Peca-Medlin , Thomas Trogdon

In computational inverse problems, it is common that a detailed and accurate forward model is approximated by a computationally less challenging substitute. The model reduction may be necessary to meet constraints in computing time when…

Methodology · Statistics 2018-02-14 Daniela Calvetti , Matthew M. Dunlop , Erkki Somersalo , Andrew M. Stuart

To precondition a large and sparse linear system, two direct methods for approximate factoring of the inverse are devised. The algorithms are fully parallelizable and appear to be more robust than the iterative methods suggested for the…

Numerical Analysis · Mathematics 2012-08-20 Mikko Byckling , Marko Huhtanen

We address the fundamental problem of selection under uncertainty by modeling it from the perspective of Bayesian persuasion. In our model, a decision maker with imperfect information always selects the option with the highest expected…

Computer Science and Game Theory · Computer Science 2024-10-16 Siddhartha Banerjee , Kamesh Munagala , Yiheng Shen , Kangning Wang

This paper proposes new estimators of the number of factors for a generalised factor model with more relaxed assumptions than the strict factor model. Under the framework of large cross-sections $N$ and large time dimensions $T$, we first…

Methodology · Statistics 2022-03-29 Rui Wang , Dandan Jiang

Bi-factor analysis is a form of confirmatory factor analysis widely used in psychological and educational measurement. The use of a bi-factor model requires the specification of an explicit bi-factor structure on the relationship between…

Methodology · Statistics 2025-05-21 Jiawei Qiao , Yunxiao Chen , Zhiliang Ying

We present a comparison between various algorithms of inference of covariance and precision matrices in small datasets of real vectors, of the typical length and dimension of human brain activity time series retrieved by functional Magnetic…

Statistical Mechanics · Physics 2023-02-07 Miguel Ibáñez-Berganza , Carlo Lucibello , Francesca Santucci , Tommaso Gili , Andrea Gabrielli