English
Related papers

Related papers: Matrix-Variate Regressions and Envelope Models

200 papers

Matrices are said to behave as free non-commuting random variables if the action which governs their dynamics constrains only their eigenvalues, i.e. depends on traces of powers of individual matrices. The authors use recently developed…

High Energy Physics - Theory · Physics 2009-10-30 Michael Engelhardt , Shimon Levit

We consider a variant of regression problem, where the correspondence between input and output data is not available. Such shuffled data is commonly observed in many real world problems. Taking flow cytometry as an example, the measuring…

Machine Learning · Computer Science 2021-02-12 Yujia Xie , Yixiu Mao , Simiao Zuo , Hongteng Xu , Xiaojing Ye , Tuo Zhao , Hongyuan Zha

Hierarchical parametric models consisting of observable and latent variables are widely used for unsupervised learning tasks. For example, a mixture model is a representative hierarchical model for clustering. From the statistical point of…

Machine Learning · Statistics 2014-01-24 Keisuke Yamazaki

Deep latent variable models learn condensed representations of data that, hopefully, reflect the inner workings of the studied phenomena. Unfortunately, these latent representations are not statistically identifiable, meaning they cannot be…

Machine Learning · Statistics 2025-06-02 Stas Syrota , Yevgen Zainchkovskyy , Johnny Xi , Benjamin Bloem-Reddy , Søren Hauberg

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

In high dimensional analysis, effects of explanatory variables on responses sometimes rely on certain exposure variables, such as time or environmental factors. In this paper, to characterize the importance of each predictor, we utilize its…

Methodology · Statistics 2018-04-11 Yeqing Zhou , Jingyuan Liu , Zhihui Hao , Liping Zhu

Matrix inversion problems are often encountered in experimental physics, and in particular in high-energy particle physics, under the name of unfolding. The true spectrum of a physical quantity is deformed by the presence of a detector,…

Machine Learning · Statistics 2020-09-08 Pietro Vischia

This paper presents a computationally feasible method to compute rigorous bounds on the interval-generalisation of regression analysis to account for epistemic uncertainty in the output variables. The new iterative method uses machine…

Data Analysis, Statistics and Probability · Physics 2023-02-22 Krasymyr Tretiak , Georg Schollmeyer , Scott Ferson

We develop a variational Bayes approach for dynamic variable selection in high-dimensional regression models with time-varying parameters and predictors that exhibit a predefined group structure. Through comprehensive simulation studies, we…

Methodology · Statistics 2025-04-16 Nicolas Bianco , Mauro Bernardi , Daniele Bianchi

Many inverse problems include nuisance parameters which, while not of direct interest, are required to recover primary parameters. Structure present in these problems allows efficient optimization strategies - a well known example is…

Numerical Analysis · Mathematics 2015-06-05 Aleksandr Y. Aravkin , Tristan van Leeuwen

Models with a large number of latent variables are often used to fully utilize the information in big or complex data. However, they can be difficult to estimate using standard approaches, and variational inference methods are a popular…

Methodology · Statistics 2021-04-20 Rubén Loaiza-Maya , Michael Stanley Smith , David J. Nott , Peter J. Danaher

We propose an extrinsic regression framework for modeling data with manifold valued responses and Euclidean predictors. Regression with manifold responses has wide applications in shape analysis, neuroscience, medical imaging and many other…

Statistics Theory · Mathematics 2015-08-11 Lizhen Lin , Brian St. Thomas , Hongtu Zhu , David B. Dunson

Studies often estimate associations between an outcome and multiple variates. For example, studies of diagnostic test accuracy estimate sensitivity and specificity, and studies of predictive and prognostic factors typically estimate…

In data science, vector autoregression (VAR) models are popular in modeling multivariate time series in the environmental sciences and other applications. However, these models are computationally complex with the number of parameters…

Methodology · Statistics 2022-09-20 Zhihao Hu , Shyam Ranganathan , Yang Shao , Xinwei Deng

We propose a general procedure for estimating the variance-covariance matrix of two-step estimates of structural parameters in latent variable models. The method is partially simulation-based, in that it includes drawing simulated values of…

Methodology · Statistics 2025-07-23 Roberto Di Mari , Jouni Kuha

In this paper we give definitions of matrix rates of return which do not depend on the choice of basis describing baskets. We give their economic interpretation. The matrix rate of return describes baskets of arbitrary type and extends…

Physics and Society · Physics 2009-11-13 Anna Zambrzycka , Edward W. Piotrowski

The classical Mat\'ern model has been a staple in spatial statistics. Novel data-rich applications in environmental and physical sciences, however, call for new, flexible vector-valued spatial and space-time models. Therefore, the extension…

Methodology · Statistics 2024-06-04 Drew Yarger , Stilian Stoev , Tailen Hsing

This paper provides some extended results on estimating parameter matrix of several regression models when the covariate or response possesses weaker moment condition. We study the $M$-estimator of Fan et al. (Ann Stat 49(3):1239--1266,…

Statistics Theory · Mathematics 2022-09-08 Kangqiang Li , Songqiao Tang , Lixin Zhang

Envelopes were recently proposed as methods for reducing estimative variation in multivariate linear regression. Estimation of an envelope usually involves optimization over Grassmann manifolds. We propose a fast and widely applicable…

Methodology · Statistics 2014-03-18 R. Dennis Cook , Xin Zhang

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone