English
Related papers

Related papers: On the Fisher information matrix for multivariate …

200 papers

Recently proposed methods in data subset selection, that is active learning and active sampling, use Fisher information, Hessians, similarity matrices based on gradients, and gradient lengths to estimate how informative data is for a…

Machine Learning · Computer Science 2022-11-08 Andreas Kirsch , Yarin Gal

The analysis of longitudinal, heterogeneous or unbalanced clustered data is of primary importance to a wide range of applications. The Linear Mixed Model (LMM) is a popular and flexible extension of the linear model specifically designed…

Methodology · Statistics 2021-02-16 Thomas Maullin-Sapey , Thomas E. Nichols

Harvey et al. (2010) extended the Bayesian estimation method by Sahu et al. (2003) to a multivariate skew-elliptical distribution with a general skewness matrix, and applied it to Bayesian portfolio optimization with higher moments.…

Methodology · Statistics 2021-08-10 Sakae Oya , Teruo Nakatsuma

In mixed linear models with nonnormal data, the Gaussian Fisher information matrix is called a quasi-information matrix (QUIM). The QUIM plays an important role in evaluating the asymptotic covariance matrix of the estimators of the model…

Statistics Theory · Mathematics 2007-06-13 Jiming Jiang

The Fisher Information Matrix formalism is extended to cases where the data is divided into two parts (X,Y), where the expectation value of Y depends on X according to some theoretical model, and X and Y both have errors with arbitrary…

Cosmology and Nongalactic Astrophysics · Physics 2015-02-20 A. F. Heavens , M. Seikel , B. D. Nord , M. Aich , Y. Bouffanais , B. A. Bassett , M. P. Hobson

In this paper, we introduce the flexible interpretable gamma (FIG) distribution which has been derived by Weibullisation of the body-tail generalised normal distribution. The parameters of the FIG have been verified graphically and…

Statistics Theory · Mathematics 2023-08-23 Matthias Wagener , Andriette Bekker , Mohammad Arashi , Antonio Punzo

The Fisher information matrix (FM) plays an important role in forecasts and inferences in many areas of physics. While giving fast parameter estimation with the Gaussian likelihood approximation in the parameter space, the FM can only give…

General Relativity and Quantum Cosmology · Physics 2022-06-22 Ziming Wang , Chang Liu , Junjie Zhao , Lijing Shao

This paper introduces the multivariate tail-inflated normal (MTIN) distribution, an elliptical heavy-tails generalization of the multivariate normal (MN). The MTIN belongs to the family of MN scale mixtures by choosing a convenient…

Methodology · Statistics 2020-06-23 Antonio Punzo , Luca Bagnato

The Fisher information matrix (FIM) is fundamental to understanding the trainability of deep neural nets (DNN), since it describes the parameter space's local metric. We investigate the spectral distribution of the conditional FIM, which is…

Machine Learning · Statistics 2021-03-31 Tomohiro Hayase , Ryo Karakida

The Fisher-Snedecor $\mathcal{F}$ distribution has been recently proposed as a more accurate and mathematically tractable composite fading model than traditional established models in some practical cases. In this paper, we firstly derive…

Information Theory · Computer Science 2019-11-27 Hongyang Du , Jiayi Zhang , Kostas P. Peppas , Hui Zhao , Bo Ai , Xiaodan Zhang

We propose communication-efficient distributed estimation and inference methods for the transelliptical graphical model, a semiparametric extension of the elliptical distribution in the high dimensional regime. In detail, the proposed…

Machine Learning · Statistics 2016-12-30 Pan Xu , Lu Tian , Quanquan Gu

We introduce a Bayesian approach for multivariate spatio-temporal prediction for high-dimensional count-valued data. Our primary interest is when there are possibly millions of data points referenced over different variables, geographic…

Methodology · Statistics 2015-12-24 Jonathan R. Bradley , Scott H. Holan , Christopher K. Wikle

In this paper we propose a family of multivariate asymmetric distributions over an arbitrary subset of set of real numbers which is defined in terms of the well-known elliptically symmetric distributions. We explore essential properties,…

Methodology · Statistics 2024-09-02 Roberto Vila , Helton Saulo , Leonardo Santos , João Monteiros , Felipe Quintino

We provide a new perspective on Stein's so-called density approach by introducing a new operator and characterizing class which are valid for a much wider family of probability distributions on the real line. We prove an elementary…

Probability · Mathematics 2013-04-05 Christophe Ley , Yvik Swan

In this paper, we present the Bayesian inference procedures for the parameters of the multivariate random effects model derived under the assumption of an elliptically contoured distribution when the Berger and Bernardo reference and the…

Methodology · Statistics 2023-05-26 Olha Bodnar , Taras Bodnar

High-dimensional data clustering has become and remains a challenging task for modern statistics and machine learning, with a wide range of applications. We consider in this work the powerful discriminative latent mixture model, and we…

Methodology · Statistics 2020-12-09 Nicolas Jouvin , Charles Bouveyron , Pierre Latouche

We show that the mathematical form of the information measure of Fisher's I for a Gibbs' canonical probability distribution (the most important one in statistical mechanics) incorporates important features of the intrinsic structure of…

Statistical Mechanics · Physics 2007-05-23 F. Pennini , A. Plastino

The study of continuous-time information diffusion has been an important area of research for many applications in recent years. When only the diffusion traces (cascades) are accessible, cascade-based network inference and influence…

Social and Information Networks · Computer Science 2024-05-22 Keke Huang , Ruize Gao , Bogdan Cautis , Xiaokui Xiao

Recently the termed \emph{multimatrix variate distributions} were proposed in \citet{dgcl:24a} as an alternative for univariate and vector variate copulas. The distributions are based on sample probabilistic dependent elliptically countered…

Statistics Theory · Mathematics 2024-08-06 Francisco J. Caro-Lopera , José A. Díaz-García

Systems with a long-term stationary state that possess as a spatio-temporally fluctuation quantity $\beta$ can be described by a superposition of several statistics, a "super statistics". We consider first, the Gamma, log-normal and…

Statistical Mechanics · Physics 2015-06-05 O. Obregón , A. Gil-Villegas