English
Related papers

Related papers: Inference on Gaussian mixture models with dependen…

200 papers

Item nonresponse is frequently encountered in practice. Ignoring missing data can lose efficiency and lead to misleading inference. Fractional imputation is a frequentist approach of imputation for handling missing data. However, the…

Methodology · Statistics 2018-09-18 Hejian Sang , Jae Kwang Kim

When outcome data are expensive or onerous to collect, scientists increasingly substitute predictions from machine learning and AI models for unlabeled cases, a process which has consequences for downstream statistical inference. While…

Machine Learning · Statistics 2026-03-13 Stephen Salerno , Zhenke Wu , Tyler McCormick

Independent component analysis (ICA) is a fundamental statistical tool used to reveal hidden generative processes from observed data. However, traditional ICA approaches struggle with the rotational invariance inherent in Gaussian…

Machine Learning · Computer Science 2024-08-21 Ignavier Ng , Yujia Zheng , Xinshuai Dong , Kun Zhang

Random graph mixture models are now very popular for modeling real data networks. In these setups, parameter estimation procedures usually rely on variational approximations, either combined with the expectation-maximisation (\textsc{em})…

Statistics Theory · Mathematics 2010-12-09 Christophe Ambroise , Catherine Matias

Identifying statistical dependence between the features and the label is a fundamental problem in supervised learning. This paper presents a framework for estimating dependence between numerical features and a categorical label using…

Machine Learning · Computer Science 2021-10-01 Silu Zhang , Xin Dang , Dao Nguyen , Dawn Wilkins , Yixin Chen

We consider linear non-Gaussian structural equation models that involve latent confounding. In this setting, the causal structure is identifiable, but, in general, it is not possible to identify the specific causal effects. Instead, a…

Machine Learning · Statistics 2024-08-12 Daniela Schkoda , Elina Robeva , Mathias Drton

This paper studies the problem of discriminating two multivariate Gaussian distributions in a distributed manner. Specifically, it characterizes in a special case the optimal typeII error exponent as a function of the available…

Information Theory · Computer Science 2020-05-15 Pierre Escamilla , Abdellatif Zaidi , Michèle Wigger

Graphical models provide a framework for exploration of multivariate dependence patterns. The connection between graph and statistical model is made by identifying the vertices of the graph with the observed variables and translating the…

Statistics Theory · Mathematics 2008-02-08 Mathias Drton , Michael D. Perlman

We develop an information-theoretic view of the stochastic block model, a popular statistical model for the large-scale structure of complex networks. A graph $G$ from such a model is generated by first assigning vertex labels at random…

Information Theory · Computer Science 2015-08-03 Yash Deshpande , Emmanuel Abbe , Andrea Montanari

Estimating parameters of mixture model has wide applications ranging from classification problems to estimating of complex distributions. Most of the current literature on estimating the parameters of the mixture densities are based on…

Machine Learning · Statistics 2020-06-23 Yuantong Li , Qi Ma , Sujit K. Ghosh

The Ising model was originally developed to model magnetisation of solids in statistical physics. As a network of binary variables with the probability of becoming 'active' depending only on direct neighbours, the Ising model appears…

Statistics Theory · Mathematics 2018-07-31 Lourens Waldorp , Maarten Marsman , Gunter Maris

We propose new statistical tests, in high-dimensional settings, for testing the independence of two random vectors and their conditional independence given a third random vector. The key idea is simple, i.e., we first transform each…

Methodology · Statistics 2026-01-28 Jinyuan Chang , Yue Du , Jing He , Qiwei Yao

Log-linear models are a classical tool for the analysis of contingency tables. In particular, the subclass of graphical log-linear models provides a general framework for modelling conditional independences. However, with the exception of…

Statistics Theory · Mathematics 2010-03-04 Mathias Drton , Thomas S. Richardson

Semi- and non-parametric mixture of regressions are a very useful flexible class of mixture of regressions in which some or all of the parameters are non-parametric functions of the covariates. These models are, however, based on the…

Methodology · Statistics 2026-01-21 Peterson Mambondimumwe , Sphiwe B. Skhosana , Najmeh Nakhaei Rad

Note: Accepted version, published in Statistical Papers, https://doi.org/10.1007/s00362-023-01414-3. It is shown that some theoretically identifiable parameters cannot be empirically identified, meaning that no consistent estimator of them…

Statistics Theory · Mathematics 2023-04-18 Christian Hennig

Graphical models are commonly used to represent conditional dependence relationships between variables. There are multiple methods available for exploring them from high-dimensional data, but almost all of them rely on the assumption that…

Machine Learning · Statistics 2020-04-22 Tianxi Li , Cheng Qian , Elizaveta Levina , Ji Zhu

Graphical models are widely used in diverse application domains to model the conditional dependencies amongst a collection of random variables. In this paper, we consider settings where the graph structure is covariate-dependent, and…

Machine Learning · Statistics 2025-04-24 Jiahe Lin , Yikai Zhang , George Michailidis

A seminal result in the ICA literature states that for $AY = \varepsilon$, if the components of $\varepsilon$ are independent and at most one is Gaussian, then $A$ is identified up to sign and permutation of its rows (Comon, 1994). In this…

Statistics Theory · Mathematics 2024-03-21 Geert Mesters , Piotr Zwiernik

Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated prediction sets with precise coverage guarantees for any classification model. However, its reliance…

Gaussian process emulators of computationally expensive computer codes provide fast statistical approximations to model physical processes. The training of these surrogates depends on the set of design points chosen to run the simulator.…

Computation · Statistics 2016-08-16 A. Garbuno-Inigo , F. A. DiazDelaO , K. M. Zuev