English
Related papers

Related papers: Zero Inflation as a Missing Data Problem: a Proxy-…

200 papers

Proximal causal inference is a recently proposed framework for evaluating causal effects in the presence of unmeasured confounding. For point identification of causal effects, it leverages a pair of so-called treatment and outcome…

Methodology · Statistics 2024-01-30 AmirEmad Ghassami , Ilya Shpitser , Eric Tchetgen Tchetgen

We propose a new methodology to detect zero-inflation and overdispersion based on the comparison of the expected sample extremes among convexly ordered distributions. The method is very flexible and includes tests for the proportion of…

Methodology · Statistics 2008-09-25 A. Baillo , J. Carcamo , J. R. Berrendero

We propose a new framework for the modelling of count data exhibiting zero inflation (ZI). The main part of this framework includes a new and more general parameterisation for ZI models which naturally includes both over- and…

Methodology · Statistics 2018-05-03 John Haslett , Andrew Parnell , James Sweeney

The human microbiome can contribute to pathogeneses of many complex diseases by mediating disease-leading causal pathways. However, standard mediation analysis methods are not adequate to analyze the microbiome as a mediator due to the…

Count data are common in medical research. When these data have more zeros than expected by the most used count distributions, it is common to employ a zero-inflated regression model. However, the interpretability of these models is much…

Methodology · Statistics 2025-09-30 Gustavo H. A. Pereira , Jeremias Leão , Manoel Santos-Neto , Jianwen Cai

The causal compatibility question asks whether a given causal structure graph -- possibly involving latent variables -- constitutes a genuinely plausible causal explanation for a given probability distribution over the graph's observed…

Quantum Physics · Physics 2022-10-28 Miguel Navascues , Elie Wolfe

The problem of causal inference is to determine if a given probability distribution on observed variables is compatible with some causal structure. The difficult case is when the causal structure includes latent variables. We here introduce…

Quantum Physics · Physics 2019-07-24 Elie Wolfe , Robert W. Spekkens , Tobias Fritz

Count data with high frequencies of zeros are found in many areas, specially in biology. Statistical models to analyze such data started to be developed in the 80s and are still a topic of active research. Such models usually assume a…

Applications · Statistics 2018-10-08 Gustavo Thomas , Luiz R. Nakamura , Rafael A. Moral , Clarice G. B. Demétrio

A frequent challenge encountered with compositional ecological data is how to interpret and model data with a high proportion of zeros and $N$'s. Such data frequently occur in ecological applications where counts of species are collected…

Methodology · Statistics 2025-08-04 James Sweeney , John Haslett , Dipankar Bandyopadhyay , Michael Fop , Andrew C. Parnell

Most practical data science problems encounter missing data. A wide variety of solutions exist, each with strengths and weaknesses that depend upon the missingness-generating process. Here we develop a theoretical framework for training and…

Machine Learning · Computer Science 2022-11-15 Jahan C. Penny-Dimri , Christoph Bergmeir , Julian Smith

Zero-inflated explanatory variables are common in fields such as ecology and finance. In this paper we address the problem of having excess of zero values in some explanatory variables which are subject to multioutcome lasso-regularized…

Methodology · Statistics 2021-09-13 Jyrki Möttönen , Tero Lähderanta , Janne Salonen , Mikko J. Sillanpää

Missing data is a pervasive problem in data analyses, resulting in datasets that contain censored realizations of a target distribution. Many approaches to inference on the target distribution using censored observed data, rely on missing…

Machine Learning · Statistics 2019-07-02 Rohit Bhattacharya , Razieh Nabi , Ilya Shpitser , James M. Robins

Analyzing high-dimensional count data is a challenge and statistical model-based approaches provide an adequate and efficient framework that preserves explainability. The (multivariate) Poisson-Log-Normal (PLN) model is one such model: it…

Methodology · Statistics 2025-09-15 Bastien Batardière , Julien Chiquet , François Gindraud , Mahendra Mariadassou

Distinguishing causal connections from correlations is important in many scenarios. However, the presence of unobserved variables, such as the latent confounder, can introduce bias in conditional independence testing commonly employed in…

Methodology · Statistics 2024-05-03 Mingzhou Liu , Xinwei Sun , Yu Qiao , Yizhou Wang

When data contains measurement errors, it is necessary to make assumptions relating the observed, erroneous data to the unobserved true phenomena of interest. These assumptions should be justifiable on substantive grounds, but are often…

Machine Learning · Statistics 2020-12-24 Noam Finkelstein , Roy Adams , Suchi Saria , Ilya Shpitser

A naive computation of the correlation functions of fluctuations generated during inflation suffers from logarithmic divergences in the infrared (IR) limit. In this paper, we propose one way to solve this IR divergence problem in the…

High Energy Physics - Theory · Physics 2010-11-02 Yuko Urakawa , Takahiro Tanaka

In some multivariate problems with missing data, pairs of variables exist that are never observed together. For example, some modern biological tools can produce data of this form. As a result of this structure, the covariance matrix is…

Methodology · Statistics 2013-08-13 Max Grazier G'Sell , Shai S. Shen-Orr , Robert Tibshirani

Zero-inflated data pose significant challenges in precipitation forecasting due to the predominance of zeros with sparse non-zero events. To address this, we propose the Zero Inflation Diffusion Framework (ZIDF), which integrates Gaussian…

Machine Learning · Computer Science 2025-09-16 Wentao Gao , Jiuyong Li , Lin Liu , Thuc Duy Le , Xiongren Chen , Xiaojing Du , Jixue Liu , Yanchang Zhao , Yun Chen

Missing data are prevalent and present daunting challenges in real data analysis. While there is a growing body of literature on fairness in analysis of fully observed data, there has been little theoretical work on investigating fairness…

Machine Learning · Computer Science 2021-12-10 Yiliang Zhang , Qi Long

Ecological studies involving counts of abundance, presence-absence or occupancy rates often produce data having a substantial proportion of zeros. Furthermore, these types of processes are typically multivariate and only adequately…

Methodology · Statistics 2011-05-17 Ali Arab , Scott H. Holan , Christopher K. Wikle , Mark L. Wildhaber