English
Related papers

Related papers: Zero Inflation as a Missing Data Problem: a Proxy-…

200 papers

Predictive analytics is increasingly used to guide decision-making in many applications. However, in practice, we often have limited data on the true predictive task of interest, and must instead rely on more abundant data on a…

Machine Learning · Statistics 2020-05-07 Hamsa Bastani

Existing high-dimensional statistical methods are largely established for analyzing individual-level data. In this work, we study estimation and inference for high-dimensional linear models where we only observe "proxy data", which include…

Methodology · Statistics 2022-01-12 Sai Li , T. Tony Cai , Hongzhe Li

There has been much recent discussion, and some confusion, regarding the use of existing observational data to estimate the likelihood that next-generation cosmic microwave background (CMB) polarization experiments might detect a nonzero…

Astrophysics · Physics 2024-03-13 Wessel Valkenburg , Lawrence M. Krauss , Jan Hamann

We propose a regression model for count data when the classical generalized linear model approach is too rigid due to a high outcome of zero counts and a nonlinear influence of continuous covariates. Zero-Inflation is applied to take into…

Methodology · Statistics 2013-04-12 T. Opitz , P. Tramini , N. Molinari

We develop an interpolation-based framework for noisy linear systems with unknown system matrix with bounded norm (implying bounded growth or non-increasing energy), and bounded process noise energy. The proposed approach characterizes all…

Systems and Control · Electrical Eng. & Systems 2025-11-17 Martina Vanelli , Nima Monshizadeh , Julien M. Hendrickx

The support recovery problem consists of determining a sparse subset of a set of variables that is relevant in generating a set of observations, and arises in a diverse range of settings such as compressive sensing, and subset selection in…

Information Theory · Computer Science 2016-08-31 Jonathan Scarlett , Volkan Cevher

In many fields, and especially in the medical and social sciences and in recommender systems, data are gathered through clinical studies or targeted surveys. Participants are generally reluctant to respond to all questions in a survey or…

Statistics Theory · Mathematics 2016-11-15 Mohammad Reza Gholami , Magnus Jansson , Erik G. Ström , Ali H. Sayed

The Vanilla Power Law Inflation is plagued with two severe drawbacks, the one being the issue of graceful exit, and the other being its compatibility with the existing data. There's yet another daunting problem generic to any inflationary…

Cosmology and Nongalactic Astrophysics · Physics 2025-08-21 Suratna Das

Missing data has the potential to affect analyses conducted in all fields of scientific study, including healthcare, economics, and the social sciences. Several approaches to unbiased inference in the presence of non-ignorable missingness…

Methodology · Statistics 2020-09-01 Razieh Nabi , Rohit Bhattacharya , Ilya Shpitser

This paper presents an approach to formalizing and enforcing a class of use privacy properties in data-driven systems. In contrast to prior work, we focus on use restrictions on proxies (i.e. strong predictors) of protected information…

Cryptography and Security · Computer Science 2017-09-08 Anupam Datta , Matthew Fredrikson , Gihyuk Ko , Piotr Mardziel , Shayak Sen

In many application settings, the data have missing entries which make analysis challenging. An abundant literature addresses missing values in an inferential framework: estimating parameters and their variance from incomplete tables. Here,…

Machine Learning · Statistics 2024-03-22 Julie Josse , Jacob M. Chen , Nicolas Prost , Erwan Scornet , Gaël Varoquaux

Monthly and weekly economic indicators are often taken to be the largest common factor estimated from high and low frequency data, either separately or jointly. To incorporate mixed frequency information without directly modeling them, we…

Econometrics · Economics 2023-10-10 Serena Ng , Susannah Scanlan

Methods that rely on proxies, without imposing strong parametric structure, are increasingly used to deal with unobserved variables in causal inference. One influential line of this work reconstructs latent distributions used to identify…

Methodology · Statistics 2026-05-12 Helen Guo , Ilya Shpitser , Elizabeth L. Ogburn

Data augmentation, by the introduction of auxiliary variables, has become an ubiquitous technique to improve convergence properties, simplify the implementation or reduce the computational time of inference methods such as Markov chain…

Methodology · Statistics 2020-09-30 Maxime Vono , Nicolas Dobigeon , Pierre Chainais

This paper develops the inferential theory for latent factor models estimated from large dimensional panel data with missing observations. We propose an easy-to-use all-purpose estimator for a latent factor model by applying principal…

Econometrics · Economics 2022-01-11 Ruoxuan Xiong , Markus Pelger

Mediation analysis seeks to understand the mechanism by which a treatment affects an outcome. Count or zero-inflated count outcome are common in many studies in which mediation analysis is of interest. For example, in dental studies,…

Methodology · Statistics 2016-07-12 Zijian Guo , Dylan S. Small , Stuart A. Gansky , Jing Cheng

This paper describes a compound Poisson-based random effects structure for modeling zero-inflated data. Data with large proportion of zeros are found in many fields of applied statistics, for example in ecology when trying to model and…

Applications · Statistics 2009-07-29 Marie-Pierre Etienne , Eric Parent , Benoit Hugues , Bernier Jacques

An efficient monotone data augmentation (MDA) algorithm is proposed for missing data imputation for incomplete multivariate nonnormal data that may contain variables of different types, and are modeled by a sequence of regression models…

Methodology · Statistics 2018-11-21 Yongqiang Tang

Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks,…

Machine Learning · Computer Science 2018-12-31 Abhishek Kumar , Prasanna Sattigeri , Avinash Balakrishnan

In many empirical settings, directly observing a treatment variable may be infeasible although an error-prone surrogate measurement of the latter will often be available. Causal inference based solely on the surrogate measurement is…

Methodology · Statistics 2024-09-26 Ying Zhou , Eric Tchetgen Tchetgen