English
Related papers

Related papers: Zero Inflation as a Missing Data Problem: a Proxy-…

200 papers

Missing data is a common problem in time series data. Most methods for imputation ignore label information pertaining to the time series even if that information exists. In this paper, we provide a framework for missing data imputation in…

Attribute reduction is one of the most important research topics in the theory of rough sets, and many rough sets-based attribute reduction methods have thus been presented. However, most of them are specifically designed for dealing with…

Artificial Intelligence · Computer Science 2021-01-26 Can Gao , Jie Zhoua , Duoqian Miao , Xiaodong Yue , Jun Wan

We present new results for nonparametric identification of causal effects using noisy proxies for unobserved confounders. Our approach builds on the results of \citet{Hu2008} who tackle the problem of general measurement error. We call this…

Econometrics · Economics 2023-05-05 Ben Deaner

Power series distributions form a useful subclass of one-parameter discrete exponential families suitable for modeling count data. A zero-inflated power series distribution is a mixture of a power series distribution and a degenerate…

Statistics Theory · Mathematics 2008-12-18 Archan Bhattacharya , Bertrand S. Clarke , Gauri S. Datta

The diffusion model has shown remarkable performance in modeling data distributions and synthesizing data. However, the vanilla diffusion model requires complete or fully observed data for training. Incomplete data is a common issue in…

Machine Learning · Computer Science 2023-07-04 Yidong Ouyang , Liyan Xie , Chongxuan Li , Guang Cheng

When first deploying an anomaly detection system, e.g., to detect out-of-scope queries in chatbots, there are no observed data, making data-driven approaches ineffective. Zero-shot anomaly detection methods offer a solution to such…

Machine Learning · Computer Science 2024-05-31 Tal Reiss , George Kour , Naama Zwerdling , Ateret Anaby-Tavor , Yedid Hoshen

Lower bounds for the average probability of error of estimating a hidden variable X given an observation of a correlated random variable Y, and Fano's inequality in particular, play a central role in information theory. In this paper, we…

Information Theory · Computer Science 2013-10-08 Flavio du Pin Calmon , Mayank Varia , Muriel Médard , Mark M. Christiansen , Ken R. Duffy , Stefano Tessaro

The pair correlations of primitive inflation rules are analysed via their exact renormalisation relations. We introduce the inflation displacement algebra that is generated by the Fourier matrix of the inflation and deduce various…

Dynamical Systems · Mathematics 2019-09-10 Michael Baake , Franz Gaehler , Neil Manibo

We consider causal inference in the presence of unobserved confounding. We study the case where a proxy is available for the unobserved confounding in the form of a network connecting the units. For example, the link structure of a social…

Machine Learning · Statistics 2019-06-03 Victor Veitch , Yixin Wang , David M. Blei

The literature on differential privacy almost invariably assumes that the data to be analyzed are fully observed. In most practical applications this is an unrealistic assumption. A popular strategy to address this problem is imputation, in…

Databases · Computer Science 2022-07-15 Soumojit Das , Jorg Drechsler , Keith Merrill , Shawn Merrill

Imputation of missing attribute values in medical datasets for extracting hidden knowledge from medical datasets is an interesting research topic of interest which is very challenging. One cannot eliminate missing values in medical records.…

Databases · Computer Science 2016-03-11 Yelipe UshaRani , P. Sammulal

Although the interest in the the use of social and information networks has grown, most inferences on networks assume the data collected represents the complete. However, when ignoring missing data, even when missing completely at random,…

Methodology · Statistics 2022-03-25 Tyler Vu , Tuo Lin , Jingjing Zou , Vladimir Novitsky , Xin Tu , Victor De Gruttola

A wide range of systems exhibit high dimensional incomplete data. Accurate estimation of the missing data is often desired, and is crucial for many downstream analyses. Many state-of-the-art recovery methods involve supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Adrian V. Dalca , John Guttag , Mert R. Sabuncu

Missing values, widely called as \textit{sparsity} in literature, is a common characteristic of many real-world datasets. Many imputation methods have been proposed to address this problem of data incompleteness or sparsity. However, the…

Machine Learning · Computer Science 2022-07-28 Vishwas Choudhary , Binay Gupta , Anirban Chatterjee , Subhadip Paul , Kunal Banerjee , Vijay Agneeswaran

Inferring causal effects of a treatment, intervention or policy from observational data is central to many applications. However, state-of-the-art methods for causal inference seldom consider the possibility that covariates have missing…

Methodology · Statistics 2020-02-26 Imke Mayer , Julie Josse , Félix Raimundo , Jean-Philippe Vert

The presence of multiple fields during inflation might seed a detectable amount of non-Gaussianity in the curvature perturbations, which in turn becomes observable in present data sets like the cosmic microwave background (CMB) or the large…

Cosmology and Nongalactic Astrophysics · Physics 2015-08-27 Sebastian Dorn , Erandy Ramirez , Kerstin E. Kunze , Stefan Hofmann , Torsten A. Enßlin

Contemporary data-driven methods are typically fed with full supervision on large-scale datasets which limits their applicability. However, in the actual systems with limitations such as measurement error and data acquisition problems,…

Machine Learning · Computer Science 2021-05-06 Qianyu Feng , Linchao Zhu , Bang Zhang , Pan Pan , Yi Yang

There are numerous applications which involve modeling multi-dimensional count data, notably in actuarial science and risk management. When such data exhibit an excess of zeros, common count models are no longer suitable. With multivariate…

Methodology · Statistics 2025-09-30 Golshid Aflaki , Juliana Schulz , Jean-François Plante

The abundance of data produced daily from large variety of sources has boosted the need of novel approaches on causal inference analysis from observational data. Observational data often contain noisy or missing entries. Moreover, causal…

Methodology · Statistics 2017-03-14 Fani Tsapeli , Peter Tino , Mirco Musolesi

Privacy preservation is a fundamental requirement in many high-stakes domains such as medicine and finance, where sensitive personal data must be analyzed without compromising individual confidentiality. At the same time, these applications…

Machine Learning · Statistics 2026-02-05 Simon Roburin , Rafaël Pinot , Erwan Scornet