English
Related papers

Related papers: When is $Y_{obs}$ missing and $Y_{mis}$ observed?

200 papers

Joint measurements of non-commuting observables are characterized by unavoidable measurement uncertainties that can be described in terms of the error statistics for input states with well-defined values for the target observables. However,…

Quantum Physics · Physics 2015-10-28 Shota Kino , Taiki Nii , Holger F. Hofmann

High throughput metabolomics data are fraught with both non-ignorable missing observations and unobserved factors that influence a metabolite's measured concentration, and it is well known that ignoring either of these complications can…

Methodology · Statistics 2019-09-09 Chris McKennan , Carole Ober , Dan Nicolae

Data with missing values is ubiquitous in many applications. Recent years have witnessed increasing attention on prediction with only incomplete data consisting of observed features and a mask that indicates the missing pattern. Existing…

Machine Learning · Computer Science 2023-05-22 Yichen Zhu , Jian Yuan , Bo Jiang , Tao Lin , Haiming Jin , Xinbing Wang , Chenghu Zhou

Missing data is pervasive in econometric applications, and rarely is it plausible that the data are missing (completely) at random. This paper proposes a methodology for studying the robustness of results drawn from incomplete datasets.…

Econometrics · Economics 2025-12-29 Daniel Ober-Reynolds

This paper provides further insight into the key concept of missing at random (MAR) in incomplete data analysis. Following the usual selection modelling approach we envisage two models with separable parameters: a model for the response of…

Statistics Theory · Mathematics 2007-06-13 Guobing Lu , John B. Copas

When a missing-data mechanism is NMAR or non-ignorable, missingness is itself vital information and it must be taken into the likelihood, which, however, needs to introduce additional parameters to be estimated. The incompleteness of the…

Methodology · Statistics 2014-05-15 Kosuke Morikawa , Yutaka Kano

Missing data are an unavoidable complication in many machine learning tasks. When data are `missing at random' there exist a range of tools and techniques to deal with the issue. However, as machine learning studies become more ambitious,…

Semi-supervised learning (SSL) constructs classifiers using both labelled and unlabelled data. It leverages information from labelled samples, whose acquisition is often costly or labour-intensive, together with unlabelled data to enhance…

Machine Learning · Statistics 2025-12-29 Jinran Wu , You-Gan Wang , Geoffrey J. McLachlan

To understand and explain process behaviour we need to be able to see it, and decide its significance, i.e. be able to tell a story about its behaviours. This paper describes a few of the modelling challenges that underlie monitoring and…

Multiagent Systems · Computer Science 2019-07-26 Mark Burgess

Learning Gibbs distributions using only sufficient statistics has long been recognized as a computationally hard problem. On the other hand, computationally efficient algorithms for learning Gibbs distributions rely on access to full sample…

Machine Learning · Computer Science 2026-02-16 Abhijith Jayakumar , Shreya Shukla , Marc Vuffray , Andrey Y. Lokhov , Sidhant Misra

The problems of observability and identifiability have been of great interest as previous steps to estimating parameters and initial conditions of dynamical systems to which some known data (observations) are associated. While most works…

Dynamical Systems · Mathematics 2025-06-16 Alicja B Kubik , Benjamin Ivorra , Alain Rapaport , Ángel M Ramos

In a recent Letter, Yang et al. [Phys. Rev. Lett. 109, 258701 (2012)] introduced the concept of observability transitions: the percolation-like emergence of a macroscopic observable component in graphs in which the state of a fraction of…

Statistical Mechanics · Physics 2014-02-11 Antoine Allard , Laurent Hébert-Dufresne , Jean-Gabriel Young , Louis J. Dubé

Conditions ensuring optimal parameter estimation in the presence of missing data are well established in inference, typically relying on the Missing-at-Random (MAR) assumption. In prediction, similar principles are often assumed to apply.…

Methodology · Statistics 2026-03-19 Pierre Catoire , Robin Genuer , Cecile Proust-Lima

Data analyses typically rely upon assumptions about missingness mechanisms that lead to observed versus missing data. When the data are missing not at random, direct assumptions about the missingness mechanism, and indirect assumptions…

Methodology · Statistics 2016-03-22 Alexander M Franks , Edoardo M Airoldi , Donald B Rubin

Applications of tangles of connectivity systems suggest a duality between these, in which for two sets $X$ and $Y\!$ the elements $x$ of $X$ map to subsets $Y_x$ of $Y\!$, and the elements $y$ of $Y\!$ map to subsets $X_y$ of $X$, so that…

Combinatorics · Mathematics 2021-09-28 Reinhard Diestel , Christian Elbracht , Joshua Erde , Maximilian Teegen

Our capacity to process large complex data sources is ever-increasing, providing us with new, important applied research questions to address, such as how to handle missing values in large-scale databases. Mitra et al. (2023) noted the…

Methodology · Statistics 2023-07-07 James Jackson , Robin Mitra , Niels Hagenbuch , Sarah McGough , Chris Harbron

We provide an analysis of complementarity via a suitably designed classicalmodel that leads to a set of inequalities that can be tested by means ofunsharp measurements. We show that, if the measured statistics does notfulfill the…

Quantum Physics · Physics 2022-01-12 Elisa Masa , Laura Ares , Alfredo Luis

In this review, we recall the concepts of Identifiability and Observability of dynamical systems, and analyse them in the framework of Mathematical Epidemiology. We show that, even for simple and well known models of the literature, these…

Dynamical Systems · Mathematics 2023-05-23 Nik Cunniffe , Frédéric Hamelin , Abderrahman Iggidr , Alain Rapaport , Gauthier Sallet

It is often said that the fundamental problem of causal inference is a missing data problem -- the comparison of responses to two hypothetical treatment assignments is made difficult because for every experimental unit only one potential…

Methodology · Statistics 2024-11-21 Razieh Nabi , Rohit Bhattacharya , Ilya Shpitser , James M. Robins

This paper contributes a set of quality metrics for identification and visual analysis of structured missingness in high-dimensional data. Missing values in data are a frequent challenge in most data generating domains and may cause a range…

Graphics · Computer Science 2025-05-30 Sara Johansson Fernstad , Sarah Alsufyani , Silvia Del Din , Alison Yarnall , Lynn Rochester