English
Related papers

Related papers: Missing at random: a stochastic process perspectiv…

200 papers

We introduce a new concept, data irrecoverability, and show that the well-studied concept of data privacy is sufficient but not necessary for data irrecoverability. We show that there are several regularized loss minimization problems that…

Machine Learning · Computer Science 2021-07-07 Zitao Li , Jean Honorio

In this article we show that a large class of infinite measure preserving dynamical systems that do not admit physical measures nevertheless exhibit strong statistical properties. In particular, we give sufficient conditions for existence…

Dynamical Systems · Mathematics 2026-04-30 Douglas Coates , Ian Melbourne , Amin Talebi

A sequence $x_1,\dots,x_n,\dots$ of discrete-valued observations is generated according to some unknown probabilistic law (measure) $\mu$. After observing each outcome, one is required to give conditional probabilities of the next…

Machine Learning · Computer Science 2014-12-30 Daniil Ryabko

This paper considers the joint distribution of elements of a random sample and an order statistic of the same sample. \ The motivation for this work stems from the important problem in reliability analysis, to estimate the number of…

Statistics Theory · Mathematics 2019-03-04 Ismihan Bairamov

Missing data poses a significant challenge in data science, affecting decision-making processes and outcomes. Understanding what missing data is, how it occurs, and why it is crucial to handle it appropriately is paramount when working with…

Methodology · Statistics 2024-04-09 Youran Zhou , Sunil Aryal , Mohamed Reda Bouadjenek

We review several statistical complexity measures proposed over the last decade and a half as general indicators of structure or correlation. Recently, Lopez-Ruiz, Mancini, and Calbet [Phys. Lett. A 209 (1995) 321] introduced another…

Statistical Mechanics · Physics 2008-02-03 David P. Feldman , James P. Crutchfield

Given a set of incomplete observations, we study the nonparametric problem of testing whether data are Missing Completely At Random (MCAR). Our first contribution is to characterise precisely the set of alternatives that can be…

Statistics Theory · Mathematics 2022-05-19 Thomas B Berrett , Richard J Samworth

We propose an l1-regularized likelihood method for estimating the inverse covariance matrix in the high-dimensional multivariate normal model in presence of missing data. Our method is based on the assumption that the data are missing at…

Methodology · Statistics 2012-02-28 Nicolas Städler , Peter Bühlmann

This work initiates a general study of learning and generalization without the i.i.d. assumption, starting from first principles. While the traditional approach to statistical learning theory typically relies on standard assumptions from…

Machine Learning · Statistics 2020-10-21 Steve Hanneke

We develop an anomaly-detection method when systematic anomalies, possibly statistically very similar to genuine inputs, are affecting control systems at the input and/or output stages. The method allows anomaly-free inputs (i.e., those…

Methodology · Statistics 2022-02-01 Ning Sun , Chen Yang , Ričardas Zitikis

There are numerous examples of natural and artificial processes that represent stochastic sequences of events followed by an absolute refractory period during which the occurrence of a subsequent event is impossible. In the simplest case of…

Neurons and Cognition · Quantitative Biology 2022-01-24 A. V. Paraskevov , A. S. Minkin

Analysis of competing risks data is often complicated by the incomplete or selectively missing information on the cause of failure. Standard approaches typically assume that the cause of failure is missing at random (MAR), an assumption…

Anomaly detection aims to identify observations that deviate from expected behavior. Because anomalous events are inherently sparse, most frameworks are trained exclusively on normal data to learn a single reference model of normality. This…

We study the identification and estimation of statistical functionals of multivariate data missing non-monotonically and not-at-random, taking a semiparametric approach. Specifically, we assume that the missingness mechanism satisfies what…

Methodology · Statistics 2022-12-26 Daniel Malinsky , Ilya Shpitser , Eric J Tchetgen Tchetgen

We use the martingale-theoretic approach of game-theoretic probability to incorporate imprecision into the study of randomness. In particular, we define a notion of computable randomness associated with interval, rather than precise,…

Probability · Mathematics 2017-05-05 Gert de Cooman , Jasper De Bock

Log-linear models are typically fitted to contingency table data to describe and identify the relationship between different categorical variables. However, the data may include observed zero cell entries. The presence of zero cell entries…

Methodology · Statistics 2022-12-01 Serveh Sharifi Far , Michail Papathomas , Ruth King

We consider the asymmetric random average process which is a one-dimensional stochastic lattice model with nearest neighbour interaction but continuous and unbounded state variables. First, the explicit functional representations, so-called…

Statistical Mechanics · Physics 2009-11-07 Frank Zielen , Andreas Schadschneider

We consider a natural measure of relevance: the reduction in optimal prediction risk in the presence of side information. For any given loss function, this relevance measure captures the benefit of side information for performing inference…

Information Theory · Computer Science 2015-12-23 Jiantao Jiao , Thomas Courtade , Kartik Venkat , Tsachy Weissman

We propose a definition o meta-stability and obtain sufficient conditions for a sequence of Markov processes on finite state spaces to be meta-stable. In the reversible case, these conditions reduce to estimates of the capacity and the…

Probability · Mathematics 2008-02-18 J. Beltran , C. Landim

Not-at-random missingness presents a challenge in addressing missing data in many health research applications. In this paper, we propose a new approach to account for not-at-random missingness after multiple imputation through weighted…

Methodology · Statistics 2021-01-21 Lauren J Beesley , Jeremy M G Taylor