English
Related papers

Related papers: Inside Out: Externalizing Assumptions in Data Anal…

200 papers

Statistical hypothesis testing, as formalized by 20th Century statisticians and taught in college statistics courses, has been a cornerstone of 100 years of scientific progress. Nevertheless, the methodology is increasingly questioned in…

Methodology · Statistics 2024-08-22 Brian Dennis , Mark L Taper , José M Ponciano

In the era of big data, the increasing availability of diverse data sources has driven interest in analytical approaches that integrate information across sources to enhance statistical accuracy, efficiency, and scientific insights. Many…

Methodology · Statistics 2026-03-30 Lu Wang , Yanyuan Ma , Jiwei Zhao

Case-control sampling is a commonly used retrospective sampling design to alleviate imbalanced structure of binary data. When fitting the logistic regression model with case-control data, although the slope parameter of the model can be…

Methodology · Statistics 2024-06-03 Hengchao Shi , Xinyi Liu , Ming Zheng , Wen Yu

In clinical settings, we often face the challenge of building prediction models based on small observational data sets. For example, such a data set might be from a medical center in a multi-center study. Differences between centers might…

Randomized experiments have become a cornerstone of evidence-based decision-making in contexts ranging from online platforms to public health. However, in experimental settings with network interference, a unit's treatment can influence…

Machine Learning · Computer Science 2025-10-22 Sadegh Shirani , Yuwei Luo , William Overman , Ruoxuan Xiong , Mohsen Bayati

Data validation is the activity where one decides whether or not a particular data set is fit for a given purpose. Formalizing the requirements that drive this decision process allows for unambiguous communication of the requirements,…

Databases · Computer Science 2020-12-23 Mark P. J. van der Loo , Edwin de Jonge

The assumption that data samples are independent and identically distributed (iid) is standard in many areas of statistics and machine learning. Nevertheless, in some settings, such as social networks, infectious disease modeling, and…

Methodology · Statistics 2019-02-06 Eli Sherman , Ilya Shpitser

The goal of causal inference is to understand the outcome of alternative courses of action. However, all causal inference requires assumptions. Such assumptions can be more influential than in typical tasks for probabilistic modeling, and…

Methodology · Statistics 2016-10-31 Dustin Tran , Francisco J. R. Ruiz , Susan Athey , David M. Blei

We develop our previous works concerning the identification of the collection of significant factors determining some, in general, non-binary random response variable. Such identification is important, e.g., in biological and medical…

Statistics Theory · Mathematics 2014-06-05 Alexander V. Bulinski , Alexander S. Rakitko

Data fusion techniques integrate information from heterogeneous data sources to improve learning, generalization, and decision making across data sciences. In causal inference, these methods leverage rich observational data to improve…

Methodology · Statistics 2025-06-02 Quinn Lanners , Cynthia Rudin , Alexander Volfovsky , Harsh Parikh

Unquantified sources of uncertainty in observational causal analyses can break the integrity of the results. One would never want another analyst to repeat a calculation with the same dataset, using a seemingly identical procedure, only to…

Methodology · Statistics 2022-08-12 Marco Morucci , Md. Noor-E-Alam , Cynthia Rudin

Improving public policy is one of the key roles of governments, and they can do this in an evidence-based way using administrative data. Causal inference for observational data improves on current practice of using descriptive or predictive…

Applications · Statistics 2023-01-18 Elena Tartaglia , Peter Rankin

We define extrapolation as any type of statistical inference on a conditional function (e.g., a conditional expectation or conditional quantile) evaluated outside of the support of the conditioning variable. This type of extrapolation…

Methodology · Statistics 2024-06-13 Niklas Pfister , Peter Bühlmann

Semiparametric inference on average causal effects from observational data is based on assumptions yielding identification of the effects. In practice, several distinct identifying assumptions may be plausible; an analyst has to make a…

Methodology · Statistics 2025-10-07 Tetiana Gorbach , Xavier de Luna , Juha Karvanen , Ingeborg Waernbaum

External controls from historical trials or observational data can augment randomized controlled trials when large-scale randomization is impractical or unethical, such as in drug evaluation for rare diseases. However, non-randomized…

Methodology · Statistics 2025-05-08 Ke Zhu , Shu Yang , Xiaofei Wang

When data contains measurement errors, it is necessary to make assumptions relating the observed, erroneous data to the unobserved true phenomena of interest. These assumptions should be justifiable on substantive grounds, but are often…

Machine Learning · Statistics 2020-12-24 Noam Finkelstein , Roy Adams , Suchi Saria , Ilya Shpitser

We analyze different types of simulations that applied researchers can use to assess whether their inference methods reliably control false-positive rates. We show that different assessments involve trade-offs, varying in the types of…

Econometrics · Economics 2025-10-03 Bruno Ferman

Statistical analysis is an important tool to distinguish systematic from chance findings. Current statistical analyses rely on distributional assumptions reflecting the structure of some underlying model, which if not met lead to problems…

Statistics Theory · Mathematics 2023-11-15 Orestis Loukas , Ho Ryun Chung

The abundance of data produced daily from large variety of sources has boosted the need of novel approaches on causal inference analysis from observational data. Observational data often contain noisy or missing entries. Moreover, causal…

Methodology · Statistics 2017-03-14 Fani Tsapeli , Peter Tino , Mirco Musolesi

Invariant prediction uses the prediction stability of causal relationships across different environments to identify causal variables. Conversely, using causal variables gives prediction guarantees even in out-of-sample data settings. In…

Methodology · Statistics 2025-11-04 Lucas Kania , Ernst Wit