English
Related papers

Related papers: The Illusion of Learning from Observational Data: …

200 papers

Reliable treatment effect estimation from observational data depends on the availability of all confounding information. While much work has targeted treatment effect estimation from observational data, there is relatively little work in…

Machine Learning · Statistics 2020-11-18 Shirly Wang , Seung Eun Yi , Shalmali Joshi , Marzyeh Ghassemi

To draw scientifically meaningful conclusions and build reliable models of quantitative phenomena, cause and effect must be taken into consideration (either implicitly or explicitly). This is particularly challenging when the measurements…

Machine Learning · Computer Science 2020-12-11 Max A. Little , Reham Badawy

Online platforms regularly conduct randomized experiments to understand how changes to the platform causally affect various outcomes of interest. However, experimentation on online platforms has been criticized for having, among other…

Machine Learning · Computer Science 2022-05-12 Smitha Milli , Luca Belli , Moritz Hardt

Before we attempt to learn a function between two (sets of) observables of a physical process, we must first decide what the inputs and what the outputs of the desired function are going to be. Here we demonstrate two distinct, data-driven…

Bayesian persuasion, a central model in information design, studies how a sender, who privately observes a state drawn from a prior distribution, strategically sends a signal to influence a receiver's action. A key assumption is that both…

Computer Science and Game Theory · Computer Science 2025-05-23 Jingwu Tang , Jiahao Zhang , Fei Fang , Zhiwei Steven Wu

Mathematical models connect theory with the real world through data, enabling us to interpret, understand, and predict complex phenomena. However, scientific knowledge often extends beyond what can be empirically measured, offering valuable…

In statistical practice, whether a Bayesian or frequentist approach is used in inference depends not only on the availability of prior information but also on the attitude taken toward partial prior information, with frequentists tending to…

Statistics Theory · Mathematics 2012-05-02 David R. Bickel

Modern data is messy and high-dimensional, and it is often not clear a priori what are the right questions to ask. Instead, the analyst typically needs to use the data to search for interesting analyses to perform and hypotheses to test.…

Machine Learning · Statistics 2019-10-09 Daniel Russo , James Zou

Much of scientific data is collected as randomized experiments intervening on some and observing other variables of interest. Quite often, a given phenomenon is investigated in several studies, and different sets of variables are involved…

Methodology · Statistics 2012-10-19 Antti Hyttinen , Frederick Eberhardt , Patrik O. Hoyer

Adding domain knowledge to a learning system is known to improve results. In multi-parameter Bayesian frameworks, such knowledge is incorporated as a prior. On the other hand, various model parameters can have different learning rates in…

Machine Learning · Computer Science 2022-06-22 Sareh Nabi , Houssam Nassif , Joseph Hong , Hamed Mamani , Guido Imbens

We provide a reason for Bayesian updating, in the Bernoulli case, even when it is assumed that observations are independent and identically distributed with a fixed but unknown parameter $\theta_0$. The motivation relies on the use of loss…

Statistics Theory · Mathematics 2010-06-08 Pier Giovanni Bissiri , Stephen G. Walker

In an empirical Bayes analysis, we use data from repeated sampling to imitate inferences made by an oracle Bayesian with extensive knowledge of the data-generating distribution. Existing results provide a comprehensive characterization of…

Methodology · Statistics 2021-09-09 Nikolaos Ignatiadis , Stefan Wager

We propose a new model for forming beliefs and learning about unknown probabilities (such as the probability of picking a red marble from a bag with an unknown distribution of coloured marbles). The most widespread model for such situations…

Artificial Intelligence · Computer Science 2019-07-24 Alexandru Baltag , Soroush Rafiee Rad , Sonja Smets

Causal representation learning aims at identifying high-level causal variables from perceptual data. Most methods assume that all latent causal variables are captured in the high-dimensional observations. We instead consider a partially…

The process of diagnosis involves learning about the state of a system from various observations of symptoms or findings about the system. Sophisticated Bayesian (and other) algorithms have been developed to revise and maintain beliefs…

Artificial Intelligence · Computer Science 2013-02-01 Mark Alan Peot , Ross D. Shachter

Many scientific questions in biomedical, environmental, and psychological research involve understanding the effects of multiple factors on outcomes. While factorial experiments are ideal for this purpose, randomized controlled treatment…

Methodology · Statistics 2025-12-03 Ruoqi Yu , Peng Ding

The angular measure on the unit sphere characterizes the first-order dependence structure of the components of a random vector in extreme regions and is defined in terms of standardized margins. Its statistical recovery is an important step…

Statistics Theory · Mathematics 2022-10-18 Stéphan Clémençon , Hamid Jalalzai , Stéphane Lhaut , Anne Sabourin , Johan Segers

In the causal learning setting, we wish to learn cause-and-effect relationships between variables such that we can correctly infer the effect of an intervention. While the difference between a cyclic structure and an acyclic structure may…

Machine Learning · Computer Science 2020-07-27 Katie Everett , Ian Fischer

Researchers increasingly have access to two types of data: (i) large observational datasets where treatment (e.g., class size) is not randomized but several primary outcomes (e.g., graduation rates) and secondary outcomes (e.g., test…

Methodology · Statistics 2025-05-29 Susan Athey , Raj Chetty , Guido Imbens

Observational studies are valuable tools for inferring causal effects in the absence of controlled experiments. However, these studies may be biased due to the presence of some relevant, unmeasured set of covariates. One approach to…

Methodology · Statistics 2026-02-17 William Bekerman , Abhinandan Dalal , Carlo del Ninno , Dylan S. Small