English
Related papers

Related papers: Robust Design and Evaluation of Predictive Algorit…

200 papers

The paper concerns the probabilistic evaluation of plans in the presence of unmeasured variables, each plan consisting of several concurrent or sequential actions. We establish a graphical criterion for recognizing when the effects of a…

Artificial Intelligence · Computer Science 2013-02-21 Judea Pearl , James M. Robins

Economists often estimate economic models on data and use the point estimates as a stand-in for the truth when studying the model's implications for optimal decision-making. This practice ignores model ambiguity, exposes the decision…

Econometrics · Economics 2021-10-07 Maximilian Blesch , Philipp Eisenhauer

Probabilistic models analyze data by relying on a set of assumptions. Data that exhibit deviations from these assumptions can undermine inference and prediction quality. Robust models offer protection against mismatch between a model's…

Machine Learning · Statistics 2018-06-20 Yixin Wang , Alp Kucukelbir , David M. Blei

We explore the problem of learning under selective labels in the context of algorithm-assisted decision making. Selective labels is a pervasive selection bias problem that arises when historical decision making blinds us to the true outcome…

Machine Learning · Computer Science 2018-07-06 Maria De-Arteaga , Artur Dubrawski , Alexandra Chouldechova

The discovery of discriminatory bias in human or automated decision making is a task of increasing importance and difficulty, exacerbated by the pervasive use of machine learning and data mining. Currently, discrimination discovery largely…

Computers and Society · Computer Science 2019-11-05 Bilal Qureshi , Faisal Kamiran , Asim Karim , Salvatore Ruggieri , Dino Pedreschi

The predictability of errors in deterministic temperature forecasts is investigated. More precisely, the aim is to issue warnings whenever the differences between forecast and verification exceed a given threshold. The warnings are…

Atmospheric and Oceanic Physics · Physics 2011-12-08 S. Hallerberg , J. Bröcker , H. Kantz , L. A. Smith

Convenient access to observational data enables us to learn causal effects without randomized experiments. This research direction draws increasing attention in research areas such as economics, healthcare, and education. For example, we…

Social and Information Networks · Computer Science 2019-12-03 Ruocheng Guo , Jundong Li , Huan Liu

Causal structure learning is a key problem in many domains. Causal structures can be learnt by performing experiments on the system of interest. We address the largely unexplored problem of designing a batch of experiments that each…

Machine Learning · Computer Science 2021-11-25 Scott Sussex , Andreas Krause , Caroline Uhler

A growing literature on human-AI decision-making investigates strategies for combining human judgment with statistical models to improve decision-making. Research in this area often evaluates proposed improvements to models, interfaces, or…

Computers and Society · Computer Science 2023-05-29 Luke Guerdan , Amanda Coston , Zhiwei Steven Wu , Kenneth Holstein

The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within. A biased model can then make decisions that disproportionately harm certain groups in society. Much…

Machine Learning · Computer Science 2022-06-28 José Pombal , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

In an attempt to make algorithms fair, the machine learning literature has largely focused on equalizing decisions, outcomes, or error rates across race or gender groups. To illustrate, consider a hypothetical government rideshare program…

Machine Learning · Computer Science 2024-02-14 Alex Chohlas-Wood , Madison Coots , Henry Zhu , Emma Brunskill , Sharad Goel

The inability of artificial neural networks to assess the uncertainty of their predictions is an impediment to their widespread use. We distinguish two types of learnable uncertainty: model uncertainty due to a lack of training data and…

Machine Learning · Computer Science 2022-06-14 Hans Weytjens , Jochen De Weerdt

Causal inference plays a vital role in diverse domains like epidemiology, healthcare, and economics. De-confounding and counterfactual prediction in observational data has emerged as a prominent concern in causal inference research. While…

Machine Learning · Computer Science 2023-09-08 Yonghe Zhao , Qiang Huang , Siwei Wu , Yun Peng , Huiyan Sun

A burgeoning paradigm in algorithm design is the field of algorithms with predictions, in which algorithms can take advantage of a possibly-imperfect prediction of some aspect of the problem. While much work has focused on using predictions…

Machine Learning · Computer Science 2022-10-18 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar , Sergei Vassilvitskii

Estimating effects of spatially structured exposures is complicated by unmeasured spatial confounders, which undermine identifiability in spatial linear regression models unless structural assumptions are imposed. We develop a general…

Methodology · Statistics 2025-12-30 Anik Burman , Elizabeth L. Ogburn , Abhirup Datta

Link prediction has aroused extensive attention since it can both discover hidden connections and predict future links in the networks. Many unsupervised link prediction algorithms have been proposed to find these links in a variety of…

Social and Information Networks · Computer Science 2021-05-10 Jingwei Wang , Yunlong Ma , Yun Yuan

Marginal structural models are a popular tool for investigating the effects of time-varying treatments, but they require an assumption of no unobserved confounders between the treatment and outcome. With observational data, this assumption…

Methodology · Statistics 2021-06-10 Matthew Blackwell , Soichiro Yamauchi

We propose a rigorous decomposition of predictive error, highlighting that not all 'irreducible' error is genuinely immutable. Many domains stand to benefit from iterative enhancements in measurement, construct validity, and modeling. Our…

Machine Learning · Computer Science 2025-02-12 Jiani Yan , Charles Rahal

There is a growing concern about typically opaque decision-making with high-performance machine learning algorithms. Providing an explanation of the reasoning process in domain-specific terms can be crucial for adoption in risk-sensitive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Aditya Chattopadhyay , Stewart Slocum , Benjamin D. Haeffele , Rene Vidal , Donald Geman

The importance of algorithmic fairness grows with the increasing impact machine learning has on people's lives. Recent work on fairness metrics shows the need for causal reasoning in fairness constraints. In this work, a practical method…

Machine Learning · Computer Science 2020-08-26 Rik Helwegen , Christos Louizos , Patrick Forré