English
Related papers

Related papers: How much does your data exploration overfit? Contr…

200 papers

Biased human decisions have consequential impacts across various domains, yielding unfair treatment of individuals and resulting in suboptimal outcomes for organizations and society. In recognition of this fact, organizations regularly…

Machine Learning · Computer Science 2024-12-11 Wanxue Dong , Maria De-Arteaga , Maytal Saar-Tsechansky

An important factor to guarantee a fair use of data-driven recommendation systems is that we should be able to communicate their uncertainty to decision makers. This can be accomplished by constructing prediction intervals, which provide an…

Methodology · Statistics 2019-08-16 Yaniv Romano , Rina Foygel Barber , Chiara Sabatti , Emmanuel J. Candès

Probabilities of causation are fundamental to individual-level explanation and decision making, yet they are inherently counterfactual and not point-identifiable from data in general. Existing bounds either disregard available covariates,…

Artificial Intelligence · Computer Science 2026-02-17 Yuxuan Xie , Ang Li

Information Theory provides a fundamental basis for analysis, and for a variety of subsequent methodological approaches, in relation to uncertainty quantification. The transversal character of concepts and derived results justifies its…

Statistics Theory · Mathematics 2024-11-27 Jose M. Angulo , Francisco J. Esquivel , Ana E. Madrid , Francisco J. Alonso

Accurately analyzing and modeling online browsing behavior play a key role in understanding users and technology interactions. In this work, we design and conduct a user study to collect browsing data from 31 participants continuously for…

Computers and Society · Computer Science 2021-08-17 Yuliia Lut , Michael Wang , Elissa M. Redmiles , Rachel Cummings

What we discover and see online, and consequently our opinions and decisions, are becoming increasingly affected by automated machine learned predictions. Similarly, the predictive accuracy of learning machines heavily depends on the…

Information Retrieval · Computer Science 2020-01-15 Sami Khenissi , Olfa Nasraoui

Consumers discover their preferences through experience, yet the sequence and composition of those experiences are often designed by firms, digital platforms, or policymakers. We introduce a ``data-design'' framework for preference…

Theoretical Economics · Economics 2026-04-17 Sebastiano Della Lena , Alessio Muscillo , Paolo Pin

Limited overlap between treated and control groups is a key challenge in observational analysis. Standard approaches like trimming importance weights can reduce variance but introduce a fundamental bias. We propose a sensitivity framework…

Machine Learning · Statistics 2026-04-21 Yuanzhe Ma , Yian Huang , Hongseok Namkoong

Decisions in organizations are about evaluating alternatives and choosing the one that would best serve organizational goals. To the extent that the evaluation of alternatives could be formulated as a predictive task with appropriate…

Human-Computer Interaction · Computer Science 2022-06-30 Charles Wan , Rodrigo Belo , Leid Zejnilović

The standard theory of optimal stopping is based on the idealised assumption that the underlying process is essentially known. In this paper, we drop this restriction and study data-driven optimal stopping for a general diffusion process,…

Statistics Theory · Mathematics 2023-12-12 Sören Christensen , Niklas Dexheimer , Claudia Strauch

How to incentivize self-interested agents to explore when they prefer to exploit? Consider a population of self-interested agents that make decisions under uncertainty. They "explore" to acquire new information and "exploit" this…

Computer Science and Game Theory · Computer Science 2024-10-23 Aleksandrs Slivkins

While recent years have witnessed a rapid growth of research papers on recommender system (RS), most of the papers focus on inventing machine learning models to better fit user behavior data. However, user behavior data is observational…

Information Retrieval · Computer Science 2021-12-30 Jiawei Chen , Hande Dong , Xiang Wang , Fuli Feng , Meng Wang , Xiangnan He

We examine the relationship between privacy metrics that utilize information density to measure information leakage between a private and a disclosed random variable. Firstly, we prove that bounding the information density from above or…

Information Theory · Computer Science 2024-02-21 Leonhard Grosse , Sara Saeidian , Parastoo Sadeghi , Tobias J. Oechtering , Mikael Skoglund

In recent years, information-theoretic generalization bounds have gained increasing attention for analyzing the generalization capabilities of meta-learning algorithms. However, existing results are confined to two-step bounds, failing to…

Machine Learning · Statistics 2025-10-14 Wen Wen , Tieliang Gong , Yuxin Dong , Zeyu Gao , Yong-Jin Liu

In 1977 John Tukey described how in exploratory data analysis, data analysts use tools, such as data visualizations, to separate their expectations from what they observe. In contrast to statistical theory, an underappreciated aspect of…

Methodology · Statistics 2024-02-02 Roger D. Peng , Stephanie C. Hicks

We provide novel bounds on average treatment effects (on the treated) that are valid under an unconfoundedness assumption. Our bounds are designed to be robust in challenging situations, for example, when the conditioning variables take on…

Econometrics · Economics 2026-05-12 Sokbae Lee , Martin Weidner

Differential privacy ensures the security of individual privacy but poses challenges to data exploration processes because the limited privacy budget incapacitates the flexibility of exploration and the noisy feedback of data requests leads…

Human-Computer Interaction · Computer Science 2024-07-30 Xumeng Wang , Shuangcheng Jiao , Chris Bryan

Estimating the causal effect of a treatment or health policy with observational data can be challenging due to an imbalance of and a lack of overlap between treated and control covariate distributions. In the presence of limited overlap,…

Methodology · Statistics 2025-03-24 Martha Barnard , Jared D. Huling , Julian Wolfson

Understanding human activities and movements on the Web is not only important for computational social scientists but can also offer valuable guidance for the design of online systems for recommendations, caching, advertising, and…

Computers and Society · Computer Science 2021-01-01 Juhi Kulshrestha , Marcos Oliveira , Orkut Karacalik , Denis Bonnay , Claudia Wagner

We consider a sequential decision making task, where the goal is to optimize an unknown function without evaluating parameters that violate an a~priori unknown (safety) constraint. A common approach is to place a Gaussian process prior on…

Machine Learning · Computer Science 2024-05-13 Alessandro G. Bottero , Carlos E. Luis , Julia Vinogradska , Felix Berkenkamp , Jan Peters