English
Related papers

Related papers: Efficient estimation and correction of selection-i…

200 papers

Large-scale datasets are increasingly being used to inform decision making. While this effort aims to ground policy in real-world evidence, challenges have arisen as selection bias and other forms of distribution shifts often plague…

Methodology · Statistics 2023-11-07 Santiago Cortes-Gomez , Mateo Dulce , Carlos Patino , Bryan Wilder

Societal biases that are contained in retrieved documents have received increased interest. Such biases, which are often prevalent in the training data and learned by the model, can cause societal harms, by misrepresenting certain groups,…

Information Retrieval · Computer Science 2023-09-19 Maria Heuss , Daniel Cohen , Masoud Mansoury , Maarten de Rijke , Carsten Eickhoff

Using instruments comprising ordered responses to items are ubiquitous for studying many constructs of interest. However, using such an item response format may lead to items with response categories infrequently endorsed or unendorsed…

Methodology · Statistics 2024-05-02 R. Noah Padgett , Grant B. Morgan , Tim Lomas

Causal classification models are adopted across a variety of operational business processes to predict the effect of a treatment on a categorical business outcome of interest depending on the process instance characteristics. This allows…

Machine Learning · Computer Science 2021-01-06 Diego Olaya , Wouter Verbeke , Jente Van Belle , Marie-Anne Guerry

Many applications require the collection of data on different variables or measurements over many system performance metrics. We term those broadly as measures or variables. Often data collection along each measure incurs a cost, thus it is…

Methodology · Statistics 2021-11-30 Donghui Yan , Zhiwei Qin , Songxiang Gu , Haiping Xu , Ming Shao

By amalgamating data from disparate sources, the resulting integrated dataset becomes a valuable resource for statistical analysis. In probabilistic record linkage, the effectiveness of such integration relies on the availability of linkage…

Methodology · Statistics 2025-11-10 Siu-Ming Tam , Min Wang , Alicia Rambaldi , Dehua Tao

Pricing decisions of companies require an understanding of the causal effect of a price change on the demand. When real-life pricing experiments are infeasible, data-driven decision-making must be based on alternative data sources such as…

Applications · Statistics 2024-07-03 Lauri Valkonen , Santtu Tikka , Jouni Helske , Juha Karvanen

We investigate the estimation of multivariate extreme models with a discrete spectral measure using spherical clustering techniques. The primary contribution involves devising a method for selecting the order, that is, the number of…

Methodology · Statistics 2025-02-20 Shiyuan Deng , He Tang , Shuyang Bai

Big data presents potential but unresolved value as a source for analysis and inference. However,selection bias, present in many of these datasets, needs to be accounted for so that appropriate inferences can be made on the target…

Methodology · Statistics 2025-01-09 Lyndon Ang , Robert Clark , Bronwyn Loong , Anders Holmberg

Ordinal measurements are common outcomes in studies within psychology, as well as in the social and behavioral sciences. Choosing an appropriate regression model for analysing such data poses a difficult task. This paper aims to facilitate…

Methodology · Statistics 2026-03-03 Stefan Inerle , Markus Pauly , Moritz Berger

This paper develops a new approach to post-selection inference for screening high-dimensional predictors of survival outcomes. Post-selection inference for right-censored outcome data has been investigated in the literature, but much…

Methodology · Statistics 2021-12-22 Tzu-Jung Huang , Alex Luedtke , Ian W. McKeague

Rule ensembles are designed to provide a useful trade-off between predictive accuracy and model interpretability. However, the myopic and random search components of current rule ensemble methods can compromise this goal: they often need…

Machine Learning · Computer Science 2021-01-22 Mario Boley , Simon Teshuva , Pierre Le Bodic , Geoffrey I Webb

A probabilistic expert system emulates the decision-making ability of a human expert through a directional graphical model. The first step in building such systems is to understand data generation mechanism. To this end, one may try to…

Methodology · Statistics 2021-09-29 Vahid Partovi Nia , Xinlin Li , Masoud Asgharian , Shoubo Hu , Zhitang Chen , Yanhui Geng

Classification model selection is a process of identifying a suitable model class for a given classification task on a dataset. Traditionally, model selection is based on cross-validation, meta-learning, and user preferences, which are…

Machine Learning · Computer Science 2023-05-24 Sudarsun Santhiappan , Nitin Shravan , Balaraman Ravindran

Classification is a well-studied machine learning task which concerns the assignment of instances to a set of outcomes. Classification models support the optimization of managerial decision-making across a variety of operational business…

Machine Learning · Computer Science 2025-05-19 Wouter Verbeke , Diego Olaya , Jeroen Berrevoets , Sam Verboven , Sebastián Maldonado

There has been increasing interest in recent years in the development of approaches to estimate causal effects when the number of potential confounders is prohibitively large. This growth in interest has led to a number of potential…

Methodology · Statistics 2020-02-05 Joseph Antonelli , Matthew Cefalu

Selective inference aims at providing valid inference after a data-driven selection of models or hypotheses. It is essential to avoid overconfident results and replicability issues. While significant advances have been made in this area for…

Methodology · Statistics 2025-03-14 Matteo D'Alessandro , Magne Thoresen

Under interference, the treatment of one unit may affect the outcomes of other units. Such interference patterns between units are typically represented by a network. Correctly specifying this network requires identifying which units can…

Methodology · Statistics 2025-12-23 Bar Weinstein , Daniel Nevo

Estimating a causal query from observational data is an essential task in the analysis of biomolecular networks. Estimation takes as input a network topology, a query estimation method, and observational measurements on the network…

Estimating causal effects from large experimental and observational data has become increasingly prevalent in both industry and research. The bootstrap is an intuitive and powerful technique used to construct standard errors and confidence…

Methodology · Statistics 2023-02-07 Matthew Kosko , Lin Wang , Michele Santacatterina