English
Related papers

Related papers: Chiseling: Powerful and Valid Subgroup Selection v…

200 papers

Randomized experiments are considered the gold standard for estimating causal effects. However, out of the set of possible randomized assignments, some may be likely to produce poor effect estimates and misleading conclusions. Restricted…

Methodology · Statistics 2025-08-28 Maggie Wang , René F. Kizilcec , Michael Baiocchi

Many selection processes such as finding patients qualifying for a medical trial or retrieval pipelines in search engines consist of multiple stages, where an initial screening stage focuses the resources on shortlisting the most promising…

Machine Learning · Computer Science 2022-06-14 Lequn Wang , Thorsten Joachims , Manuel Gomez Rodriguez

Subgroup discovery is a local pattern mining technique to find interpretable descriptions of sub-populations that stand out on a given target variable. That is, these sub-populations are exceptional with regard to the global distribution.…

Databases · Computer Science 2017-09-26 Janis Kalofolias , Mario Boley , Jilles Vreeken

Researchers often run resource-intensive randomized controlled trials (RCTs) to estimate the causal effects of interventions on outcomes of interest. Yet these outcomes are often noisy, and estimated overall effects can be small or…

Econometrics · Economics 2023-12-21 Jann Spiess , Vasilis Syrgkanis , Victor Yaneng Wang

Generative models typically sample outputs independently, and recent inference-time guidance and scaling algorithms focus on improving the quality of individual samples. However, in real-world applications, users are often presented with a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Gaurav Parmar , Or Patashnik , Daniil Ostashev , Kuan-Chieh Wang , Kfir Aberman , Srinivasa Narasimhan , Jun-Yan Zhu

Subtype Discovery consists in finding interpretable and consistent sub-parts of a dataset, which are also relevant to a certain supervised task. From a mathematical point of view, this can be defined as a clustering task driven by…

Machine Learning · Statistics 2021-07-06 Robin Louiset , Pietro Gori , Benoit Dufumier , Josselin Houenou , Antoine Grigis , Edouard Duchesnay

Deriving insights from high-dimensional data is one of the core problems in data mining. The difficulty mainly stems from the fact that there are exponentially many variable combinations to potentially consider, and there are infinitely…

Machine Learning · Statistics 2021-11-08 Jefrey Lijffijt , Bo Kang , Wouter Duivesteijn , Kai Puolamäki , Emilia Oikarinen , Tijl De Bie

In many modern statistical problems, the limited available data must be used both to develop the hypotheses to test, and to test these hypotheses-that is, both for exploratory and confirmatory data analysis. Reusing the same dataset for…

Methodology · Statistics 2023-07-24 Youngjoo Yun , Rina Foygel Barber

Multi-task learning is frequently used to model a set of related response variables from the same set of features, improving predictive performance and modeling accuracy relative to methods that handle each response variable separately.…

Methodology · Statistics 2023-08-11 Snigdha Panigrahi , Natasha Stewart , Chandra Sekhar Sripada , Elizaveta Levina

A general approach to selective inference is considered for hypothesis testing of the null hypothesis represented as an arbitrary shaped region in the parameter space of multivariate normal model. This approach is useful for hierarchical…

Statistics Theory · Mathematics 2018-03-28 Yoshikazu Terada , Hidetoshi Shimodaira

In a well-calibrated risk prediction model, the average predicted probability is close to the true event rate for any given subgroup. Such models are reliable across heterogeneous populations and satisfy strong notions of algorithmic…

Machine Learning · Computer Science 2023-07-31 Jean Feng , Alexej Gossmann , Romain Pirracchio , Nicholas Petrick , Gene Pennello , Berkman Sahiner

Training a computer vision system to segment a novel class typically requires collecting and painstakingly annotating lots of images with objects from that class. Few-shot segmentation techniques reduce the required number of images to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Shreyas Chandgothia , Ardhendu Sekhar , Amit Sethi

While reliable data-driven decision-making hinges on high-quality labeled data, the acquisition of quality labels often involves laborious human annotations or slow and expensive scientific measurements. Machine learning is becoming an…

Machine Learning · Statistics 2024-03-01 Tijana Zrnic , Emmanuel J. Candès

We propose a new approach to safe variable preselection in high-dimensional penalized regression, such as the lasso. Preselection - to start with a manageable set of covariates - has often been implemented without clear appreciation of its…

We study confidence regions and approximate chi-squared tests for variable groups in high-dimensional linear regression. When the size of the group is small, low-dimensional projection estimators for individual coefficients can be directly…

Statistics Theory · Mathematics 2016-02-23 Ritwik Mitra , Cun-Hui Zhang

Selective inference aims at providing valid inference after a data-driven selection of models or hypotheses. It is essential to avoid overconfident results and replicability issues. While significant advances have been made in this area for…

Methodology · Statistics 2025-03-14 Matteo D'Alessandro , Magne Thoresen

Instrumental variable methods have been widely used to identify causal effects in the presence of unmeasured confounding. A key identification condition known as the exclusion restriction states that the instrument cannot have a direct…

Methodology · Statistics 2022-08-05 Baoluo Sun , Yifan Cui , Eric Tchetgen Tchetgen

Given a sample of covariate-response pairs, we consider the subgroup selection problem of identifying a subset of the covariate domain where the regression function exceeds a pre-determined threshold. We introduce a computationally-feasible…

Statistics Theory · Mathematics 2023-06-29 Manuel M. Müller , Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

Machine Learning · Computer Science 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

Causal inference with observational studies often relies on the assumptions of unconfoundedness and overlap of covariate distributions in different treatment groups. The overlap assumption is violated when some units have propensity scores…

Methodology · Statistics 2022-07-19 Shu Yang , Peng Ding