English
Related papers

Related papers: Fast Threshold Tests for Detecting Discrimination

200 papers

Microtask crowdsourcing has enabled dataset advances in social science and machine learning, but existing crowdsourcing schemes are too expensive to scale up with the expanding volume of data. To scale and widen the applicability of…

Human-Computer Interaction · Computer Science 2016-02-16 Ranjay Krishna , Kenji Hata , Stephanie Chen , Joshua Kravitz , David A. Shamma , Li Fei-Fei , Michael S. Bernstein

How do we design measures of social bias that we trust? While prior work has introduced several measures, no measure has gained widespread trust: instead, mounting evidence argues we should distrust these measures. In this work, we design…

Computation and Language · Computer Science 2024-07-19 Rishi Bommasani , Percy Liang

We study how to perform tests on samples of pairs of observations and predictions in order to assess whether or not the predictions are prudent. Prudence requires that that the mean of the difference of the observation-prediction pairs can…

Risk Management · Quantitative Finance 2022-10-03 Dirk Tasche

The problem of binary hypothesis testing between two probability measures is considered. New sharp bounds are derived for the best achievable error probability of such tests based on independent and identically distributed observations.…

Information Theory · Computer Science 2024-05-30 Valentinian Lungu , Ioannis Kontoyiannis

This paper conducts fairness testing of automated pedestrian detection, a crucial but under-explored issue in autonomous driving systems. We evaluate eight state-of-the-art deep learning-based pedestrian detectors across demographic groups…

Computers and Society · Computer Science 2024-10-18 Xinyue Li , Zhenpeng Chen , Jie M. Zhang , Federica Sarro , Ying Zhang , Xuanzhe Liu

Fair clustering is the process of grouping similar entities together, while satisfying a mathematically well-defined fairness metric as a constraint. Due to the practical challenges in precise model specification, the prescribed fairness…

Machine Learning · Statistics 2021-02-09 Sainyam Galhotra , Sandhya Saisubramanian , Shlomo Zilberstein

Choosing a decision threshold is one of the challenging job in any classification tasks. How much the model is accurate, if the deciding boundary is not picked up carefully, its entire performance would go in vain. On the other hand, for…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Bharat Bohara

In modern scientific research, small-scale studies with limited participants are increasingly common. However, interpreting individual outcomes can be challenging, making it standard practice to combine data across studies using random…

Statistics Theory · Mathematics 2025-11-04 Lucas Kania , Larry Wasserman , Sivaraman Balakrishnan

In group testing, the task is to identify defective items by testing groups of them together using as few tests as possible. We consider the setting where each item is defective with a constant probability $\alpha$, independent of all other…

Discrete Mathematics · Computer Science 2024-11-15 Lukas Hintze , Lena Krieg , Olga Scheftelowitsch , Haodong Zhu

Data-driven algorithms play a large role in decision making across a variety of industries. Increasingly, these algorithms are being used to make decisions that have significant ramifications for people's social and economic well-being,…

Machine Learning · Computer Science 2018-09-26 J. Henry Hinnefeld , Peter Cooman , Nat Mammo , Rupert Deese

As predictive algorithms grow in popularity, using the same dataset to both train and test a new model has become routine across research, policy, and industry. Sample-splitting attains valid inference on model properties by using separate…

Econometrics · Economics 2025-11-27 Bruno Fava

Change point detection plays a fundamental role in many real-world applications, where the goal is to analyze and monitor the behaviour of a data stream. In this paper, we study change detection in binary streams. To this end, we use a…

Machine Learning · Computer Science 2023-01-24 Nikolaj Tatti

Calibrated probability outputs of trained classifiers are increasingly used as inputs to downstream regression estimands such as effects, prevalences, or disparities for a latent group observed only on a small labelled subset. A standard…

Methodology · Statistics 2026-05-14 Marcell T. Kurbucz

Multiple hypothesis testing is a significant problem in nearly all neuroimaging studies. In order to correct for this phenomena, we require a reliable estimate of the Family-Wise Error Rate (FWER). The well known Bonferroni correction…

Computation · Statistics 2015-02-17 Chris Hinrichs , Vamsi K Ithapu , Qinyuan Sun , Sterling C Johnson , Vikas Singh

The problem of quickest detection of a change in distribution is considered under the assumption that the pre-change distribution is known, and the post-change distribution is only known to belong to a family of distributions…

Applications · Statistics 2019-01-30 Tze Siong Lau , Wee Peng Tay , Venugopal V. Veeravalli

Hard-threshold estimators are popular in signal processing applications. We provide a detailed study of using hard-threshold estimators for estimating an unknown deterministic signal when additive white Gaussian noise corrupts observations.…

Statistics Theory · Mathematics 2008-01-24 Baris I. Erkmen , Vivek K. Goyal

Intuitively, unfamiliarity should lead to lack of confidence. In reality, current algorithms often make highly confident yet wrong predictions when faced with relevant but unfamiliar examples. A classifier we trained to recognize gender is…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Zhizhong Li , Derek Hoiem

Consider a statistical problem where a set of parameters are of interest to a researcher. Then multiple confidence intervals can be constructed to infer the set of parameters simultaneously. The constructed multiple confidence intervals are…

Methodology · Statistics 2019-12-10 Taeho Kim , Edsel A. Pena

Intersectionality is a framework that analyzes how interlocking systems of power and oppression affect individuals along overlapping dimensions including race, gender, sexual orientation, class, and disability. Intersectionality theory…

Machine Learning · Computer Science 2019-09-11 James Foulds , Rashidul Islam , Kamrun Keya , Shimei Pan

The use of group testing to locate all instances of disease in a large population of blood samples was first considered seventy years ago. Since then, several methods have been used to approximate the minimum expected number of tests. The…

Applications · Statistics 2015-03-24 Seth Zimmerman