English
Related papers

Related papers: Statistical Methods for Assessing Differences in F…

200 papers

Although significant progress has been made in face recognition, demographic bias still exists in face recognition systems. For instance, it usually happens that the face recognition performance for a certain demographic group is lower than…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Fu-En Wang , Chien-Yi Wang , Min Sun , Shang-Hong Lai

We reveal critical insights into problems of bias in state-of-the-art facial recognition (FR) systems using a novel Balanced Faces In the Wild (BFW) dataset: data balanced for gender and ethnic groups. We show variations in the optimal…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Joseph P Robinson , Gennady Livitz , Yann Henon , Can Qin , Yun Fu , Samson Timoner

Learning a fair predictive model is crucial to mitigate biased decisions against minority groups in high-stakes applications. A common approach to learn such a model involves solving an optimization problem that maximizes the predictive…

Machine Learning · Computer Science 2023-06-08 Abhin Shah , Maohao Shen , Jongha Jon Ryu , Subhro Das , Prasanna Sattigeri , Yuheng Bu , Gregory W. Wornell

Observed events in recommendation are consequence of the decisions made by a policy, thus they are usually selectively labeled, namely the data are Missing Not At Random (MNAR), which often causes large bias to the estimate of true outcomes…

Machine Learning · Computer Science 2021-10-05 Zifeng Wang , Xi Chen , Rui Wen , Shao-Lun Huang

Assessing whether two patient populations exhibit comparable event dynamics is essential for evaluating treatment equivalence, pooling data across cohorts, or comparing clinical pathways across hospitals or strategies. We introduce a…

Methodology · Statistics 2026-04-10 Zoe Kristin Lange , Maryam Farhadizadeh , Holger Dette , Nadine Binder

The most widely used task fMRI analyses use parametric methods that depend on a variety of assumptions. While individual aspects of these fMRI models have been evaluated, they have not been evaluated in a comprehensive manner with empirical…

Applications · Statistics 2016-07-14 Anders Eklund , Thomas Nichols , Hans Knutsson

Clustering is part of unsupervised analysis methods that consist in grouping samples into homogeneous and separate subgroups of observations also called clusters. To interpret the clusters, statistical hypothesis testing is often used to…

Methodology · Statistics 2022-10-25 Benjamin Hivert , Denis Agniel , Rodolphe Thiébaut , Boris P Hejblum

Effective machine learning models can automatically learn useful information from a large quantity of data and provide decisions in a high accuracy. These models may, however, lead to unfair predictions in certain sense among the population…

Machine Learning · Computer Science 2020-06-19 Mingliang Chen , Min Wu

Data-driven algorithms play a large role in decision making across a variety of industries. Increasingly, these algorithms are being used to make decisions that have significant ramifications for people's social and economic well-being,…

Machine Learning · Computer Science 2018-09-26 J. Henry Hinnefeld , Peter Cooman , Nat Mammo , Rupert Deese

The wide use of social media sites and other digital technologies have resulted in an unprecedented availability of digital data that are being used to study human behavior across research domains. Although unsolicited opinions and…

Social and Information Networks · Computer Science 2018-06-01 Nina Cesare , Christan Grant , Quynh Nguyen , Hedwig Lee , Elaine O. Nsoesie

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Hypothesis testing in high dimensional data is a notoriously difficult problem without direct access to competing models' likelihood functions. This paper argues that statistical divergences can be used to quantify the difference between…

Data Analysis, Statistics and Probability · Physics 2024-08-02 Jeremy J. H. Wilkinson , Christopher G. Lester

Complex statistical machine learning models are increasingly being used or considered for use in high-stakes decision-making pipelines in domains such as financial services, health care, criminal justice and human services. These models are…

Applications · Statistics 2017-07-04 Alexandra Chouldechova , Max G'Sell

Applications based on Machine Learning models have now become an indispensable part of the everyday life and the professional world. A critical question then recently arised among the population: Do algorithmic decisions convey any type of…

Machine Learning · Statistics 2020-04-07 Philippe Besse , Eustasio del Barrio , Paula Gordaliza , Jean-Michel Loubes , Laurent Risser

There are demographic biases present in current facial recognition (FR) models. To measure these biases across different ethnic and gender subgroups, we introduce our Balanced Faces in the Wild (BFW) dataset. This dataset allows for the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Joseph P Robinson , Can Qin , Yann Henon , Samson Timoner , Yun Fu

As machine learning (ML) algorithms are increasingly used in social domains to make predictions about humans, there is a growing concern that these algorithms may exhibit biases against certain social groups. Numerous notions of fairness…

Machine Learning · Computer Science 2025-09-30 Zhongteng Cai , Mohammad Mahdi Khalili , Xueru Zhang

Symmetry plays a central role in the sciences, machine learning, and statistics. While statistical tests for the presence of distributional invariance with respect to groups have a long history, tests for conditional symmetry in the form of…

Methodology · Statistics 2025-12-12 Kenny Chiu , Alex Sharp , Benjamin Bloem-Reddy

Recent advances in probabilistic modelling have led to a large number of simulation-based inference algorithms which do not require numerical evaluation of likelihoods. However, a public benchmark with appropriate performance metrics for…

Machine Learning · Statistics 2021-04-12 Jan-Matthis Lueckmann , Jan Boelts , David S. Greenberg , Pedro J. Gonçalves , Jakob H. Macke

In the past few years, Artificial Intelligence (AI) has garnered attention from various industries including financial services (FS). AI has made a positive impact in financial services by enhancing productivity and improving risk…

As automated classification systems become increasingly prevalent, concerns have emerged over their potential to reinforce and amplify existing societal biases. In the light of this issue, many methods have been proposed to enhance the…

Machine Learning · Computer Science 2026-02-13 Ainhize Barrainkua , Santiago Mazuelas , Novi Quadrianto , Jose A. Lozano