English
Related papers

Related papers: Data AUDIT: Identifying Attribute Utility- and Det…

200 papers

Evaluating machine learning models is crucial not only for determining their technical accuracy but also for assessing their potential societal implications. While the potential for low-sample-size bias in algorithms is well known, we…

Machine Learning · Computer Science 2025-05-08 Jarren Briscoe , Garrett Kepler , Daryl Deford , Assefaw Gebremedhin

In recent years, the rapid development of artificial intelligence (AI) systems has raised concerns about our ability to ensure their fairness, that is, how to avoid discrimination based on protected characteristics such as gender, race, or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar , MaryBeth Defrance , Maarten Buyl , Tijl De Bie

Subset selection algorithms are ubiquitous in AI-driven applications, including, online recruiting portals and image search engines, so it is imperative that these tools are not discriminatory on the basis of protected attributes such as…

Computers and Society · Computer Science 2021-02-23 Anay Mehrotra , L. Elisa Celis

Machine learning (ML) models often exhibit bias that can exacerbate inequities in biomedical applications. Fairness auditing, the process of evaluating a model's performance across subpopulations, is critical for identifying and mitigating…

Methodology · Statistics 2026-05-19 Jianhui Gao , Jessica Gronsbell

Thanks to the increasing growth of computational power and data availability, the research in machine learning has advanced with tremendous rapidity. Nowadays, the majority of automatic decision making systems are based on data. However, it…

Machine Learning · Computer Science 2021-01-28 Elena Beretta , Antonio Vetrò , Bruno Lepri , Juan Carlos De Martin

Advanced image editing software enables easy creation of highly convincing image manipulations, which has been made even more accessible in recent years due to advances in generative AI. Manipulated images, while often harmless, could…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Keanu Nichols , Divya Appapogu , Giscard Biamby , Dina Bashkirova , Anna Rohrbach , Bryan A. Plummer

Objectives: Leveraging artificial intelligence (AI) in conjunction with electronic health records (EHRs) holds transformative potential to improve healthcare. Yet, addressing bias in AI, which risks worsening healthcare disparities, cannot…

Artificial Intelligence · Computer Science 2026-01-08 Feng Chen , Liqin Wang , Julie Hong , Jiaqi Jiang , Li Zhou

Fairness and accountability are two essential pillars for trustworthy Artificial Intelligence (AI) in healthcare. However, the existing AI model may be biased in its decision marking. To tackle this issue, we propose an adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Xiaoxiao Li , Ziteng Cui , Yifan Wu , Lin Gu , Tatsuya Harada

Machine learned models exhibit bias, often because the datasets used to train them are biased. This presents a serious problem for the deployment of such technology, as the resulting models might perform poorly on populations that are…

Machine Learning · Computer Science 2018-10-02 Daniel McDuff , Roger Cheng , Ashish Kapoor

Machine learning systems are increasingly deployed in high-stakes domains, yet they remain vulnerable to bias systematic disparities that disproportionately impact specific demographic groups. Traditional bias detection methods often depend…

Machine Learning · Computer Science 2025-06-16 Chirudeep Tupakula , Rittika Shamsuddin

The rapid deployment of AI systems in high-stakes domains, including those classified as high-risk under the The EU AI Act (Regulation (EU) 2024/1689), has intensified the need for reliable compliance auditing. For binary classifiers,…

Machine Learning · Computer Science 2026-03-10 Valentin Lafargue , Adriana Laurindo Monteiro , Emmanuelle Claeys , Laurent Risser , Jean-Michel Loubes

Artificial intelligence (AI) systems increasingly inform medical decision-making, yet concerns about algorithmic bias and inequitable outcomes persist, particularly for historically marginalized populations. This paper introduces the…

Machine Learning · Computer Science 2025-07-22 Andrés Morales-Forero , Lili J. Rueda , Ronald Herrera , Samuel Bassetto , Eric Coatanea

Machine learning model bias can arise from dataset composition: correlated sensitive features can distort the downstream classification model's decision boundary and lead to performance differences along these features. Existing de-biasing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Miao Zhang , Zee fryer , Ben Colman , Ali Shahriyari , Gaurav Bharaj

Ensuring a neural network is not relying on protected attributes (e.g., race, sex, age) for predictions is crucial in advancing fair and trustworthy AI. While several promising methods for removing attribute bias in neural networks have…

Machine Learning · Computer Science 2023-11-17 Jiazhi Li , Mahyar Khayatkhoei , Jiageng Zhu , Hanchen Xie , Mohamed E. Hussein , Wael AbdAlmageed

It is well known that the usefulness of a machine learning model is due to its ability to generalize to unseen data. This study uses three popular cyberbullying datasets to explore the effects of data, how it's collected, and how it's…

Machine Learning · Computer Science 2024-12-03 Andrew Root , Liam Jakubowski , Mounika Vanamala

Visual data from the Web power image classifiers, which often underpin many web services, such as recommendation and content moderation. However, the raw Web data often contain spurious correlations and social biases, and neural networks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jungwook Seo , Yoonsik Park , Changmin Lee , Sungyong Baik

With the rise of AI, algorithms have become better at learning underlying patterns from the training data including ingrained social biases based on gender, race, etc. Deployment of such algorithms to domains such as hiring, healthcare, law…

Machine Learning · Computer Science 2022-08-11 Bhavya Ghai , Klaus Mueller

An increased awareness concerning risks of algorithmic bias has driven a surge of efforts around bias mitigation strategies. A vast majority of the proposed approaches fall under one of two categories: (1) imposing algorithmic fairness…

Machine Learning · Computer Science 2023-07-11 Yunyi Li , Maria De-Arteaga , Maytal Saar-Tsechansky

It is tempting to think that machines are less prone to unfairness and prejudice. However, machine learning approaches compute their outputs based on data. While biases can enter at any stage of the development pipeline, models are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Patrick Esser , Robin Rombach , Björn Ommer

Person attributes are often exploited as mid-level human semantic information to help promote the performance of person re-identification task. In this paper, unlike most existing methods simply taking attribute learning as a classification…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Shuzhao Li , Huimin Yu , Wei Huang , Jing Zhang