中文
相关论文

相关论文: Dataset Distribution Impacts Model Fairness: Singl…

200 篇论文

Interpreting the inference-time behavior of deep neural networks remains a challenging problem. Existing approaches to counterfactual explanation typically ask: What is the closest alternative input that would alter the model's prediction…

机器学习 · 计算机科学 2026-02-12 Brian Hyeongseok Kim , Jacqueline L. Mitchell , Chao Wang

Regression-based predictive analytics used in modern kidney transplantation is known to inherit biases from training data. This leads to social discrimination and inefficient organ utilization, particularly in the context of a few social…

人机交互 · 计算机科学 2025-05-13 Mukund Telukunta , Venkata Sriram Siddhardh Nadendla , Morgan Stuart , Casey Canfield

As Artificial Intelligence (AI) increasingly integrates into our daily lives, fairness has emerged as a critical concern, particularly in medical AI, where datasets often reflect inherent biases due to social factors like the…

机器学习 · 计算机科学 2024-07-22 Yi Sheng , Junhuan Yang , Jinyang Li , James Alaina , Xiaowei Xu , Yiyu Shi , Jingtong Hu , Weiwen Jiang , Lei Yang

Convolutional neural networks (CNNs) are increasingly being used to automate the segmentation of brain structures in magnetic resonance (MR) images for research studies. In other applications, CNN models have been shown to exhibit bias…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Stefanos Ioannou , Hana Chockler , Alexander Hammers , Andrew P. King

Fairness is a critical component of Trustworthy AI. In this paper, we focus on Machine Learning (ML) and the performance of model predictions when dealing with skin color. Unlike other sensitive attributes, the nature of skin color differs…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Kuniko Paxton , Koorosh Aslansefat , Dhavalkumar Thakker , Yiannis Papadopoulos

How do we learn from biased data? Historical datasets often reflect historical prejudices; sensitive or protected attributes may affect the observed treatments and outcomes. Classification algorithms tasked with predicting outcomes…

机器学习 · 计算机科学 2018-12-04 David Madras , Elliot Creager , Toniann Pitassi , Richard Zemel

Machine learning technology has become ubiquitous, but, unfortunately, often exhibits bias. As a consequence, disparate stakeholders need to interact with and make informed decisions about using machine learning models in everyday systems.…

人机交互 · 计算机科学 2024-01-12 Aimen Gaba , Zhanna Kaufman , Jason Chueng , Marie Shvakel , Kyle Wm. Hall , Yuriy Brun , Cindy Xiong Bearfield

Software built on top of machine learning algorithms is becoming increasingly prevalent in a variety of fields, including college admissions, healthcare, insurance, and justice. The effectiveness and efficiency of these systems heavily…

机器学习 · 计算机科学 2023-05-25 Ying Xiao , Shangwen Wang , Sicen Liu , Dingyuan Xue , Xian Zhan , Yepang Liu

In this paper, we consider a theoretical model for injecting data bias, namely, under-representation and label bias (Blum & Stangl, 2019). We empirically study the effect of varying data biases on the accuracy and fairness of fair…

机器学习 · 计算机科学 2023-12-12 Mohit Sharma , Amit Deshpande , Rajiv Ratn Shah

Background: Many open-source skin cancer image datasets are the result of clinical trials conducted in countries with lighter skin tones. Due to this tone imbalance, machine learning models derived from these datasets can perform well at…

图像与视频处理 · 电气工程与系统科学 2025-03-20 James Pope , Md Hassanuzzaman , William Chapman , Huw Day , Mingmar Sherpa , Omar Emara , Nirmala Adhikari , Ayush Joshi

There has been an increase in research in developing machine learning models for mental health detection or prediction in recent years due to increased mental health issues in society. Effective use of mental health prediction or detection…

机器学习 · 计算机科学 2022-08-09 Khadija Zanna , Kusha Sridhar , Han Yu , Akane Sano

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

计算与语言 · 计算机科学 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Our society collects data on people for a wide range of applications, from building a census for policy evaluation to running meaningful clinical trials. To collect data, we typically sample individuals with the goal of accurately…

机器学习 · 计算机科学 2024-07-02 Victor Borza , Andrew Estornell , Chien-Ju Ho , Bradley Malin , Yevgeniy Vorobeychik

A biased dataset is a dataset that generally has attributes with an uneven class distribution. These biases have the tendency to propagate to the models that train on them, often leading to a poor performance in the minority class. In this…

计算机视觉与模式识别 · 计算机科学 2022-05-05 Athiya Deviyani

Predicting external hand load from sensor data is essential for ergonomic exposure assessments, as obtaining this information typically requires direct observation or supplementary data. While machine learning methods have been used to…

机器学习 · 计算机科学 2025-04-09 Arafat Rahman , Sol Lim , Seokhyun Chung

Artificial intelligence (AI) has shown remarkable promise in dermatology, offering accurate and non-invasive diagnosis of skin cancer. While extensive research has addressed skin tone-related bias, gender bias in dermatologic AI remains…

图像与视频处理 · 电气工程与系统科学 2025-12-01 Mingcheng Zhu , Mingxuan Liu , Han Yuan , Yilin Ning , Zhiyao Luo , Tingting Zhu , Nan Liu

Machine learning models can inherit biases from their training data, leading to discriminatory or inaccurate predictions. This is particularly concerning with the increasing use of large, unsupervised datasets for training foundational…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Iris Dominguez-Catena , Daniel Paternain , Aranzazu Jurio , Mikel Galar

This work explores the biases in learning processes based on deep neural network architectures. We analyze how bias affects deep learning processes through a toy example using the MNIST database and a case study in gender detection from…

计算机视觉与模式识别 · 计算机科学 2020-07-23 Ignacio Serna , Alejandro Peña , Aythami Morales , Julian Fierrez

It is tempting to think that machines are less prone to unfairness and prejudice. However, machine learning approaches compute their outputs based on data. While biases can enter at any stage of the development pipeline, models are…

计算机视觉与模式识别 · 计算机科学 2020-12-07 Patrick Esser , Robin Rombach , Björn Ommer

Face recognition algorithms, when used in the real world, can be very useful, but they can also be dangerous when biased toward certain demographics. So, it is essential to understand how these algorithms are trained and what factors affect…

计算机视觉与模式识别 · 计算机科学 2023-02-14 Manideep Kolla , Aravinth Savadamuthu