English
Related papers

Related papers: Preserving Fairness in AI under Domain Shift

200 papers

The idealization of a static machine-learned model, trained once and deployed forever, is not practical. As input distributions change over time, the model will not only lose accuracy, any constraints to reduce bias against a protected…

Machine Learning · Computer Science 2022-06-15 Abdulaziz A. Almuzaini , Chidansh A. Bhatt , David M. Pennock , Vivek K. Singh

The widespread use of Artificial Intelligence (AI) in consequential domains, such as healthcare and parole decision-making systems, has drawn intense scrutiny on the fairness of these methods. However, ensuring fairness is often…

Artificial Intelligence · Computer Science 2021-09-10 Ninareh Mehrabi , Umang Gupta , Fred Morstatter , Greg Ver Steeg , Aram Galstyan

Machine learning algorithms have achieved remarkable success across various disciplines, use cases and applications, under the prevailing assumption that training and test samples are drawn from the same distribution. Consequently, these…

Machine Learning · Computer Science 2024-11-07 Zehao Xiao , Cees G. M. Snoek

Machine learning systems must adapt to data distributions that evolve over time, in applications ranging from sensor networks and self-driving car perception modules to brain-machine interfaces. We consider gradual domain adaptation, where…

Machine Learning · Computer Science 2020-02-27 Ananya Kumar , Tengyu Ma , Percy Liang

Data-driven learning algorithms are employed in many online applications, in which data become available over time, like network monitoring, stock price prediction, job applications, etc. The underlying data distribution might evolve over…

Machine Learning · Computer Science 2021-08-16 Vasileios Iosifidis , Wenbin Zhang , Eirini Ntoutsi

Deep reinforcement learning agents have recently been successful across a variety of discrete and continuous control tasks; however, they can be slow to train and require a large number of interactions with the environment to learn a…

Machine Learning · Computer Science 2018-12-19 Thomas Carr , Maria Chli , George Vogiatzis

Fairness and robustness are critical elements of Trustworthy AI that need to be addressed together. Fairness is about learning an unbiased model while robustness is about learning from corrupted data, and it is known that addressing only…

Machine Learning · Computer Science 2021-10-28 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

This study delves into the pervasive issue of gender issues in artificial intelligence (AI), specifically within automatic scoring systems for student-written responses. The primary objective is to investigate the presence of gender biases,…

Computers and Society · Computer Science 2025-01-29 Ehsan Latif , Xiaoming Zhai , Lei Liu

Fairness in machine learning has attracted increasing attention in recent years. The fairness methods improving algorithmic fairness for in-distribution data may not perform well under distribution shifts. In this paper, we first…

Machine Learning · Computer Science 2023-10-24 Zhimeng Jiang , Xiaotian Han , Hongye Jin , Guanchu Wang , Rui Chen , Na Zou , Xia Hu

Artificial Intelligence has the potential to exacerbate societal bias and set back decades of advances in equal rights and civil liberty. Data used to train machine learning algorithms may capture social injustices, inequality or…

Computers and Society · Computer Science 2020-08-18 Susan Leavy , Barry O'Sullivan , Eugenia Siapera

Training supervised machine learning systems with a fairness loss can improve prediction fairness across different demographic groups. However, doing so requires demographic annotations for training data, without which we cannot produce…

Machine Learning · Computer Science 2024-04-17 Carlos Aguirre , Mark Dredze

In AI-based histopathology, domain shifts are common and well-studied. However, this research focuses on stain and scanner variations, which do not show the full picture -- shifts may be combinations of other shifts, or "invisible" shifts…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Andrew Walker

Due to the recent cases of algorithmic bias in data-driven decision-making, machine learning methods are being put under the microscope in order to understand the root cause of these biases and how to correct them. Here, we consider a basic…

Machine Learning · Computer Science 2016-10-25 L. Elisa Celis , Amit Deshpande , Tarun Kathuria , Nisheeth K. Vishnoi

Recent artificial intelligence (AI) technologies show remarkable evolution in various academic fields and industries. However, in the real world, dynamic data lead to principal challenges for deploying AI models. An unexpected data change…

Machine Learning · Computer Science 2024-02-21 Jeng-Lin Li , Chih-Fan Hsu , Ming-Ching Chang , Wei-Chao Chen

Auditing involves verifying the proper implementation of a given policy. As such, auditing is essential for ensuring compliance with the principles of fairness, equity, and transparency mandated by the European Union's AI Act. Moreover,…

Applications · Statistics 2025-12-04 Valentin Lafargue , Emmanuelle Claeys , Jean-Michel Loubes

Fairness-aware domain generalization (FairDG) has emerged as a critical challenge for deploying trustworthy AI systems, particularly in scenarios involving distribution shifts. Traditional methods for addressing fairness have failed in…

Machine Learning · Computer Science 2025-05-01 Yujie Lin , Dong Li , Minglai Shao , Guihong Wan , Chen Zhao

Bias in training datasets must be managed for various groups in classification tasks to ensure parity or equal treatment. With the recent growth in artificial intelligence models and their expanding role in automated decision-making,…

Machine Learning · Computer Science 2023-11-07 Mehdi Yazdani-Jahromi , AmirArsalan Rajabi , Ali Khodabandeh Yalabadi , Aida Tayebi , Ozlem Ozmen Garibay

Artificial Intelligence (AI) systems are not intrinsically neutral and biases trickle in any type of technological tool. In particular when dealing with people, the impact of AI algorithms' technical errors originating with mislabeled data…

Artificial Intelligence · Computer Science 2025-04-03 Camilla Quaresmini , Giuseppe Primiero

Fairness,the impartial treatment towards individuals or groups regardless of their inherent or acquired characteristics [20], is a critical challenge for the successful implementation of Artificial Intelligence (AI) in multiple fields like…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Catalina M Jaramillo , Paul Squires , Julian Togelius

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth