English
Related papers

Related papers: Preserving Fairness in AI under Domain Shift

200 papers

Training fair machine learning models, aiming for their interpretability and solving the problem of domain shift has gained a lot of interest in the last years. There is a vast amount of work addressing these topics, mostly in separation.…

Machine Learning · Computer Science 2021-01-22 Linda H. Boedi , Helmut Grabner

The wide spread usage of automated data-driven decision support systems has raised a lot of concerns regarding accountability and fairness of the employed models in the absence of human supervision. Existing fairness-aware approaches tackle…

Machine Learning · Computer Science 2020-01-24 Vasileios Iosifidis , Thi Ngoc Han Tran , Eirini Ntoutsi

Learning in non-stationary environments is one of the biggest challenges in machine learning. Non-stationarity can be caused by either task drift, i.e., the drift in the conditional distribution of labels given the input data, or the domain…

Machine Learning · Computer Science 2020-03-16 Qicheng Lao , Xiang Jiang , Mohammad Havaei , Yoshua Bengio

Artificial Intelligence (AI) has demonstrated remarkable capabilities in domains such as recruitment, finance, healthcare, and the judiciary. However, biases in AI systems raise ethical and societal concerns, emphasizing the need for…

Despite being trained on balanced datasets, existing AI-generated image detectors often exhibit systematic bias at test time, frequently misclassifying fake images as real. We hypothesize that this behavior stems from distributional shift…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Muli Yang , Gabriel James Goenawan , Henan Wang , Huaiyuan Qin , Chenghao Xu , Yanhua Yang , Fen Fang , Ying Sun , Joo-Hwee Lim , Hongyuan Zhu

The performance of a machine learning model degrades when it is applied to data from a similar but different domain than the data it has initially been trained on. To mitigate this domain shift problem, domain adaptation (DA) techniques…

Machine Learning · Computer Science 2024-10-08 Felix Ott , David Rügamer , Lucas Heublein , Bernd Bischl , Christopher Mutschler

Algorithmic decision making driven by neural networks has become very prominent in applications that directly affect people's quality of life. In this paper, we study the problem of verifying, training, and guaranteeing individual fairness…

Machine Learning · Computer Science 2023-01-31 Kiarash Mohammadi , Aishwarya Sivaraman , Golnoosh Farnadi

Dataset bias is one of the prevailing causes of unfairness in machine learning. Addressing fairness at the data collection and dataset preparation stages therefore becomes an essential part of training fairer algorithms. In particular,…

Machine Learning · Computer Science 2021-04-15 Frédéric Branchaud-Charron , Parmida Atighehchian , Pau Rodríguez , Grace Abuhamad , Alexandre Lacoste

Object recognition is a key enabler across industry and defense. As technology changes, algorithms must keep pace with new requirements and data. New modalities and higher resolution sensors should allow for increased algorithm robustness.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Samuel Rivera , Joel Klipfel , Deborah Weeks

The development of fair and unbiased machine learning models remains an ongoing objective for researchers in the field of artificial intelligence. We introduce the Differential Adjusted Parity (DAP) loss to produce unbiased informative…

Machine Learning · Computer Science 2025-04-10 Bucher Sahyouni , Matthew Vowels , Liqun Chen , Simon Hadfield

Domain adaptation aims to learn models on a supervised source domain that perform well on an unsupervised target. Prior work has examined domain adaptation in the context of stationary domain shifts, i.e. static data sets. However, with…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Sindi Shkodrani , Michael Hofmann , Efstratios Gavves

While machine learning can myopically reinforce social inequalities, it may also be used to dynamically seek equitable outcomes. In this paper, we formalize long-term fairness in the context of online reinforcement learning. This…

Machine Learning · Computer Science 2024-10-02 Tongxin Yin , Reilly Raab , Mingyan Liu , Yang Liu

Domain randomization in reinforcement learning is an established technique for increasing the robustness of control policies trained in simulation. By randomizing environment properties during training, the learned policy can become robust…

In the generalized zero-shot learning, synthesizing unseen data with generative models has been the most popular method to address the imbalance of training data between seen and unseen classes. However, this method requires that the unseen…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Xinsheng Wang , Shanmin Pang , Jihua Zhu

Supervised learning systems are trained using historical data and, if the data was tainted by discrimination, they may unintentionally learn to discriminate against protected groups. We propose that fair learning methods, despite training…

Machine Learning · Computer Science 2026-01-22 Przemyslaw A. Grabowicz , Nicholas Perello , Kenta Takatsu

Emerging Distributed AI systems are revolutionizing big data computing and data processing capabilities with growing economic and societal impact. However, recent studies have identified new attack surfaces and risks caused by security,…

Machine Learning · Computer Science 2024-02-05 Wenqi Wei , Ling Liu

Machine learning algorithms often struggle to eliminate inherent data biases, particularly those arising from unreliable labels, which poses a significant challenge in ensuring fairness. Existing fairness techniques that address label bias…

Machine Learning · Computer Science 2024-12-17 Yixuan Zhang , Zhidong Li , Yang Wang , Fang Chen , Xuhui Fan , Feng Zhou

There has been concern within the artificial intelligence (AI) community and the broader society regarding the potential lack of fairness of AI-based decision-making systems. Surprisingly, there is little work quantifying and guaranteeing…

Machine Learning · Computer Science 2023-01-31 Wenbin Zhang , Jeremy C. Weiss

The biases and discrimination of machine learning algorithms have attracted significant attention, leading to the development of various algorithms tailored to specific contexts. However, these solutions often fall short of addressing…

Machine Learning · Computer Science 2025-08-05 Yinghui Huang , Zihao Tang , Xiangyu Chang

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

Machine Learning · Computer Science 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang