中文
相关论文

相关论文: Adversarial Bias: Data Poisoning Attacks on Fairne…

200 篇论文

In this paper, we advocate for representation learning as the key to mitigating unfair prediction outcomes downstream. Motivated by a scenario where learned representations are used by third parties with unknown objectives, we propose and…

机器学习 · 计算机科学 2018-10-23 David Madras , Elliot Creager , Toniann Pitassi , Richard Zemel

Clustering algorithms are widely utilized for many modern data science applications. This motivates the need to make outputs of clustering algorithms fair. Traditionally, new fair algorithmic variants to clustering algorithms are developed…

机器学习 · 计算机科学 2021-10-26 Anshuman Chhabra , Adish Singla , Prasant Mohapatra

In distributed multiple-input multiple-output (D-MIMO) networks, power control is crucial to optimize the spectral efficiencies of users and max-min fairness (MMF) power control is a commonly used strategy as it satisfies uniform…

信号处理 · 电气工程与系统科学 2023-01-24 Ömer Faruk Tuna , Fehmi Emre Kadan , Leyli Karaçay

The economics of smaller budgets and larger case numbers necessitates the use of AI in legal proceedings. We examine the concept of disparate impact and how biases in the training data lead to the search for fairer AI. This paper seeks to…

计算机与社会 · 计算机科学 2020-09-14 Lauren Boswell , Arjun Prakash

In a poisoning attack, an adversary with control over a small fraction of the training data attempts to select that data in a way that induces a corrupted model that misbehaves in favor of the adversary. We consider poisoning attacks…

机器学习 · 计算机科学 2021-04-22 Fnu Suya , Saeed Mahloujifar , Anshuman Suri , David Evans , Yuan Tian

Classification, a heavily-studied data-driven machine learning task, drives an increasing number of prediction systems involving critical human decisions such as loan approval and criminal risk assessment. However, classifiers often…

机器学习 · 计算机科学 2022-04-12 Maliha Tashfia Islam , Anna Fariha , Alexandra Meliou , Babak Salimi

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

机器学习 · 统计学 2026-04-21 Yixiao Lin , James Booth

As machine learning models are increasingly used in educational settings, from detecting at-risk students to predicting student performance, algorithmic bias and its potential impacts on students raise critical concerns about algorithmic…

计算机与社会 · 计算机科学 2025-04-22 Woojin Kim , Hyeoncheol Kim

Data poisoning and backdoor attacks manipulate training data in order to cause models to fail during inference. A recent survey of industry practitioners found that data poisoning is the number one concern among threats ranging from model…

机器学习 · 计算机科学 2021-06-18 Avi Schwarzschild , Micah Goldblum , Arjun Gupta , John P Dickerson , Tom Goldstein

Model fairness is an essential element for Trustworthy AI. While many techniques for model fairness have been proposed, most of them assume that the training and deployment data distributions are identical, which is often not true in…

机器学习 · 计算机科学 2023-02-07 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

Datasets often contain biases which unfairly disadvantage certain groups, and classifiers trained on such datasets can inherit these biases. In this paper, we provide a mathematical formulation of how this bias can arise. We do so by…

机器学习 · 计算机科学 2019-01-16 Heinrich Jiang , Ofir Nachum

Data poisoning attacks, in which an adversary corrupts a training set with the goal of inducing specific desired mistakes, have raised substantial concern: even just the possibility of such an attack can make a user no longer trust the…

机器学习 · 计算机科学 2022-03-09 Maria-Florina Balcan , Avrim Blum , Steve Hanneke , Dravyansh Sharma

This paper summarizes and evaluates various approaches, methods, and techniques for pursuing fairness in artificial intelligence (AI) systems. It examines the merits and shortcomings of these measures and proposes practical guidelines for…

计算机与社会 · 计算机科学 2022-07-21 Arash Bateni , Matthew C. Chan , Ray Eitel-Porter

Fairness-aware graph neural networks (GNNs) have gained a surge of attention as they can reduce the bias of predictions on any demographic group (e.g., female) in graph-based applications. Although these methods greatly improve the…

机器学习 · 计算机科学 2024-03-05 Binchi Zhang , Yushun Dong , Chen Chen , Yada Zhu , Minnan Luo , Jundong Li

Applications based on Machine Learning models have now become an indispensable part of the everyday life and the professional world. A critical question then recently arised among the population: Do algorithmic decisions convey any type of…

Adversarial training (AT) is widely considered the state-of-the-art technique for improving the robustness of deep neural networks (DNNs) against adversarial examples (AE). Nevertheless, recent studies have revealed that adversarially…

机器学习 · 计算机科学 2023-08-04 Chenhao Lin , Xiang Ji , Yulong Yang , Qian Li , Chao Shen , Run Wang , Liming Fang

We consider the problem of prediction by a machine learning algorithm, called learner, within an adversarial learning setting. The learner's task is to correctly predict the class of data passed to it as a query. However, along with queries…

机器学习 · 计算机科学 2020-02-11 Prithviraj Dasgupta , Joseph B. Collins , Michael McCarrick

Machine learning models built on datasets containing discriminative instances attributed to various underlying factors result in biased and unfair outcomes. It's a well founded and intuitive fact that existing bias mitigation strategies…

机器学习 · 计算机科学 2022-10-25 Bhushan Chaudhari , Akash Agarwal , Tanmoy Bhowmik

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

机器学习 · 计算机科学 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

Deep learning models are vulnerable to various adversarial manipulations of their training data, parameters, and input sample. In particular, an adversary can modify the training data and model parameters to embed backdoors into the model,…

机器学习 · 计算机科学 2020-06-09 Te Juin Lester Tan , Reza Shokri