中文
相关论文

相关论文: Towards Poisoning Fair Representations

200 篇论文

Machine Learning systems are increasingly prevalent across healthcare, law enforcement, and finance but often operate on historical data, which may carry biases against certain demographic groups. Causal and counterfactual fairness provides…

机器学习 · 计算机科学 2024-07-09 Jake Robertson , Noah Hollmann , Noor Awad , Frank Hutter

Machine Learning (ML) algorithms shape our lives. Banks use them to determine if we are good borrowers; IT companies delegate them recruitment decisions; police apply ML for crime-prediction, and judges base their verdicts on ML. However,…

计算机科学与博弈论 · 计算机科学 2021-01-05 Omer Ben-Porat , Fedor Sandomirskiy , Moshe Tennenholtz

Modern machine learning pipelines leverage large amounts of public data, making it infeasible to guarantee data quality and leaving models open to poisoning and backdoor attacks. Provably bounding model behavior under such attacks remains…

机器学习 · 计算机科学 2024-10-31 Philip Sosnin , Mark N. Müller , Maximilian Baader , Calvin Tsay , Matthew Wicker

Federated learning (FL) is vulnerable to data poisoning attacks due to its distributed nature. Although recent GAN-based data poisoning methods have indicated the potential of using generative AI to generate seemingly legitimate poisoned…

密码学与安全 · 计算机科学 2026-05-18 Wei Sun , Yijun Chen , Bo Gao , Ke Xiong , Yuwei Wang , Pingyi Fan , Khaled Ben Letaief

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

机器学习 · 统计学 2026-04-21 Yixiao Lin , James Booth

Deep image classification models trained on vast amounts of web-scraped data are susceptible to data poisoning - a mechanism for backdooring models. A small number of poisoned samples seen during training can severely undermine a model's…

密码学与安全 · 计算机科学 2023-06-30 Nils Lukas , Florian Kerschbaum

Similar to other machine learning frameworks, Offline Reinforcement Learning (RL) is shown to be vulnerable to poisoning attacks, due to its reliance on externally sourced datasets, a vulnerability that is exacerbated by its sequential…

机器学习 · 计算机科学 2025-05-28 Shijie Liu , Andrew C. Cullen , Paul Montague , Sarah Erfani , Benjamin I. P. Rubinstein

Federated learning (FL) is a distributed machine learning paradigm that enables training models on decentralized data. The field of FL security against poisoning attacks is plagued with confusion due to the proliferation of research that…

机器学习 · 计算机科学 2024-03-12 Hamid Mozaffari , Sunav Choudhary , Amir Houmansadr

Training ML models which are fair across different demographic groups is of critical importance due to the increased integration of ML in crucial decision-making scenarios such as healthcare and recruitment. Federated learning has been…

机器学习 · 计算机科学 2022-11-28 Yahya H. Ezzeldin , Shen Yan , Chaoyang He , Emilio Ferrara , Salman Avestimehr

Fair representation learning (FRL) is a popular class of methods aiming to produce fair classifiers via data preprocessing. Recent regulatory directives stress the need for FRL methods that provide practical certificates, i.e., provable…

机器学习 · 计算机科学 2023-06-09 Nikola Jovanović , Mislav Balunović , Dimitar I. Dimitrov , Martin Vechev

As machine learning has been deployed ubiquitously across applications in modern data science, algorithmic fairness has become a great concern. Among them, imposing fairness constraints during learning, i.e. in-processing fair training, has…

机器学习 · 计算机科学 2023-07-18 Yuzhen Mao , Zhun Deng , Huaxiu Yao , Ting Ye , Kenji Kawaguchi , James Zou

Recently, much attention has been paid to the societal impact of AI, especially concerns regarding its fairness. A growing body of research has identified unfair AI systems and proposed methods to debias them, yet many challenges remain.…

人工智能 · 计算机科学 2021-04-20 Ziqian Zeng , Rashidul Islam , Kamrun Naher Keya , James Foulds , Yangqiu Song , Shimei Pan

Deep learning has become a cornerstone of modern artificial intelligence, enabling transformative applications across a wide range of domains. As the core element of deep learning, the quality and security of training data critically…

密码学与安全 · 计算机科学 2025-04-01 Pinlong Zhao , Weiyao Zhu , Pengfei Jiao , Di Gao , Ou Wu

Manipulation of local training data and local updates, i.e., the poisoning attack, is the main threat arising from the collaborative nature of the federated learning (FL) paradigm. Most existing poisoning attacks aim to manipulate local…

机器学习 · 计算机科学 2025-05-30 Huazi Pan , Yanjun Zhang , Leo Yu Zhang , Scott Adams , Abbas Kouzani , Suiyang Khoo

Deep neural networks (DNNs) are increasingly used in real-world applications (e.g. facial recognition). This has resulted in concerns about the fairness of decisions made by these models. Various notions and measures of fairness have been…

机器学习 · 计算机科学 2021-01-22 Vedant Nanda , Samuel Dooley , Sahil Singla , Soheil Feizi , John P. Dickerson

Backdoor data poisoning attacks have recently been demonstrated in computer vision research as a potential safety risk for machine learning (ML) systems. Traditional data poisoning attacks manipulate training data to induce unreliability of…

计算机视觉与模式识别 · 计算机科学 2020-04-27 Loc Truong , Chace Jones , Brian Hutchinson , Andrew August , Brenda Praggastis , Robert Jasper , Nicole Nichols , Aaron Tuor

As machine learning systems become increasingly integrated into human-centered domains such as healthcare, ensuring fairness while maintaining high predictive performance is critical. Existing bias mitigation techniques often impose a…

机器学习 · 计算机科学 2025-11-11 Xuwei Tan , Yuanlong Wang , Thai-Hoang Pham , Ping Zhang , Xueru Zhang

Modern machine learning (ML) ecosystems offer a surging number of ML frameworks and code repositories that can greatly facilitate the development of ML models. Today, even ordinary data holders who are not ML experts can apply off-the-shelf…

密码学与安全 · 计算机科学 2024-07-03 Zitao Chen , Karthik Pattabiraman

Graph neural networks (GNNs) have shown great power in modeling graph structured data. However, similar to other machine learning models, GNNs may make predictions biased on protected sensitive attributes, e.g., skin color and gender.…

机器学习 · 计算机科学 2021-10-18 Enyan Dai , Suhang Wang

Semi-supervised Federated Learning (SSFL) has recently drawn much attention due to its practical consideration, i.e., the clients may only have unlabeled data. In practice, these SSFL systems implement semi-supervised training by assigning…

机器学习 · 计算机科学 2022-05-10 Yi Liu , Xingliang Yuan , Ruihui Zhao , Cong Wang , Dusit Niyato , Yefeng Zheng