中文
相关论文

相关论文: Fairness Increases Adversarial Vulnerability

200 篇论文

Adversarial robustness refers to a model's ability to resist perturbation of inputs, while distribution robustness evaluates the performance of the model under data shifts. Although both aim to ensure reliable performance, prior work has…

机器学习 · 计算机科学 2026-01-26 Yipei Wang , Zhaoying Pan , Xiaoqian Wang

This thesis investigates three areas targeted at improving the reliability of machine learning; fairness in machine learning, strategic classification, and algorithmic robustness. Each of these domains has special properties or structure…

机器学习 · 计算机科学 2024-08-30 Kevin Stangl

As the use of deep learning in high impact domains becomes ubiquitous, it is increasingly important to assess the resilience of models. One such high impact domain is that of face recognition, with real world applications involving images…

计算机视觉与模式识别 · 计算机科学 2022-02-10 Aparna R. Joshi , Xavier Suau , Nivedha Sivakumar , Luca Zappella , Nicholas Apostoloff

In sequential decision-making problems involving sensitive attributes like race and gender, reinforcement learning (RL) agents must carefully consider long-term fairness while maximizing returns. Recent works have proposed many different…

机器学习 · 计算机科学 2024-04-30 Zhihong Deng , Jing Jiang , Guodong Long , Chengqi Zhang

Efforts in the recommendation community are shifting from the sole emphasis on utility to considering beyond-utility factors, such as fairness and robustness. Robustness of recommendation models is typically linked to their ability to…

信息检索 · 计算机科学 2024-01-29 Ludovico Boratto , Francesco Fabbri , Gianni Fenu , Mirko Marras , Giacomo Medda

Although adversarial training (AT) has proven effective in enhancing the model's robustness, the recently revealed issue of fairness in robustness has not been well addressed, i.e. the robust accuracy varies significantly among different…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Yanghao Zhang , Tianle Zhang , Ronghui Mu , Xiaowei Huang , Wenjie Ruan

We initiate the study of fair classifiers that are robust to perturbations in the training distribution. Despite recent progress, the literature on fairness has largely ignored the design of fair and robust classifiers. In this work, we…

机器学习 · 计算机科学 2020-11-05 Debmalya Mandal , Samuel Deng , Suman Jana , Jeannette M. Wing , Daniel Hsu

Fairness and accountability are two essential pillars for trustworthy Artificial Intelligence (AI) in healthcare. However, the existing AI model may be biased in its decision marking. To tackle this issue, we propose an adversarial…

计算机视觉与模式识别 · 计算机科学 2021-05-12 Xiaoxiao Li , Ziteng Cui , Yifan Wu , Lin Gu , Tatsuya Harada

The field of fair machine learning aims to ensure that decisions guided by algorithms are equitable. Over the last decade, several formal, mathematical definitions of fairness have gained prominence. Here we first assemble and categorize…

计算机与社会 · 计算机科学 2023-08-31 Sam Corbett-Davies , Johann D. Gaebler , Hamed Nilforoshan , Ravi Shroff , Sharad Goel

Despite the essential need for comprehensive considerations in responsible AI, factors like robustness, fairness, and causality are often studied in isolation. Adversarial perturbation, used to identify vulnerabilities in models, and…

机器学习 · 计算机科学 2024-02-07 Ahmad-Reza Ehyaei , Golnoosh Farnadi , Samira Samadi

Non-adversarial robustness, also known as natural robustness, is a property of deep learning models that enables them to maintain performance even when faced with distribution shifts caused by natural variations in data. However, achieving…

机器学习 · 计算机科学 2023-05-25 Gorana Gojić , Vladimir Vincan , Ognjen Kundačina , Dragiša Mišković , Dinu Dragan

Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially…

机器学习 · 计算机科学 2020-03-20 Mengnan Du , Fan Yang , Na Zou , Xia Hu

Motivated by the need for fair algorithmic decision making in the age of automation and artificially-intelligent technology, this technical report provides a theoretical insight into adversarial training for fairness in deep learning. We…

机器学习 · 计算机科学 2021-01-11 Becky Mashaido , Winston Moh Tangongho

Vulnerability to adversarial attacks is a well-known weakness of Deep Neural networks. While most of the studies focus on single-task neural networks with computer vision datasets, very little research has considered complex multi-task…

机器学习 · 计算机科学 2021-10-29 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

We investigate individual fairness in generative probabilistic classifiers by analysing the robustness of posterior inferences to perturbations in private features. Building on established results in robustness analysis, we hypothesise a…

机器学习 · 计算机科学 2025-09-17 Alessandro Antonucci , Eric Rossetto , Ivan Duvnjak

Convolutional neural networks (CNNs) have made significant advancement, however, they are widely known to be vulnerable to adversarial attacks. Adversarial training is the most widely used technique for improving adversarial robustness to…

机器学习 · 计算机科学 2021-10-12 Philipp Benz , Chaoning Zhang , Adil Karjauv , In So Kweon

A small but growing body of work has shown that machine learning models which better align with human vision have also exhibited higher robustness to adversarial examples, raising the question: can human-like perception make models more…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Blaine Hoak , Kunyang Li , Patrick McDaniel

Deep neural networks are vulnerable to adversarial examples, which becomes one of the most important research problems in the development of deep learning. While a lot of efforts have been made in recent years, it is of great significance…

计算机视觉与模式识别 · 计算机科学 2019-12-30 Yinpeng Dong , Qi-An Fu , Xiao Yang , Tianyu Pang , Hang Su , Zihao Xiao , Jun Zhu

Fairness is becoming a rising concern w.r.t. machine learning model performance. Especially for sensitive fields such as criminal justice and loan decision, eliminating the prediction discrimination towards a certain group of population…

机器学习 · 计算机科学 2019-09-09 Xiaoqian Wang , Heng Huang

Facial analysis systems have been deployed by large companies and critiqued by scholars and activists for the past decade. Many existing algorithmic audits examine the performance of these systems on later stage elements of facial analysis…

计算机与社会 · 计算机科学 2022-11-30 Samuel Dooley , George Z. Wei , Tom Goldstein , John P. Dickerson