English
Related papers

Related papers: Fairness Increases Adversarial Vulnerability

200 papers

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

Machine Learning · Statistics 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

It has been suggested that adversarial examples cause deep learning models to make incorrect predictions with high confidence. In this work, we take the opposite stance: an overly confident model is more likely to be vulnerable to…

Machine Learning · Computer Science 2018-02-14 Angus Galloway , Graham W. Taylor , Medhat Moussa

Recent research studies revealed that neural networks are vulnerable to adversarial attacks. State-of-the-art defensive techniques add various adversarial examples in training to improve models' adversarial robustness. However, these…

Machine Learning · Computer Science 2019-09-13 Chang Song , Zuoguan Wang , Hai Li

Adversarial training (i.e., training on adversarially perturbed input data) is a well-studied method for making neural networks robust to potential adversarial attacks during inference. However, the improved robustness does not come for…

Robotics · Computer Science 2023-01-27 Mathias Lechner , Alexander Amini , Daniela Rus , Thomas A. Henzinger

Fairness is a widely discussed topic in recommender systems, but its practical implementation faces challenges in defining sensitive features while maintaining recommendation accuracy. We propose feature fairness as the foundation to…

Information Retrieval · Computer Science 2023-09-28 Hengchang Hu , Yiming Cao , Zhankui He , Samson Tan , Min-Yen Kan

This work tackles an intriguing and fundamental open challenge in representation learning: Given a well-trained deep learning model, can it be reprogrammed to enhance its robustness against adversarial or noisy input perturbations without…

Machine Learning · Computer Science 2024-10-08 Zhichao Hou , MohamadAli Torkamani , Hamid Krim , Xiaorui Liu

Algorithmic fairness is frequently motivated in terms of a trade-off in which overall performance is decreased so as to improve performance on disadvantaged groups where the algorithm would otherwise be less accurate. Contrary to this, we…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Dominik Zietlow , Michael Lohaus , Guha Balakrishnan , Matthäus Kleindessner , Francesco Locatello , Bernhard Schölkopf , Chris Russell

Algorithmic decision making systems are ubiquitous across a wide variety of online as well as offline services. These systems rely on complex learning methods and vast amounts of data to optimize the service functionality, satisfaction of…

Machine Learning · Statistics 2017-03-27 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

We initiate the study of fairness in reinforcement learning, where the actions of a learning algorithm may affect its environment and future rewards. Our fairness constraint requires that an algorithm never prefers one action over another…

Machine Learning · Computer Science 2017-08-08 Shahin Jabbari , Matthew Joseph , Michael Kearns , Jamie Morgenstern , Aaron Roth

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

Machine Learning · Computer Science 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

The prediction accuracy has been the long-lasting and sole standard for comparing the performance of different image classification models, including the ImageNet competition. However, recent studies have highlighted the lack of robustness…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Dong Su , Huan Zhang , Hongge Chen , Jinfeng Yi , Pin-Yu Chen , Yupeng Gao

Ensuring that a predictor is not biased against a sensible feature is the key of Fairness learning. Conversely, Global Sensitivity Analysis is used in numerous contexts to monitor the influence of any feature on an output variable. We…

Statistics Theory · Mathematics 2021-09-21 Clément Bénesse , Fabrice Gamboa , Jean-Michel Loubes , Thibaut Boissin

Fairness in artificial intelligence and machine learning (AI/ML) models is becoming critically important, especially as decisions made by these systems impact diverse groups. In education, a vital sector for all countries, the widespread…

Machine Learning · Computer Science 2024-10-10 Nga Pham , Minh Kha Do , Tran Vu Dai , Pham Ngoc Hung , Anh Nguyen-Duc

Given the widespread use of deep learning models in safety-critical applications, ensuring that the decisions of such models are robust against adversarial exploitation is of fundamental importance. In this thesis, we discuss recent…

Machine Learning · Computer Science 2025-09-24 Alexander Robey

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

Machine Learning · Computer Science 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang

Machine learning has significantly enhanced the abilities of robots, enabling them to perform a wide range of tasks in human environments and adapt to our uncertain real world. Recent works in various machine learning domains have…

Existing bias mitigation methods to reduce disparities in model outcomes across cohorts have focused on data augmentation, debiasing model embeddings, or adding fairness-based optimization objectives during training. Separately, certified…

Computation and Language · Computer Science 2021-06-22 Yada Pruksachatkun , Satyapriya Krishna , Jwala Dhamala , Rahul Gupta , Kai-Wei Chang

Fairness researchers in machine learning (ML) have coalesced around several fairness criteria which provide formal definitions of what it means for an ML model to be fair. However, these criteria have some serious limitations. We identify…

Machine Learning · Computer Science 2022-07-14 Liam Peet-Pare , Nidhi Hegde , Alona Fyshe

To advance the understanding of robust deep learning, we delve into the effects of adversarial training on self-supervised and supervised contrastive learning alongside supervised learning. Our analysis uncovers significant disparities…

Machine Learning · Computer Science 2023-06-08 Fatemeh Ghofrani , Mehdi Yaghouti , Pooyan Jamshidi

The existence of adversarial examples has been a mystery for years and attracted much interest. A well-known theory by \citet{ilyas2019adversarial} explains adversarial vulnerability from a data perspective by showing that one can extract…

Machine Learning · Computer Science 2024-05-07 Ang Li , Yifei Wang , Yiwen Guo , Yisen Wang
‹ Prev 1 4 5 6 7 8 10 Next ›