English
Related papers

Related papers: Multi-Differential Fairness Auditor for Black Box …

200 papers

Recent work has shown that deep-learning algorithms for malware detection are also susceptible to adversarial examples, i.e., carefully-crafted perturbations to input malware that enable misleading classification. Although this has…

Cryptography and Security · Computer Science 2019-01-25 Luca Demetrio , Battista Biggio , Giovanni Lagorio , Fabio Roli , Alessandro Armando

Algorithms learned from data are increasingly used for deciding many aspects in our life: from movies we see, to prices we pay, or medicine we get. Yet there is growing evidence that decision making by inappropriately trained algorithms may…

Artificial Intelligence · Computer Science 2017-08-03 Indre Zliobaite

To ensure unbiased and ethical automated predictions, fairness must be a core principle in machine learning applications. Fairness in machine learning aims to mitigate biases present in the training data and model imperfections that could…

Machine Learning · Computer Science 2024-12-03 Jan Pablo Burgard , João Vitor Pamplona

Motivated by settings in which predictive models may be required to be non-discriminatory with respect to certain attributes (such as race), but even collecting the sensitive attribute may be forbidden or restricted, we initiate the study…

Machine Learning · Computer Science 2019-06-04 Matthew Jagielski , Michael Kearns , Jieming Mao , Alina Oprea , Aaron Roth , Saeed Sharifi-Malvajerdi , Jonathan Ullman

Ensuring fairness is critical when applying artificial intelligence to high-stakes domains such as healthcare, where predictive models trained on imbalanced and demographically skewed data risk exacerbating existing disparities. Federated…

Computers and Society · Computer Science 2025-05-15 Qiming Wu , Siqi Li , Doudou Zhou , Nan Liu

Fairness-aware machine learning has attracted a surge of attention in many domains, such as online advertising, personalized recommendation, and social media analysis in web applications. Fairness-aware machine learning aims to eliminate…

Machine Learning · Computer Science 2023-07-18 Jing Ma , Ruocheng Guo , Aidong Zhang , Jundong Li

Understanding and removing bias from the decisions made by machine learning models is essential to avoid discrimination against unprivileged groups. Despite recent progress in algorithmic fairness, there is still no clear answer as to which…

Decision-based evasion attacks repeatedly query a black-box classifier to generate adversarial examples. Prior work measures the cost of such attacks by the total number of queries made to the classifier. We argue this metric is flawed.…

Cryptography and Security · Computer Science 2024-02-15 Edoardo Debenedetti , Nicholas Carlini , Florian Tramèr

Recent attempts to achieve fairness in predictive models focus on the balance between fairness and accuracy. In sensitive applications such as healthcare or criminal justice, this trade-off is often undesirable as any increase in prediction…

Machine Learning · Statistics 2018-12-12 Irene Chen , Fredrik D. Johansson , David Sontag

We study fairness in supervised few-shot meta-learning models that are sensitive to discrimination (or bias) in historical data. A machine learning model trained based on biased data tends to make unfair predictions for users from minority…

Machine Learning · Computer Science 2020-09-25 Chen Zhao , Feng Chen

The wide adoption of AI decision-making systems in critical domains such as criminal justice, loan approval, and hiring processes has heightened concerns about algorithmic fairness. As we often only have access to the output of algorithms…

Machine Learning · Computer Science 2025-10-02 Saeyoung Rho , Junzhe Zhang , Elias Bareinboim

Black box systems for automated decision making, often based on machine learning over (big) data, map a user's features into a class or a score without exposing the reasons why. This is problematic not only for lack of transparency, but…

Artificial Intelligence · Computer Science 2018-06-27 Dino Pedreschi , Fosca Giannotti , Riccardo Guidotti , Anna Monreale , Luca Pappalardo , Salvatore Ruggieri , Franco Turini

Given the computational cost and technical expertise required to train machine learning models, users may delegate the task of learning to a service provider. We show how a malicious learner can plant an undetectable backdoor into a…

Machine Learning · Computer Science 2024-11-12 Shafi Goldwasser , Michael P. Kim , Vinod Vaikuntanathan , Or Zamir

Making predictions that are fair with regard to protected group membership (race, gender, age, etc.) has become an important requirement for classification algorithms. Existing techniques derive a fair model from sampled labeled data…

Machine Learning · Computer Science 2021-02-09 Ashkan Rezaei , Anqi Liu , Omid Memarrast , Brian Ziebart

Automated gender classification has important applications in many domains, such as demographic research, law enforcement, online advertising, as well as human-computer interaction. Recent research has questioned the fairness of this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Anoop Krishnan , Ali Almadan , Ajita Rattani

Algorithmic fairness is often studied in static or single-agent settings, yet many real-world decision-making systems involve multiple interacting entities whose multi-stage actions jointly influence long-term outcomes. Existing fairness…

In recent years, a growing body of work has emerged on how to learn machine learning models under fairness constraints, often expressed with respect to some sensitive attributes. In this work, we consider the setting in which an adversary…

Machine Learning · Computer Science 2022-09-07 Julien Ferry , Ulrich Aïvodji , Sébastien Gambs , Marie-José Huguet , Mohamed Siala

Cluster-weighted factor analyzers (CWFA) are a versatile class of mixture models designed to estimate the joint distribution of a random vector that includes a response variable along with a set of explanatory variables. They are…

Methodology · Statistics 2024-11-07 Xiaoke Qin , Francesca Martella , Sanjeena Subedi

In this paper, we study the problem of how to defend classifiers against adversarial attacks that fool the classifiers using subtly modified input data. In contrast to previous works, here we focus on the white-box adversarial defense where…

Machine Learning · Computer Science 2019-09-16 Zudi Lin , Hanspeter Pfister , Ziming Zhang

Fairness in Multi-Agent Systems (MAS) has been extensively studied, particularly in reward distribution among agents in scenarios such as goods allocation, resource division, lotteries, and bargaining systems. Fairness in MAS depends on…

Multiagent Systems · Computer Science 2024-10-18 Gabriele La Malfa , Jie M. Zhang , Michael Luck , Elizabeth Black