English
Related papers

Related papers: Fairness in the Eyes of the Data: Certifying Machi…

200 papers

Machine Learning models have been deployed across many different aspects of society, often in situations that affect social welfare. Although these models offer streamlined solutions to large problems, they may contain biases and treat…

Machine Learning · Computer Science 2021-06-22 Tal Feldman , Ashley Peake

Trustworthy machine learning is of primary importance to the practical deployment of deep learning models. While state-of-the-art models achieve astonishingly good performance in terms of accuracy, recent literature reveals that their…

Machine Learning · Computer Science 2023-02-07 Ailin Deng , Shen Li , Miao Xiong , Zhirui Chen , Bryan Hooi

We study the problem of formally verifying individual fairness of decision tree ensembles, as well as training tree models which maximize both accuracy and individual fairness. In our approach, fairness verification and fairness-aware…

Machine Learning · Computer Science 2021-01-05 Francesco Ranzato , Caterina Urban , Marco Zanella

Machine learning models in safety-critical settings like healthcare are often blackboxes: they contain a large number of parameters which are not transparent to users. Post-hoc explainability methods where a simple, human-interpretable…

Machine Learning · Computer Science 2022-06-03 Aparna Balagopalan , Haoran Zhang , Kimia Hamidieh , Thomas Hartvigsen , Frank Rudzicz , Marzyeh Ghassemi

Machine learning is increasingly becoming a powerful tool to make decisions in a wide variety of applications, such as medical diagnosis and autonomous driving. Privacy concerns related to the training data and unfair behaviors of some…

Cryptography and Security · Computer Science 2020-03-16 Jiahao Ding , Xinyue Zhang , Xiaohuan Li , Junyi Wang , Rong Yu , Miao Pan

Privacy and fairness are two crucial pillars of responsible Artificial Intelligence (AI) and trustworthy Machine Learning (ML). Each objective has been independently studied in the literature with the aim of reducing utility loss in…

Deep learning's unprecedented success raises several ethical concerns ranging from biased predictions to data privacy. Researchers tackle these issues by introducing fairness metrics, or federated learning, or differential privacy. A first,…

Machine Learning · Computer Science 2021-08-24 Manisha Padala , Sankarshan Damle , Sujit Gujar

Training ML models which are fair across different demographic groups is of critical importance due to the increased integration of ML in crucial decision-making scenarios such as healthcare and recruitment. Federated learning has been…

Machine Learning · Computer Science 2022-11-28 Yahya H. Ezzeldin , Shen Yan , Chaoyang He , Emilio Ferrara , Salman Avestimehr

Federated learning involves training statistical models over remote devices such as mobile phones while keeping data localized. Training in heterogeneous and potentially massive networks introduces opportunities for privacy-preserving data…

Machine Learning · Computer Science 2022-01-21 Afra Mashhadi , Alex Kyllo , Reza M. Parizi

With widespread adoption of AI models for important decision making, ensuring reliability of such models remains an important challenge. In this paper, we present an end-to-end generic framework for testing AI Models which performs…

Machine Learning · Computer Science 2021-02-12 Aniya Aggarwal , Samiulla Shaikh , Sandeep Hans , Swastik Haldar , Rema Ananthanarayanan , Diptikalyan Saha

The current standalone deep learning framework tends to result in overfitting and low utility. This problem can be addressed by either a centralized framework that deploys a central server to train a global model on the joint data from all…

Cryptography and Security · Computer Science 2020-05-20 Lingjuan Lyu , Jiangshan Yu , Karthik Nandakumar , Yitong Li , Xingjun Ma , Jiong Jin , Han Yu , Kee Siong Ng

Federated Learning has rapidly expanded from its original inception to now have a large body of research, several frameworks, and sold in a variety of commercial offerings. Thus, its security and robustness is of significant importance.…

Cryptography and Security · Computer Science 2025-10-02 Simone Bottoni , Giulio Zizzo , Stefano Braghin , Alberto Trombetta

Federated learning enables collaborative model training across distributed institutions without centralizing sensitive data; however, ensuring algorithmic fairness across heterogeneous data distributions while preserving privacy remains…

Cryptography and Security · Computer Science 2026-02-16 Mohammed Himayath Ali , Mohammed Aqib Abdullah , Syed Muneer Hussain , Mohammed Mudassir Uddin , Shahnawaz Alam

Federated Learning is a promising machine learning paradigm when multiple parties collaborate to build a high-quality machine learning model. Nonetheless, these parties are only willing to participate when given enough incentives, such as a…

Machine Learning · Computer Science 2021-06-10 Shuaicheng Ma , Yang Cao , Li Xiong

The notion that collaborative machine learning can ensure privacy by just withholding the raw data is widely acknowledged to be flawed. Over the past seven years, the literature has revealed several privacy attacks that enable adversaries…

Cryptography and Security · Computer Science 2024-09-27 Federico Mazzone , Ahmad Al Badawi , Yuriy Polyakov , Maarten Everts , Florian Hahn , Andreas Peter

This paper firstly considers the research problem of fairness in collaborative deep learning, while ensuring privacy. A novel reputation system is proposed through digital tokens and local credibility to ensure fairness, in combination with…

Cryptography and Security · Computer Science 2020-07-21 Lingjuan Lyu , Yitong Li , Karthik Nandakumar , Jiangshan Yu , Xingjun Ma

Machine learning decision systems are getting omnipresent in our lives. From dating apps to rating loan seekers, algorithms affect both our well-being and future. Typically, however, these systems are not infallible. Moreover, complex…

Machine Learning · Statistics 2022-02-15 Jakub Wiśniewski , Przemysław Biecek

The privacy risks of machine learning models is a major concern when training them on sensitive and personal data. We discuss the tradeoffs between data privacy and the remaining goals of trustworthy machine learning (notably, fairness,…

Machine Learning · Computer Science 2022-09-15 Martin Strobel , Reza Shokri

At the intersection of the cutting-edge technologies and privacy concerns, Federated Learning (FL) with its distributed architecture, stands at the forefront in a bid to facilitate collaborative model training across multiple clients while…

Machine Learning · Computer Science 2025-09-03 Noorain Mukhtiar , Adnan Mahmood , Quan Z. Sheng

As machine learning algorithms have been widely deployed across applications, many concerns have been raised over the fairness of their predictions, especially in high stakes settings (such as facial recognition and medical imaging). To…

Machine Learning · Computer Science 2021-02-16 Valeriia Cherepanova , Vedant Nanda , Micah Goldblum , John P. Dickerson , Tom Goldstein