English
Related papers

Related papers: Learning Fair Representations via Rate-Distortion …

200 papers

Numerous approaches have been recently proposed for learning fair representations that mitigate unfair outcomes in prediction tasks. A key motivation for these methods is that the representations can be used by third parties with unknown…

Machine Learning · Computer Science 2024-06-25 Tianhao Wang , Zana Buçinca , Zilin Ma

Recent work on reducing bias in NLP models usually focuses on protecting or isolating information related to a sensitive attribute (like gender or race). However, when sensitive information is semantically entangled with the task…

Computation and Language · Computer Science 2022-10-25 Zexue He , Yu Wang , Julian McAuley , Bodhisattwa Prasad Majumder

Machine learning models often make predictions based on biased features such as gender, race, and other social attributes, posing significant fairness risks, especially in societal applications, such as hiring, banking, and criminal…

Machine Learning · Computer Science 2024-08-28 Yi Zhang , Dongyuan Lu , Jitao Sang

With growing emphasis on privacy regulations, machine unlearning has become increasingly critical in real-world applications such as social networks and recommender systems, many of which are naturally represented as graphs. However,…

Machine Learning · Computer Science 2026-01-19 Ziheng Chen , Jiali Cheng , Hadi Amiri , Kaushiki Nag , Lu Lin , Sijia Liu , Xiangguo Sun , Gabriele Tolomei

While fairness-aware machine learning algorithms have been receiving increasing attention, the focus has been on centralized machine learning, leaving decentralized methods underexplored. Federated Learning is a decentralized form of…

Machine Learning · Computer Science 2023-07-04 Teresa Salazar , Miguel Fernandes , Helder Araujo , Pedro Henriques Abreu

Deep neural networks are susceptible to learn biased models with entangled feature representations, which may lead to subpar performances on various downstream tasks. This is particularly true for under-represented classes, where a lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Sanghyeok Chu , Dongwan Kim , Bohyung Han

Fair Representation Learning (FRL) is a broad set of techniques, mostly based on neural networks, that seeks to learn new representations of data in which sensitive or undesired information has been removed. Methodologically, FRL was…

Machine Learning · Computer Science 2024-07-08 Mattia Cerrato , Marius Köppel , Philipp Wolf , Stefan Kramer

Machine learning models (e.g., speech recognizers) are usually trained to minimize average loss, which results in representation disparity---minority groups (e.g., non-native speakers) contribute less to the training objective and thus tend…

Machine Learning · Statistics 2018-08-01 Tatsunori B. Hashimoto , Megha Srivastava , Hongseok Namkoong , Percy Liang

Data and algorithms have the potential to produce and perpetuate discrimination and disparate treatment. As such, significant effort has been invested in developing approaches to defining, detecting, and eliminating unfair outcomes in…

Machine Learning · Computer Science 2025-02-07 Alexander Asemota , Giles Hooker

Node representation learning has demonstrated its effectiveness for various applications on graphs. Particularly, recent developments in contrastive learning have led to promising results in unsupervised node representation learning for a…

Machine Learning · Computer Science 2021-06-11 Öykü Deniz Köse , Yanning Shen

Statistical algorithms are usually helping in making decisions in many aspects of our lives. But, how do we know if these algorithms are biased and commit unfair discrimination of a particular group of people, typically a minority?…

Statistics Theory · Mathematics 2018-07-19 Eustasio del Barrio , Fabrice Gamboa , Paula Gordaliza , Jean-Michel Loubes

Representation Learning in a heterogeneous space with mixed variables of numerical and categorical types has interesting challenges due to its complex feature manifold. Moreover, feature learning in an unsupervised setup, without class…

Machine Learning · Statistics 2020-10-15 Souradip Chakraborty , Ekansh Verma , Saswata Sahoo , Jyotishka Datta

Much of the previous machine learning (ML) fairness literature assumes that protected features such as race and sex are present in the dataset, and relies upon them to mitigate fairness concerns. However, in practice factors like privacy…

Machine Learning · Computer Science 2020-11-04 Preethi Lahoti , Alex Beutel , Jilin Chen , Kang Lee , Flavien Prost , Nithum Thain , Xuezhi Wang , Ed H. Chi

Recently there has been a significant interest in learning disentangled representations, as they promise increased interpretability, generalization to unseen scenarios and faster learning on downstream tasks. In this paper, we investigate…

Machine Learning · Computer Science 2019-10-30 Francesco Locatello , Gabriele Abbati , Tom Rainforth , Stefan Bauer , Bernhard Schölkopf , Olivier Bachem

Recent research has identified discriminatory behavior of automated prediction algorithms towards groups identified on specific protected attributes (e.g., gender, ethnicity, age group, etc.). When deployed in real-world scenarios, such…

Machine Learning · Computer Science 2023-12-20 Anubha Pandey , Aditi Rai , Maneet Singh , Deepak Bhatt , Tanmoy Bhowmik

Algorithms learn rules and associations based on the training data that they are exposed to. Yet, the very same data that teaches machines to understand and predict the world, contains societal and historic biases, resulting in biased…

Machine Learning · Computer Science 2021-04-08 Paul Tiwald , Alexandra Ebert , Daniel T. Soukup

Machine learning models are trained to minimize the mean loss for a single metric, and thus typically do not consider fairness and robustness. Neglecting such metrics in training can make these models prone to fairness violations when…

Machine Learning · Computer Science 2022-07-21 Bobby Yan , Skyler Seto , Nicholas Apostoloff

With the introduction of (large) language models, there has been significant concern about the unintended bias such models may inherit from their training data. A number of studies have shown that such models propagate gender stereotypes,…

Computation and Language · Computer Science 2024-08-20 Rameez Qureshi , Naïm Es-Sebbani , Luis Galárraga , Yvette Graham , Miguel Couceiro , Zied Bouraoui

Diffusion models have shown their effectiveness in generation tasks by well-approximating the underlying probability distribution. However, diffusion models are known to suffer from an amplified inherent bias from the training data in terms…

Machine Learning · Computer Science 2024-10-04 Yujin Choi , Jinseong Park , Hoki Kim , Jaewook Lee , Saerom Park

Debiasing methods in NLP models traditionally focus on isolating information related to a sensitive attribute (e.g., gender or race). We instead argue that a favorable debiasing method should use sensitive information 'fairly,' with…

Computation and Language · Computer Science 2023-10-24 Bodhisattwa Prasad Majumder , Zexue He , Julian McAuley