English
Related papers

Related papers: Efficient Fair Principal Component Analysis

200 papers

Fair ranking problems arise in many decision-making processes that often necessitate a trade-off between accuracy and fairness. Many existing studies have proposed correction methods such as adding fairness constraints to a ranking model's…

Machine Learning · Computer Science 2022-04-26 Ryosuke Sonoda

This paper defines fair principal component analysis (PCA) as minimizing the maximum mean discrepancy (MMD) between dimensionality-reduced conditional distributions of different protected classes. The incorporation of MMD naturally leads to…

Machine Learning · Statistics 2022-01-26 Junghyun Lee , Gwangsu Kim , Matt Olfat , Mark Hasegawa-Johnson , Chang D. Yoo

Ensuring fairness in machine learning models is critical, especially when biases compound across intersecting protected attributes like race, gender, and age. While existing methods address fairness for single attributes, they fail to…

Machine Learning · Computer Science 2025-09-24 Priyobrata Mondal , Faizanuddin Ansari , Swagatam Das

In this work, we study the problem of finding Pareto optimal policies in multi-agent reinforcement learning problems with cooperative reward structures. We show that any algorithm where each agent only optimizes their reward is subject to…

Machine Learning · Computer Science 2024-10-28 Bang Giang Le , Viet Cuong Ta

Principal Component Analysis (PCA) is a powerful and popular dimensionality reduction technique. However, due to its linear nature, it often fails to capture the complex underlying structure of real-world data. While Kernel PCA (kPCA)…

Machine Learning · Computer Science 2026-02-05 Thomas Uriot , Elise Chung

In this paper, we tackle a significant challenge in PCA: heterogeneity. When data are collected from different sources with heterogeneous trends while still sharing some congruency, it is critical to extract shared knowledge while retaining…

Machine Learning · Computer Science 2025-08-25 Naichen Shi , Raed Al Kontar

Deep neural networks have achieved exceptional results across a range of applications. As the demand for efficient and sparse deep learning models escalates, the significance of model compression, particularly pruning, is increasingly…

Machine Learning · Computer Science 2025-04-01 Yucong Dai , Gen Li , Feng Luo , Xiaolong Ma , Yongkai Wu

Principal component analysis (PCA) is possibly one of the most widely used statistical tools to recover a low-rank structure of the data. In the high-dimensional settings, the leading eigenvector of the sample covariance can be nearly…

Statistics Theory · Mathematics 2015-04-06 Chao Gao , Harrison H. Zhou

In this paper, we deal with bias mitigation techniques that remove specific data points from the training set to aim for a fair representation of the population in that set. Machine learning models are trained on these pre-processed…

Machine Learning · Computer Science 2024-09-24 Manh Khoi Duong , Stefan Conrad

Many machine learning systems are vulnerable to small perturbations made to inputs either at test time or at training time. This has received much recent interest on the empirical front due to applications where reliability and security are…

Data Structures and Algorithms · Computer Science 2021-08-16 Pranjal Awasthi , Vaggos Chatziafratis , Xue Chen , Aravindan Vijayaraghavan

Machine learning is used to make decisions for individuals in various fields, which require us to achieve good prediction accuracy while ensuring fairness with respect to sensitive features (e.g., race and gender). This problem, however,…

Machine Learning · Computer Science 2021-03-01 Yoichi Chikahara , Shinsaku Sakaue , Akinori Fujino , Hisashi Kashima

The study of online algorithms with machine-learned predictions has gained considerable prominence in recent years. One of the common objectives in the design and analysis of such algorithms is to attain (Pareto) optimal tradeoffs between…

Machine Learning · Computer Science 2024-08-09 Spyros Angelopoulos , Christoph Dürr , Alex Elenter , Yanni Lefki

We study the problem of post-processing a supervised machine-learned regressor to maximize fair binary classification at all decision thresholds. By decreasing the statistical distance between each group's score distributions, we show that…

Machine Learning · Computer Science 2023-12-12 Kweku Kwegyir-Aggrey , A. Feder Cooper , Jessica Dai , John Dickerson , Keegan Hines , Suresh Venkatasubramanian

Machine learning improves predictive accuracy in insurance pricing but exacerbates trade-offs between competing fairness criteria across different discrimination measures, challenging regulators and insurers to reconcile profitability with…

Risk Management · Quantitative Finance 2026-01-01 Tim J. Boonen , Xinyue Fan , Zixiao Quan

Pre-trained foundation models can be adapted for specific tasks using Low-Rank Adaptation (LoRA). However, the fairness properties of these adapted classifiers remain underexplored. Existing fairness-aware fine-tuning methods rely on direct…

Machine Learning · Computer Science 2025-03-10 Parameswaran Kamalaruban , Mark Anderson , Stuart Burrell , Maeve Madigan , Piotr Skalski , David Sutton

We present a novel approach for adaptive, differentiable parameterization of large-scale random fields. If the approach is coupled with any gradient-based optimization algorithm, it can be applied to a variety of optimization problems,…

Machine Learning · Computer Science 2020-06-09 Maksim Elizarev , Andrei Mukhin , Aleksey Khlyupin

Principal component analysis is a simple yet useful dimensionality reduction technique in modern machine learning pipelines. In consequential domains such as college admission, healthcare and credit approval, it is imperative to take into…

Machine Learning · Computer Science 2022-02-08 Hieu Vu , Toan Tran , Man-Chung Yue , Viet Anh Nguyen

Discrimination-aware classification aims to make accurate predictions while satisfying fairness constraints. Traditional decision tree learners typically optimize for information gain in the target attribute alone, which can result in…

Machine Learning · Computer Science 2025-04-18 Kewen Peng , Hao Zhuo , Yicheng Yang , Tim Menzies

Optimizing NLP models for fairness poses many challenges. Lack of differentiable fairness measures prevents gradient-based loss training or requires surrogate losses that diverge from the true metric of interest. In addition, competing…

Computation and Language · Computer Science 2025-06-19 Soumyajit Gupta , Venelin Kovatchev , Anubrata Das , Maria De-Arteaga , Matthew Lease

Real-world applications of machine learning tools in high-stakes domains are often regulated to be fair, in the sense that the predicted target should satisfy some quantitative notion of parity with respect to a protected attribute.…

Machine Learning · Computer Science 2021-10-06 Han Zhao