English
Related papers

Related papers: Fairness and Accuracy under Domain Generalization

200 papers

Our goal is to improve reliability of Machine Learning (ML) systems deployed in the wild. ML models perform exceedingly well when test examples are similar to train examples. However, real-world applications are required to perform on any…

Machine Learning · Computer Science 2023-03-07 Vihari Piratla

In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to…

Machine Learning · Computer Science 2022-07-14 José Pombal , André F. Cruz , João Bravo , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

Across machine learning (ML) sub-disciplines, researchers make explicit mathematical assumptions in order to facilitate proof-writing. We note that, specifically in the area of fairness-accuracy trade-off optimization scholarship, similar…

Computers and Society · Computer Science 2021-09-09 A. Feder Cooper , Ellen Abrams

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

Domain generalization is the problem of machine learning when the training data and the test data come from different data domains. We present a simple theoretical model of learning to generalize across domains in which there is a…

Machine Learning · Computer Science 2020-02-14 Vikas K. Garg , Adam Kalai , Katrina Ligett , Zhiwei Steven Wu

Machine learning methods often assume that the test data have the same distribution as the training data. However, this assumption may not hold due to multiple levels of heterogeneity in applications, raising issues in algorithmic fairness…

Machine Learning · Statistics 2024-04-03 Sai Li , Linjun Zhang

Machine learning typically relies on the assumption that training and testing distributions are identical and that data is centrally stored for training and testing. However, in real-world scenarios, distributions may differ significantly…

Machine Learning · Computer Science 2025-08-22 Ying Li , Xingwei Wang , Rongfei Zeng , Praveen Kumar Donta , Ilir Murturi , Min Huang , Schahram Dustdar

Existing algorithms for ensuring fairness in AI use a single-shot training strategy, where an AI model is trained on an annotated training dataset with sensitive attributes and then fielded for utilization. This training strategy is…

Machine Learning · Computer Science 2023-01-31 Serban Stan , Mohammad Rostami

Fairness in machine learning (ML) has become a rapidly growing area of research. But why, in the first place, is unfairness in ML wrong? And why should we care about improving fairness? Most fair-ML research implicitly appeals to…

Machine Learning · Computer Science 2026-02-27 Youjin Kong

Fairness in both Machine Learning (ML) predictions and human decision-making is essential, yet both are susceptible to different forms of bias, such as algorithmic and data-driven in ML, and cognitive or subjective in humans. In this study,…

Computation and Language · Computer Science 2025-08-28 Junhua Liu , Roy Ka-Wei Lee , Kwan Hui Lim

Educational technologies nowadays increasingly use data and Machine Learning (ML) models. This gives the students, instructors, and administrators support and insights for the optimum policy. However, it is well acknowledged that ML models…

Machine Learning · Computer Science 2022-08-02 Modar Sulaiman , Kallol Roy

Achieving the generalization of an invariant classifier from training domains to shifted test domains while simultaneously considering model fairness is a substantial and complex challenge in machine learning. Existing methods address the…

Machine Learning · Computer Science 2024-08-20 Dong Li , Chen Zhao , Minglai Shao , Wenjun Wang

The digitization of healthcare data coupled with advances in computational capabilities has propelled the adoption of machine learning (ML) in healthcare. However, these methods can perpetuate or even exacerbate existing disparities,…

Machine Learning · Computer Science 2024-02-02 Qizhang Feng , Mengnan Du , Na Zou , Xia Hu

Machine learning (ML) robustness and domain generalization are fundamentally correlated: they essentially concern data distribution shifts under adversarial and natural settings, respectively. On one hand, recent studies show that more…

Machine Learning · Computer Science 2022-06-27 Xiaojun Xu , Jacky Yibo Zhang , Evelyn Ma , Danny Son , Oluwasanmi Koyejo , Bo Li

Many machine learning and data mining algorithms rely on the assumption that the training and testing data share the same feature space and distribution. However, this assumption may not always hold. For instance, there are situations where…

Cryptography and Security · Computer Science 2024-03-05 Adrian Shuai Li , Arun Iyengar , Ashish Kundu , Elisa Bertino

With the growing adoption of machine learning (ML) systems in areas like law enforcement, criminal justice, finance, hiring, and admissions, it is increasingly critical to guarantee the fairness of decisions assisted by ML. In this paper,…

Machine Learning · Computer Science 2024-05-17 Meiyu Zhong , Ravi Tandon

Extensive efforts have been made to understand and improve the fairness of machine learning models based on observational metrics, especially in high-stakes domains such as medical insurance, education, and hiring decisions. However, there…

Machine Learning · Computer Science 2022-11-22 Mintong Kang , Linyi Li , Maurice Weber , Yang Liu , Ce Zhang , Bo Li

Model fairness is an essential element for Trustworthy AI. While many techniques for model fairness have been proposed, most of them assume that the training and deployment data distributions are identical, which is often not true in…

Machine Learning · Computer Science 2023-02-07 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

Ensuring that machine learning (ML) models are safe, effective, and equitable across all patients is critical for clinical decision-making and for preventing the amplification of existing health disparities. In this work, we examine how…

Machine Learning · Computer Science 2025-05-28 Jianhui Gao , Benson Chou , Zachary R. McCaw , Hilary Thurston , Paul Varghese , Chuan Hong , Jessica Gronsbell

In recent years fairness in machine learning (ML) has emerged as a highly active area of research and development. Most define fairness in simple terms, where fairness means reducing gaps in performance or outcomes between demographic…

Artificial Intelligence · Computer Science 2023-03-14 Brent Mittelstadt , Sandra Wachter , Chris Russell