English
Related papers

Related papers: Data (in)equities in data science: Dissecting syst…

200 papers

We propose a new family of fairness definitions for classification problems that combine some of the best properties of both statistical and individual notions of fairness. We posit not only a distribution over individuals, but also a…

Machine Learning · Computer Science 2019-12-18 Michael Kearns , Aaron Roth , Saeed Sharifi-Malvajerdi

We consider the problem of purchasing data for machine learning or statistical estimation. The data analyst has a budget to purchase datasets from multiple data providers. She does not have any test data that can be used to evaluate the…

Computer Science and Game Theory · Computer Science 2020-10-30 Yiling Chen , Yiheng Shen , Shuran Zheng

When a model's performance differs across socially or culturally relevant groups--like race, gender, or the intersections of many such groups--it is often called "biased." While much of the work in algorithmic fairness over the last several…

Methodology · Statistics 2022-07-01 Kristian Lum , Yunfeng Zhang , Amanda Bower

We address the problem of fair classification in settings where data is scarce and unbalanced across demographic groups. Such low-data regimes are common in domains like medical imaging, where false negatives can have fatal consequences. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jonathan Rystrøm , Zihao Fu , Chris Russell

Data collected in the real world often encapsulates historical discrimination against disadvantaged groups and individuals. Existing fair machine learning (FairML) research has predominantly focused on mitigating discriminative bias in the…

Machine Learning · Computer Science 2024-06-19 Zhining Liu , Ruizhong Qiu , Zhichen Zeng , Yada Zhu , Hendrik Hamann , Hanghang Tong

Explicit and implicit bias clouds human judgement, leading to discriminatory treatment of minority groups. A fundamental goal of algorithmic fairness is to avoid the pitfalls in human judgement by learning policies that improve the overall…

Machine Learning · Computer Science 2020-11-02 Yuzi He , Keith Burghardt , Siyi Guo , Kristina Lerman

In this paper, we propose an innovative approach to thoroughly explore dataset features that introduce bias in downstream machine-learning tasks. Depending on the data format, we use different techniques to map instances into a similarity…

Machine Learning · Computer Science 2024-11-11 Samira Maghool , Paolo Ceravolo

The potential risk of AI systems unintentionally embedding and reproducing bias has attracted the attention of machine learning practitioners and society at large. As policy makers are willing to set the standards of algorithms and AI…

Artificial Intelligence · Computer Science 2020-03-17 Boris Ruf , Chaouki Boutharouite , Marcin Detyniecki

Despite the growing reliance on fairness benchmarks to evaluate language models, the datasets that underpin these benchmarks remain critically underexamined. This survey addresses that overlooked foundation by offering a comprehensive…

Computation and Language · Computer Science 2025-09-23 Jiale Zhang , Zichong Wang , Avash Palikhe , Zhipeng Yin , Wenbin Zhang

Fair machine learning is receiving an increasing attention in machine learning fields. Researchers in fair learning have developed correlation or association-based measures such as demographic disparity, mistreatment disparity, calibration,…

Computers and Society · Computer Science 2019-11-20 Wen Huang , Yongkai Wu , Lu Zhang , Xintao Wu

Scoring systems, as a type of predictive model, have significant advantages in interpretability and transparency and facilitate quick decision-making. As such, scoring systems have been extensively used in a wide variety of industries such…

Machine Learning · Computer Science 2022-11-23 Yi Yang , Ying Wu , Mei Li , Xiangyu Chang , Yong Tan

As data-driven systems are increasingly deployed at scale, ethical concerns have arisen around unfair and discriminatory outcomes for historically marginalized groups that are underrepresented in training data. In response, work around AI…

Human-Computer Interaction · Computer Science 2022-09-21 Rie Kamikubo , Lining Wang , Crystal Marte , Amnah Mahmood , Hernisa Kacorri

Data-driven science is an emerging paradigm where scientific discoveries depend on the execution of computational AI models against rich, discipline-specific datasets. With modern machine learning frameworks, anyone can develop and execute…

Machine Learning · Computer Science 2022-08-09 Seth Ockerman , John Wu , Christopher Stewart

With the universal adoption of machine learning in healthcare, the potential for the automation of societal biases to further exacerbate health disparities poses a significant risk. We explore algorithmic fairness from the perspective of…

Machine Learning · Computer Science 2024-04-02 Md Rahat Shahriar Zawad , Peter Washington

Today, AI is increasingly being used in many high-stakes decision-making applications in which fairness is an important concern. Already, there are many examples of AI being biased and making questionable and unfair decisions. The AI…

Artificial Intelligence · Computer Science 2020-02-06 Yunfeng Zhang , Rachel K. E. Bellamy , Kush R. Varshney

Data-driven algorithms play a large role in decision making across a variety of industries. Increasingly, these algorithms are being used to make decisions that have significant ramifications for people's social and economic well-being,…

Machine Learning · Computer Science 2018-09-26 J. Henry Hinnefeld , Peter Cooman , Nat Mammo , Rupert Deese

In this paper, we initiate the study of fair clustering that ensures distributional similarity among similar individuals. In response to improving fairness in machine learning, recent papers have investigated fairness in clustering…

Machine Learning · Computer Science 2020-06-24 Nihesh Anderson , Suman K. Bera , Syamantak Das , Yang Liu

Machine learning systems are increasingly being used in critical decision making such as healthcare, finance, and criminal justice. Concerns around their fairness have resulted in several bias mitigation techniques that emphasize the need…

Machine Learning · Computer Science 2024-12-05 Jahid Hasan , Romila Pradhan

Effective machine learning models can automatically learn useful information from a large quantity of data and provide decisions in a high accuracy. These models may, however, lead to unfair predictions in certain sense among the population…

Machine Learning · Computer Science 2020-06-19 Mingliang Chen , Min Wu

AI-based systems are widely employed nowadays to make decisions that have far-reaching impacts on individuals and society. Their decisions might affect everyone, everywhere and anytime, entailing concerns about potential human rights…