English
Related papers

Related papers: Themis-ml: A Fairness-aware Machine Learning Inter…

200 papers

Machine Learning (ML) algorithms shape our lives. Banks use them to determine if we are good borrowers; IT companies delegate them recruitment decisions; police apply ML for crime-prediction, and judges base their verdicts on ML. However,…

Computer Science and Game Theory · Computer Science 2021-01-05 Omer Ben-Porat , Fedor Sandomirskiy , Moshe Tennenholtz

Employers are adopting algorithmic hiring technology throughout the recruitment pipeline. Algorithmic fairness is especially applicable in this domain due to its high stakes and structural inequalities. Unfortunately, most work in this…

Machine learning has significantly enhanced the abilities of robots, enabling them to perform a wide range of tasks in human environments and adapt to our uncertain real world. Recent works in various machine learning domains have…

Algorithmic discrimination is a critical concern as machine learning models are used in high-stakes decision-making in legally protected contexts. Although substantial research on algorithmic bias and discrimination has led to the…

Computers and Society · Computer Science 2025-06-18 Holli Sargeant , Måns Magnusson

Both industry and academia have made considerable progress in developing trustworthy and responsible machine learning (ML) systems. While critical concepts like fairness and explainability are often addressed, the safety of systems is…

Machine Learning · Statistics 2022-11-08 Patrick Kaiser , Christoph Kern , David Rügamer

The rise in the use of AI/ML applications across industries has sparked more discussions about the fairness of AI/ML in recent times. While prior research on the fairness of AI/ML exists, there is a lack of empirical studies focused on…

Computers and Society · Computer Science 2024-08-02 Aastha Pant , Rashina Hoda , Chakkrit Tantithamthavorn , Burak Turhan

We study fairness in Machine Learning (FairML) through the lens of attribute-based explanations generated for machine learning models. Our hypothesis is: Biased Models have Biased Explanations. To establish that, we first translate existing…

Machine Learning · Computer Science 2020-12-22 Aditya Jain , Manish Ravula , Joydeep Ghosh

Artificial Intelligence and Machine Learning are becoming increasingly present in several aspects of human life, especially, those dealing with decision making. Many of these algorithmic decisions are taken without human supervision and…

Machine Learning · Computer Science 2020-06-19 Vaishnavi Bhargava , Miguel Couceiro , Amedeo Napoli

Large Language Models (LLMs) have demonstrated remarkable success across various domains but often lack fairness considerations, potentially leading to discriminatory outcomes against marginalized populations. Unlike fairness in traditional…

Computation and Language · Computer Science 2024-08-09 Thang Doan Viet , Zichong Wang , Minh Nhat Nguyen , Wenbin Zhang

The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality training data, most…

Machine Learning · Computer Science 2022-04-01 Sainyam Galhotra , Karthikeyan Shanmugam , Prasanna Sattigeri , Kush R. Varshney

The widespread integration of Machine Learning systems in daily life, particularly in high-stakes domains, has raised concerns about the fairness implications. While prior works have investigated static fairness measures, recent studies…

Machine Learning · Computer Science 2025-07-30 Usman Gohar , Zeyu Tang , Jialu Wang , Kun Zhang , Peter L. Spirtes , Yang Liu , Lu Cheng

With the current ongoing debate about fairness, explainability and transparency of machine learning models, their application in high-impact clinical decision-making systems must be scrutinized. We consider a real-life example of risk…

Machine Learning · Computer Science 2020-11-13 Sandhya Tripathi , Bradley A. Fritz , Mohamed Abdelhack , Michael S. Avidan , Yixin Chen , Christopher R. King

Biases in machine learning pose significant challenges, particularly when models amplify disparities that affect disadvantaged groups. Traditional bias mitigation techniques often lead to a {\itshape leveling-down effect}, whereby improving…

Machine Learning · Computer Science 2025-09-03 Lucas Mansilla , Rodrigo Echeveste , Camila Gonzalez , Diego H. Milone , Enzo Ferrante

Machine learning algorithms for prediction are increasingly being used in critical decisions affecting human lives. Various fairness formalizations, with no firm consensus yet, are employed to prevent such algorithms from systematically…

Machine Learning · Computer Science 2018-05-29 Pratik Gajane , Mykola Pechenizkiy

Machine learning models are increasingly being used in important decision-making software such as approving bank loans, recommending criminal sentencing, hiring employees, and so on. It is important to ensure the fairness of these models so…

Machine Learning · Computer Science 2020-09-23 Sumon Biswas , Hridesh Rajan

Unintended biases in machine learning (ML) models are among the major concerns that must be addressed to maintain public trust in ML. In this paper, we address process fairness of ML models that consists in reducing the dependence of models…

Machine Learning · Computer Science 2021-08-06 Guilherme Alves , Maxime Amblard , Fabien Bernier , Miguel Couceiro , Amedeo Napoli

Recent work has explored how to train machine learning models which do not discriminate against any subgroup of the population as determined by sensitive attributes such as gender or race. To avoid disparate treatment, sensitive attributes…

Machine Learning · Statistics 2018-09-06 Niki Kilbertus , Adrià Gascón , Matt J. Kusner , Michael Veale , Krishna P. Gummadi , Adrian Weller

Generative AI technologies, particularly Large Language Models (LLMs), have transformed information management systems but introduced substantial biases that can compromise their effectiveness in informing business decision-making. This…

Computers and Society · Computer Science 2025-02-18 Xiahua Wei , Naveen Kumar , Han Zhang

As the data-driven decision process becomes dominating for industrial applications, fairness-aware machine learning arouses great attention in various areas. This work proposes fairness penalties learned by neural networks with a simple…

Machine Learning · Statistics 2024-03-12 Jinwon Sohn , Qifan Song , Guang Lin

Large language models (LLMs) are increasingly deployed in high-stakes hiring applications, making decisions that directly impact people's careers and livelihoods. While prior studies suggest simple anti-bias prompts can eliminate…

Machine Learning · Computer Science 2025-06-13 Adam Karvonen , Samuel Marks