English
Related papers

Related papers: It's COMPASlicated: The Messy Relationship between…

200 papers

Predictive artificial intelligence (AI) offers an opportunity to improve clinical practice and patient outcomes, but risks perpetuating biases if fairness is inadequately addressed. However, the definition of "fairness" remains unclear. We…

Fairness is one of the most commonly identified ethical principles in existing AI guidelines, and the development of fair AI-enabled systems is required by new and emerging AI regulation. But most approaches to addressing the fairness of…

When might human input help (or not) when assessing risk in fairness domains? Dressel and Farid (2018) asked Mechanical Turk workers to evaluate a subset of defendants in the ProPublica COMPAS data for risk of recidivism, and concluded that…

Machine Learning · Computer Science 2018-12-04 Sarah Tan , Julius Adebayo , Kori Inkpen , Ece Kamar

The increasing application of Artificial Intelligence and Machine Learning models poses potential risks of unfair behavior and, in light of recent regulations, has attracted the attention of the research community. Several researchers…

Machine Learning · Computer Science 2023-02-17 Giandomenico Cornacchia , Vito Walter Anelli , Fedelucio Narducci , Azzurra Ragone , Eugenio Di Sciascio

Creating fair AI systems is a complex problem that involves the assessment of context-dependent bias concerns. Existing research and programming libraries express specific concerns as measures of bias that they aim to constrain or mitigate.…

Machine Learning · Computer Science 2024-05-30 Emmanouil Krasanakis , Symeon Papadopoulos

Current developments in AI made it broadly significant for reducing human labor and expenses across several essential domains, including healthcare and finance. However, the application of AI in the actual world poses multiple risks and…

Software Engineering · Computer Science 2025-07-28 Sadia Afrin Mim

Data-driven algorithms play a large role in decision making across a variety of industries. Increasingly, these algorithms are being used to make decisions that have significant ramifications for people's social and economic well-being,…

Machine Learning · Computer Science 2018-09-26 J. Henry Hinnefeld , Peter Cooman , Nat Mammo , Rupert Deese

While data-driven predictive models are a strictly technological construct, they may operate within a social context in which benign engineering choices entail implicit, indirect and unexpected real-life consequences. Fairness of such…

Machine Learning · Computer Science 2024-07-11 Kacper Sokol , Meelis Kull , Jeffrey Chan , Flora Salim

Intersectionality is a framework that analyzes how interlocking systems of power and oppression affect individuals along overlapping dimensions including race, gender, sexual orientation, class, and disability. Intersectionality theory…

Machine Learning · Computer Science 2019-09-11 James Foulds , Rashidul Islam , Kamrun Keya , Shimei Pan

Machine Learning algorithms (ML) impact virtually every aspect of human lives and have found use across diverse sectors including healthcare, finance, and education. Often, ML algorithms have been found to exacerbate societal biases present…

Machine Learning · Computer Science 2025-06-02 Jonathan Vasquez , Carlotta Domeniconi , Huzefa Rangwala

Fairness in AI-driven decision-making systems has become a critical concern, especially when these systems directly affect human lives. This paper explores the public's comprehension of fairness in healthcare recommendations. We conducted a…

Machine Learning · Computer Science 2024-09-10 Veronica Kecki , Alan Said

We address the critical issue of biased algorithms and unfair rankings, which have permeated various sectors, including search engines, recommendation systems, and workforce management. These biases can lead to discriminatory outcomes in a…

Computers and Society · Computer Science 2025-02-11 Chiara Criscuolo , Davide Martinenghi , Giuseppe Piccirillo

Fair and trustworthy AI is becoming ever more important in both machine learning and legal domains. One important consequence is that decision makers must seek to guarantee a 'fair', i.e., non-discriminatory, algorithmic decision procedure.…

Computers and Society · Computer Science 2024-12-23 Meike Zehlike , Alex Loosley , Håkan Jonsson , Emil Wiedemann , Philipp Hacker

Quantitative Artificial Intelligence (AI) Benchmarks have emerged as fundamental tools for evaluating the performance, capability, and safety of AI models and systems. Currently, they shape the direction of AI development and are playing an…

Artificial Intelligence · Computer Science 2025-05-27 Maria Eriksson , Erasmo Purificato , Arman Noroozian , Joao Vinagre , Guillaume Chaslot , Emilia Gomez , David Fernandez-Llorca

In the current era, people and society have grown increasingly reliant on artificial intelligence (AI) technologies. AI has the potential to drive us towards a future in which all of humanity flourishes. It also comes with substantial risks…

Computers and Society · Computer Science 2021-08-24 Lu Cheng , Kush R. Varshney , Huan Liu

Machine Learning or Artificial Intelligence algorithms have gained considerable scrutiny in recent times owing to their propensity towards imitating and amplifying existing prejudices in society. This has led to a niche but growing body of…

Machine Learning · Computer Science 2022-05-06 Avijit Ghosh , Lea Genuit , Mary Reagan

The increasing impact of algorithmic decisions on people's lives compels us to scrutinize their fairness and, in particular, the disparate impacts that ostensibly-color-blind algorithms can have on different groups. Examples include credit…

Machine Learning · Statistics 2020-06-17 Nathan Kallus , Xiaojie Mao , Angela Zhou

As decision-making increasingly relies on Machine Learning (ML) and (big) data, the issue of fairness in data-driven Artificial Intelligence (AI) systems is receiving increasing attention from both research and industry. A large variety of…

Machine Learning · Computer Science 2022-03-08 Tai Le Quy , Arjun Roy , Vasileios Iosifidis , Wenbin Zhang , Eirini Ntoutsi

Predictive algorithms are now used to help distribute a large share of our society's resources and sanctions, such as healthcare, loans, criminal detentions, and tax audits. Under the right circumstances, these algorithms can improve the…

Machine Learning · Computer Science 2023-02-21 Alex Chohlas-Wood , Madison Coots , Sharad Goel , Julian Nyarko

Algorithmic processes are increasingly employed to perform managerial decision making, especially after the tremendous success in Artificial Intelligence (AI). This paradigm shift is occurring because these sophisticated AI techniques are…

Computers and Society · Computer Science 2021-09-30 Jianlong Zhou , Sunny Verma , Mudit Mittal , Fang Chen