English
Related papers

Related papers: Software Fairness Testing in Practice

200 papers

The evaluation of recommender system fairness has become increasingly important, especially with recent legislation that emphasises the development of fair and responsible artificial intelligence. This has led to the emergence of various…

Information Retrieval · Computer Science 2026-04-29 Theresia Veronika Rampisela

Fairness in machine learning is more important than ever as ethical concerns continue to grow. Individual fairness demands that individuals differing only in sensitive attributes receive the same outcomes. However, commonly used machine…

Machine Learning · Computer Science 2025-08-22 Ruihan Zhang , Jun Sun

Benchmarking competitions are central to the development of artificial intelligence (AI) in medical imaging, defining performance standards and shaping methodological progress. However, it remains unclear whether these benchmarks provide…

Fairness is one of the most commonly identified ethical principles in existing AI guidelines, and the development of fair AI-enabled systems is required by new and emerging AI regulation. But most approaches to addressing the fairness of…

We propose new tools for policy-makers to use when assessing and correcting fairness and bias in AI algorithms. The three tools are: - A new definition of fairness called "controlled fairness" with respect to choices of protected features…

Machine Learning · Computer Science 2020-07-10 Mingliang Chen , Aria Shahverdi , Sarah Anderson , Se Yong Park , Justin Zhang , Dana Dachman-Soled , Kristin Lauter , Min Wu

The fairness of machine learning (ML) approaches is critical to the reliability of modern artificial intelligence systems. Despite extensive study on this topic, the fairness of ML models in the software engineering (SE) domain has not been…

Software Engineering · Computer Science 2023-07-24 Mohammad Mahdi Mohajer , Alvine Boaye Belle , Nima Shiri harzevili , Junjie Wang , Hadi Hemmati , Song Wang , Zhen Ming , Jiang

In this paper we examine algorithmic fairness from the perspective of law aiming to identify best practices and strategies for the specification and adoption of fairness definitions and algorithms in real-world systems and use cases. We…

Computers and Society · Computer Science 2024-05-01 Giorgos Giannopoulos , Maria Psalla , Loukas Kavouras , Dimitris Sacharidis , Jakub Marecek , German M Matilla , Ioannis Emiris

Classification, a heavily-studied data-driven machine learning task, drives an increasing number of prediction systems involving critical human decisions such as loan approval and criminal risk assessment. However, classifiers often…

Machine Learning · Computer Science 2022-04-12 Maliha Tashfia Islam , Anna Fariha , Alexandra Meliou , Babak Salimi

One of the difficulties of artificial intelligence is to ensure that model decisions are fair and free of bias. In research, datasets, metrics, techniques, and tools are applied to detect and mitigate algorithmic unfairness and bias. This…

This paper investigates current software testing systems and explores how artificial intelligence, specifically Generative AI, can be integrated to enhance these systems. It begins by examining different types of AI systems and focuses on…

Software Engineering · Computer Science 2026-03-03 Tanish Singla , Qusay H. Mahmoud

An increasing number of decisions regarding the daily lives of human beings are being controlled by artificial intelligence (AI) algorithms in spheres ranging from healthcare, transportation, and education to college admissions,…

Computers and Society · Computer Science 2020-01-28 Dana Pessach , Erez Shmueli

Algorithmic fairness for artificial intelligence has become increasingly relevant as these systems become more pervasive in society. One realm of AI, recommender systems, presents unique challenges for fairness due to trade offs between…

Information Retrieval · Computer Science 2020-04-21 Jessie Smith , Nasim Sonboli , Casey Fiesler , Robin Burke

Recent research advances in Artificial Intelligence (AI) have yielded promising results for automated software vulnerability management. AI-based models are reported to greatly outperform traditional static analysis tools, indicating a…

Cryptography and Security · Computer Science 2024-05-07 Shengye Wan , Joshua Saxe , Craig Gomes , Sahana Chennabasappa , Avilash Rath , Kun Sun , Xinda Wang

The prevalence of software systems has become an integral part of modern-day living. Software usage has increased significantly, leading to its growth in both size and complexity. Consequently, software development is becoming a more…

Software Engineering · Computer Science 2023-06-07 Tiago Dias , Arthur Batista , Eva Maia , Isabel Praça

Fairness is an increasingly important concern as machine learning models are used to support decision making in high-stakes applications such as mortgage lending, hiring, and prison sentencing. This paper introduces a new open source Python…

To implement fair machine learning in a sustainable way, choosing the right fairness objective is key. Since fairness is a concept of justice which comes in various, sometimes conflicting definitions, this is not a trivial task though. The…

Artificial Intelligence · Computer Science 2021-05-04 Boris Ruf , Marcin Detyniecki

The development of Artificial Intelligence (AI), including AI in Science (AIS), should be done following the principles of responsible AI. Progress in responsible AI is often quantified through evaluation metrics, yet there has been less…

Computers and Society · Computer Science 2025-10-31 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Christina Lioma

Ensuring that machine learning (ML) models are safe, effective, and equitable across all patients is critical for clinical decision-making and for preventing the amplification of existing health disparities. In this work, we examine how…

Machine Learning · Computer Science 2025-05-28 Jianhui Gao , Benson Chou , Zachary R. McCaw , Hilary Thurston , Paul Varghese , Chuan Hong , Jessica Gronsbell

Early studies of risk assessment algorithms used in criminal justice revealed widespread racial biases. In response, machine learning researchers have developed methods for fairness, many of which rely on equalizing empirical metrics across…

Computers and Society · Computer Science 2022-09-15 Rajiv Movva

The increasing use of Artificial Intelligence (AI) in critical societal domains has amplified concerns about fairness, particularly regarding unequal treatment across sensitive attributes such as race, gender, and socioeconomic status.…

Machine Learning · Computer Science 2025-12-09 Munshi Mahbubur Rahman , Shimei Pan , James R. Foulds