English
Related papers

Related papers: Auditing a Dutch Public Sector Risk Profiling Algo…

200 papers

In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to…

Machine Learning · Computer Science 2022-07-14 José Pombal , André F. Cruz , João Bravo , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

From massive face-recognition-based surveillance and machine-learning-based decision systems predicting crime recidivism rates, to the move towards automated health diagnostic systems, artificial intelligence (AI) is being used in scenarios…

Computers and Society · Computer Science 2019-08-20 Timnit Gebru

With the European Union's Artificial Intelligence Act taking effect on 1 August 2024, high-risk AI applications must adhere to stringent transparency and fairness standards. This paper addresses a crucial question: how can we scientifically…

Applications · Statistics 2024-09-09 Shiqi Fang , Zexun Chen , Jake Ansell

Recognizing, assessing, countering, and mitigating the biases of different nature from heterogeneous sources is a critical problem in designing a cognitive Decision Support System (DSS). An example of such a system is a cognitive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Kenneth Lai , Helder C. R. Oliveira , Ming Hou , Svetlana N. Yanushkevich , Vlad Shmerko

Recommender systems are essential for personalizing digital experiences on e-commerce sites, streaming services, and social media platforms. While these systems are necessary for modern digital interactions, they face fairness, bias,…

Information Retrieval · Computer Science 2024-09-20 Falguni Roy , Xiaofeng Ding , K. -K. R. Choo , Pan Zhou

Health care decisions are increasingly informed by clinical decision support algorithms, but these algorithms may perpetuate or increase racial and ethnic disparities in access to and quality of health care. Further complicating the…

Methodology · Statistics 2024-02-28 Solvejg Wastvedt , Joshua Snoke , Denis Agniel , Julie Lai , Marc N. Elliott , Steven C. Martino

There is substantial evidence that Artificial Intelligence (AI) and Machine Learning (ML) algorithms can generate bias against minorities, women, and other protected classes. Federal and state laws have been enacted to protect consumers…

Computers and Society · Computer Science 2021-08-23 Nicholas Schmidt , Bryce Stephens

There has been rapidly growing interest in the use of algorithms in hiring, especially as a means to address or mitigate bias. Yet, to date, little is known about how these methods are used in practice. How are algorithmic assessments…

Computers and Society · Computer Science 2019-12-10 Manish Raghavan , Solon Barocas , Jon Kleinberg , Karen Levy

Algorithmic discrimination is a condition that arises when data-driven software unfairly treats users based on attributes like ethnicity, race, gender, sexual orientation, religion, age, disability, or other personal characteristics.…

Software Engineering · Computer Science 2024-01-18 Ramandeep Singh Dehal , Mehak Sharma , Ronnie de Souza Santos

Context. As software systems become more integrated into society's infrastructure, the responsibility of software professionals to ensure compliance with various non-functional requirements increases. These requirements include security,…

Societal biases that are contained in retrieved documents have received increased interest. Such biases, which are often prevalent in the training data and learned by the model, can cause societal harms, by misrepresenting certain groups,…

Information Retrieval · Computer Science 2023-09-19 Maria Heuss , Daniel Cohen , Masoud Mansoury , Maarten de Rijke , Carsten Eickhoff

The emergence and growth of research on issues of ethics in AI, and in particular algorithmic fairness, has roots in an essential observation that structural inequalities in society are reflected in the data used to train predictive models…

Computers and Society · Computer Science 2020-02-28 Caitlin Kuhlman , Latifa Jackson , Rumi Chunara

Before deploying a black-box model in high-stakes problems, it is important to evaluate the model's performance on sensitive subpopulations. For example, in a recidivism prediction task, we may wish to identify demographic groups for which…

Methodology · Statistics 2023-06-09 John J. Cherian , Emmanuel J. Candès

Decision making in crucial applications such as lending, hiring, and college admissions has witnessed increasing use of algorithmic models and techniques as a result of a confluence of factors such as ubiquitous connectivity, ability to…

Artificial Intelligence · Computer Science 2020-09-08 G Roshan Lal , Sahin Cem Geyik , Krishnaram Kenthapadi

Predictive algorithms are now used to help distribute a large share of our society's resources and sanctions, such as healthcare, loans, criminal detentions, and tax audits. Under the right circumstances, these algorithms can improve the…

Machine Learning · Computer Science 2023-02-21 Alex Chohlas-Wood , Madison Coots , Sharad Goel , Julian Nyarko

In higher education, many institutions use algorithmic alerts to flag at-risk students and deliver advising at scale. While much research has focused on evaluating algorithmic predictions, relatively little is known about how discretionary…

Computers and Society · Computer Science 2025-10-16 Kara Schechtman , Benjamin Brandon , Jenise Stafford , Hannah Li , Lydia T. Liu

Undesired bias afflicts both human and algorithmic decision making, and may be especially prevalent when information processing trade-offs incentivize the use of heuristics. One primary example is \textit{statistical discrimination} --…

Large-scale web-scraped text corpora used to train general-purpose AI models often contain harmful demographic-targeted social biases, creating a regulatory need for data auditing and developing scalable bias-detection methods. Although…

Computation and Language · Computer Science 2026-04-10 Ayan Majumdar , Feihao Chen , Jinghui Li , Xiaozhen Wang

Cyberbullying, which often has a deeply negative impact on the victim, has grown as a serious issue in Online Social Networks. Recently, researchers have created automated machine learning algorithms to detect Cyberbullying using social and…

Social and Information Networks · Computer Science 2019-05-10 Vivek Singh , Connor Hofenbitzer

The increasing integration of machine learning algorithms in daily life underscores the critical need for fairness and equity in their deployment. As these technologies play a pivotal role in decision-making, addressing biases across…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Guanyu Hu , Eleni Papadopoulou , Dimitrios Kollias , Paraskevi Tzouveli , Jie Wei , Xinyu Yang