English
Related papers

Related papers: FairLens: Auditing Black-box Clinical Decision Sup…

200 papers

Recent advancements in Artificial Intelligence, particularly in Large Language Models (LLMs), have transformed natural language processing by improving generative capabilities. However, detecting biases embedded within these models remains…

Computation and Language · Computer Science 2025-03-11 Suvendu Mohanty

Decisions made by various Artificial Intelligence (AI) systems greatly influence our day-to-day lives. With the increasing use of AI systems, it becomes crucial to know that they are fair, identify the underlying biases in their…

Computers and Society · Computer Science 2022-03-15 Avinash Agarwal , Harsh Agarwal , Nihaarika Agarwal

Objectives: Leveraging artificial intelligence (AI) in conjunction with electronic health records (EHRs) holds transformative potential to improve healthcare. Yet, addressing bias in AI, which risks worsening healthcare disparities, cannot…

Artificial Intelligence · Computer Science 2026-01-08 Feng Chen , Liqin Wang , Julie Hong , Jiaqi Jiang , Li Zhou

The rapid development of generative AI (GenAI) models in computer vision necessitates effective evaluation methods to ensure their quality and fairness. Existing tools primarily focus on dataset quality assurance and model explainability,…

Human-Computer Interaction · Computer Science 2024-02-07 Tica Lin , Hanspeter Pfister , Jui-Hsien Wang

There is growing concern that the potential of black box AI may exacerbate health-related disparities and biases such as gender and ethnicity in clinical decision-making. Biased decisions can arise from data availability and collection…

Computers and Society · Computer Science 2023-11-28 Jiahui Liu , Xiaohao Cai , Mahesan Niranjan

The integration of artificial intelligence (AI) into medicine is remarkable, offering advanced diagnostic and therapeutic possibilities. However, the inherent opacity of complex AI models presents significant challenges to their clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Binbin Wen , Yihang Wu , Tareef Daqqaq , Ahmad Chaddad

The ethical integration of Artificial Intelligence (AI) in healthcare necessitates addressing fairness-a concept that is highly context-specific across medical fields. Extensive studies have been conducted to expand the technical components…

AI systems can create, propagate, support, and automate bias in decision-making processes. To mitigate biased decisions, we both need to understand the origin of the bias and define what it means for an algorithm to make fair decisions.…

Machine Learning · Computer Science 2022-08-29 Carmen Mazijn , Carina Prunkl , Andres Algaba , Jan Danckaert , Vincent Ginis

Causal machine learning methods which flexibly generate heterogeneous treatment effect estimates could be very useful tools for governments trying to make and implement policy. However, as the critical artificial intelligence literature has…

Econometrics · Economics 2023-09-06 Patrick Rehill , Nicholas Biddle

Multi-agent systems have demonstrated the ability to improve performance on a variety of predictive tasks by leveraging collaborative decision making. However, the lack of effective evaluation methodologies has made it difficult to estimate…

Machine Learning · Computer Science 2025-12-19 Maeve Madigan , Parameswaran Kamalaruban , Glenn Moynihan , Tom Kempton , David Sutton , Stuart Burrell

The adoption of diagnosis and prognostic algorithms in healthcare has led to concerns about the perpetuation of bias against disadvantaged groups of individuals. Deep learning methods to detect and mitigate bias have revolved around…

The use of machine learning to guide clinical decision making has the potential to worsen existing health disparities. Several recent works frame the problem as that of algorithmic fairness, a framework that has attracted considerable…

Machine Learning · Statistics 2021-06-16 Stephen R. Pfohl , Agata Foryciarz , Nigam H. Shah

Objective: Algorithmic fairness is essential for equitable and trustworthy machine learning in healthcare. Most fairness tools emphasize single-axis demographic comparisons and may miss compounded disparities affecting intersectional…

Machine Learning · Computer Science 2026-04-07 Nick Souligne , Vignesh Subbian

Due to the beyond-classical capability of quantum computing, quantum machine learning is applied independently or embedded in classical models for decision making, especially in the field of finance. Fairness and other ethical issues are…

Quantum Physics · Physics 2022-07-25 Ji Guan , Wang Fang , Mingsheng Ying

In the current development and deployment of many artificial intelligence (AI) systems in healthcare, algorithm fairness is a challenging problem in delivering equitable care. Recent evaluation of AI models stratified across race…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Richard J. Chen , Tiffany Y. Chen , Jana Lipkova , Judy J. Wang , Drew F. K. Williamson , Ming Y. Lu , Sharifa Sahai , Faisal Mahmood

Many works have shown that deep learning-based medical image classification models can exhibit bias toward certain demographic attributes like race, gender, and age. Existing bias mitigation methods primarily focus on learning debiased…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Yawen Wu , Dewen Zeng , Xiaowei Xu , Yiyu Shi , Jingtong Hu

Machine learning software is increasingly being used to make decisions that affect people's lives. But sometimes, the core part of this software (the learned model), behaves in a biased manner that gives undue advantages to a specific group…

Software Engineering · Computer Science 2020-10-07 Joymallya Chakraborty , Suvodeep Majumder , Zhe Yu , Tim Menzies

Thanks to the great progress of machine learning in the last years, several Artificial Intelligence (AI) techniques have been increasingly moving from the controlled research laboratory settings to our everyday life. AI is clearly…

Artificial Intelligence · Computer Science 2021-06-07 Tatiana Tommasi , Silvia Bucci , Barbara Caputo , Pietro Asinari

We propose new tools for policy-makers to use when assessing and correcting fairness and bias in AI algorithms. The three tools are: - A new definition of fairness called "controlled fairness" with respect to choices of protected features…

Machine Learning · Computer Science 2020-07-10 Mingliang Chen , Aria Shahverdi , Sarah Anderson , Se Yong Park , Justin Zhang , Dana Dachman-Soled , Kristin Lauter , Min Wu

Black box systems for automated decision making, often based on machine learning over (big) data, map a user's features into a class or a score without exposing the reasons why. This is problematic not only for lack of transparency, but…

Artificial Intelligence · Computer Science 2018-06-27 Dino Pedreschi , Fosca Giannotti , Riccardo Guidotti , Anna Monreale , Luca Pappalardo , Salvatore Ruggieri , Franco Turini