中文
相关论文

相关论文: Uncovering Bias in Foundation Models: Impact, Test…

200 篇论文

Machine learning software is increasingly being used to make decisions that affect people's lives. But sometimes, the core part of this software (the learned model), behaves in a biased manner that gives undue advantages to a specific group…

软件工程 · 计算机科学 2020-10-07 Joymallya Chakraborty , Suvodeep Majumder , Zhe Yu , Tim Menzies

Most Fairness in AI research focuses on exposing biases in AI systems. A broader lens on fairness reveals that AI can serve a greater aspiration: rooting out societal inequities from their source. Specifically, we focus on inequities in…

Multimodal large language models (MLLMs) have shown strong potential for medical image reasoning, yet fairness across demographic groups remains a major concern. Existing debiasing methods often rely on large labeled datasets or…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Dawei Li , Zijian Gu , Peng Wang , Chuhan Song , Zhen Tan , Mohan Zhang , Tianlong Chen , Yu Tian , Song Wang

Classification, a heavily-studied data-driven machine learning task, drives an increasing number of prediction systems involving critical human decisions such as loan approval and criminal risk assessment. However, classifiers often…

机器学习 · 计算机科学 2022-04-12 Maliha Tashfia Islam , Anna Fariha , Alexandra Meliou , Babak Salimi

Vision-Language Models (VLMs) inherit significant social biases from their training data, notably in gender representation. Current fairness interventions often adopt a difference-unaware perspective that enforces uniform treatment across…

人工智能 · 计算机科学 2025-12-02 Yujie Lin , Jiayao Ma , Qingguo Hu , Derek F. Wong , Jinsong Su

Machine learning (ML) systems for medical imaging have demonstrated remarkable diagnostic capabilities, but their susceptibility to biases poses significant risks, since biases may negatively impact generalization performance. In this…

机器学习 · 计算机科学 2025-04-29 Haroui Ma , Francesco Quinzan , Theresa Willem , Stefan Bauer

We provide a psychometric-grounded exposition of bias and fairness as applied to a typical machine learning pipeline for affective computing. We expand on an interpersonal communication framework to elucidate how to identify sources of bias…

机器学习 · 计算机科学 2023-05-05 Brandon M Booth , Louis Hickman , Shree Krishna Subburaj , Louis Tay , Sang Eun Woo , Sidney K. DMello

We study fairness in supervised few-shot meta-learning models that are sensitive to discrimination (or bias) in historical data. A machine learning model trained based on biased data tends to make unfair predictions for users from minority…

机器学习 · 计算机科学 2020-09-25 Chen Zhao , Feng Chen

Despite the development of effective deepfake detectors in recent years, recent studies have demonstrated that biases in the data used to train these detectors can lead to disparities in detection accuracy across different races and…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Yan Ju , Shu Hu , Shan Jia , George H. Chen , Siwei Lyu

Human society had a long history of suffering from cognitive biases leading to social prejudices and mass injustice. The prevalent existence of cognitive biases in large volumes of historical data can pose a threat of being manifested as…

计算机与社会 · 计算机科学 2020-07-29 Procheta Sen , Debasis Ganguly

A multitude of work has shown that machine learning-based medical diagnosis systems can be biased against certain subgroups of people. This has motivated a growing number of bias mitigation algorithms that aim to address fairness issues in…

机器学习 · 计算机科学 2023-02-21 Yongshuo Zong , Yongxin Yang , Timothy Hospedales

Machine learning decision systems are getting omnipresent in our lives. From dating apps to rating loan seekers, algorithms affect both our well-being and future. Typically, however, these systems are not infallible. Moreover, complex…

机器学习 · 统计学 2022-02-15 Jakub Wiśniewski , Przemysław Biecek

In recent years, image and video manipulations with Deepfake have become a severe concern for security and society. Many detection models and datasets have been proposed to detect Deepfake data reliably. However, there is an increased…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Ying Xu , Philipp Terhörst , Kiran Raja , Marius Pedersen

Large Language Models (LLMs) push the bound-aries in natural language processing and generative AI, driving progress across various aspects of modern society. Unfortunately, the pervasive issue of bias in LLMs responses (i.e., predictions)…

计算与语言 · 计算机科学 2025-05-20 Isabela Pereira Gregio , Ian Pons , Anna Helena Reali Costa , Artur Jordão

The evaluation of fairness in machine learning systems has become a central concern in high-stakes applications, including biometric recognition, healthcare decision-making, and automated risk assessment. Existing approaches typically rely…

机器学习 · 计算机科学 2026-05-21 Khalid Adnan Alsayed

As machine learning models become increasingly integrated into healthcare, structural inequities and social biases embedded in clinical data can be perpetuated or even amplified by data-driven models. In survival analysis, censoring and…

Recent work has explored how to train machine learning models which do not discriminate against any subgroup of the population as determined by sensitive attributes such as gender or race. To avoid disparate treatment, sensitive attributes…

Artificial Intelligence has the capacity to amplify and perpetuate societal biases and presents profound ethical implications for society. Gender bias has been identified in the context of employment advertising and recruitment tools, due…

计算与语言 · 计算机科学 2020-05-19 Susan Leavy , Gerardine Meaney , Karen Wade , Derek Greene

It has been shown that many generative models inherit and amplify societal biases. To date, there is no uniform/systematic agreed standard to control/adjust for these biases. This study examines the presence and manipulation of societal…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Philip Wootaek Shin , Jihyun Janice Ahn , Wenpeng Yin , Jack Sampson , Vijaykrishnan Narayanan

Ensuring fairness in AI systems is critical, especially in high-stakes domains such as lending, hiring, and healthcare. This urgency is reflected in emerging global regulations that mandate fairness assessments and independent bias audits.…

机器学习 · 计算机科学 2025-08-19 Varsha Ramineni , Hossein A. Rahmani , Emine Yilmaz , David Barber