中文
相关论文

相关论文: Bias Mitigation in Fine-tuning Pre-trained Models …

200 篇论文

Pretrained machine learning models are known to perpetuate and even amplify existing biases in data, which can result in unfair outcomes that ultimately impact user experience. Therefore, it is crucial to understand the mechanisms behind…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Laura Cabello , Emanuele Bugliarello , Stephanie Brandl , Desmond Elliott

Real-world datasets often encode stereotypes and societal biases. Such biases can be implicitly captured by trained models, leading to biased predictions and exacerbating existing societal preconceptions. Existing debiasing methods, such as…

机器学习 · 计算机科学 2022-05-06 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

机器学习 · 统计学 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

Machine learning models have achieved widespread success but often inherit and amplify historical biases, resulting in unfair outcomes. Traditional fairness methods typically impose constraints at the prediction level, without addressing…

机器学习 · 统计学 2026-02-10 Enze Shi , Pankaj Bhagwat , Zhixian Yang , Linglong Kong , Bei Jiang

Model pruning can enable the deployment of neural networks in environments with resource constraints. While pruning may have a small effect on the overall performance of the model, it can exacerbate existing biases into the model such that…

机器学习 · 计算机科学 2024-11-19 Robbie Meyer , Alexander Wong

Foundation models pretrained on physiological data such as photoplethysmography (PPG) signals are increasingly used to improve heart rate (HR) prediction across diverse settings. Fine-tuning these models for local deployment is often seen…

机器学习 · 计算机科学 2025-09-23 Lovely Yeswanth Panchumarthi , Saurabh Kataria , Yi Wu , Xiao Hu , Alex Fedorov , Hyunjung Gloria Kwak

We develop a novel bias mitigation framework with distribution-based fairness constraints suitable for producing demographically blind and explainable machine-learning models across a wide range of fairness levels. This is accomplished…

机器学习 · 计算机科学 2025-10-31 Ryan Franks , Alexey Miroshnikov , Konstandinos Kotsiopoulos

Fairness-aware machine learning has recently attracted various communities to mitigate discrimination against certain societal groups in data-driven tasks. For fair supervised learning, particularly in pre-processing, there have been two…

机器学习 · 计算机科学 2026-01-21 Jinwon Sohn , Guang Lin , Qifan Song

As a fundamental problem in transfer learning, model selection aims to rank off-the-shelf pre-trained models and select the most suitable one for the new target task. Existing model selection techniques are often constrained in their scope…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Jiameng Bai , Sai Wu , Jie Song , Junbo Zhao , Gang Chen

Fine-tuned language models have been shown to exhibit biases against protected groups in a host of modeling tasks such as text classification and coreference resolution. Previous works focus on detecting these biases, reducing bias in data…

计算与语言 · 计算机科学 2021-04-13 Xisen Jin , Francesco Barbieri , Brendan Kennedy , Aida Mostafazadeh Davani , Leonardo Neves , Xiang Ren

If our models are used in new or unexpected cases, do we know if they will make fair predictions? Previously, researchers developed ways to debias a model for a single problem domain. However, this is often not how models are trained and…

机器学习 · 计算机科学 2019-11-18 Candice Schumann , Xuezhi Wang , Alex Beutel , Jilin Chen , Hai Qian , Ed H. Chi

In consequential decision-making applications, mitigating unwanted biases in machine learning models that yield systematic disadvantage to members of groups delineated by sensitive attributes such as race and gender is one key intervention…

机器学习 · 计算机科学 2022-12-15 Prasanna Sattigeri , Soumya Ghosh , Inkit Padhi , Pierre Dognin , Kush R. Varshney

Fine-tuning pre-trained models for downstream tasks is a widely adopted technique known for its adaptability and reliability across various domains. Despite its conceptual simplicity, fine-tuning entails several troublesome engineering…

人工智能 · 计算机科学 2024-12-30 Chaeyun Jang , Hyungi Lee , Jungtaek Kim , Juho Lee

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

机器学习 · 统计学 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

Fairness in machine learning has attained significant focus due to the widespread application in high-stake decision-making tasks. Unregulated machine learning classifiers can exhibit bias towards certain demographic groups in data, thus…

机器学习 · 计算机科学 2023-07-04 Bishwamittra Ghosh , Debabrota Basu , Kuldeep S. Meel

There has been an increase in research in developing machine learning models for mental health detection or prediction in recent years due to increased mental health issues in society. Effective use of mental health prediction or detection…

机器学习 · 计算机科学 2022-08-09 Khadija Zanna , Kusha Sridhar , Han Yu , Akane Sano

Fine-tuning large pre-trained models has become the de facto strategy for developing both task-specific and general-purpose machine learning systems, including developing models that are safe to deploy. Despite its clear importance, there…

Although the pre-training followed by fine-tuning paradigm is used extensively in many fields, there is still some controversy surrounding the impact of pre-training on the fine-tuning process. Currently, experimental findings based on text…

机器学习 · 计算机科学 2023-09-12 Jiashu Pu , Shiwei Zhao , Ling Cheng , Yongzhu Chang , Runze Wu , Tangjie Lv , Rongsheng Zhang

Pre-trained models have become indispensable for efficiently building models across a broad spectrum of downstream tasks. The advantages of pre-trained models have been highlighted by empirical studies on scaling laws, which demonstrate…

机器学习 · 统计学 2026-02-05 Kazuto Fukuchi , Ryuichiro Hataya , Kota Matsui

Feature attribution methods, proposed recently, help users interpret the predictions of complex models. Our approach integrates feature attributions into the objective function to allow machine learning practitioners to incorporate priors…

计算与语言 · 计算机科学 2019-06-21 Frederick Liu , Besim Avci