中文
相关论文

相关论文: Bias Mitigation in Fine-tuning Pre-trained Models …

200 篇论文

We introduce a framework to measure how biases change before and after fine-tuning a large scale visual recognition model for a downstream task. Deep learning models trained on increasing amounts of data are known to encode societal biases.…

计算机视觉与模式识别 · 计算机科学 2023-03-15 Jaspreet Ranjit , Tianlu Wang , Baishakhi Ray , Vicente Ordonez

With growing awareness of societal impact of artificial intelligence, fairness has become an important aspect of machine learning algorithms. The issue is that human biases towards certain groups of population, defined by sensitive features…

机器学习 · 计算机科学 2020-11-17 Andrija Petrović , Mladen Nikolić , Sandro Radovanović , Boris Delibašić , Miloš Jovanović

Machine learning models are central to people's lives and impact society in ways as fundamental as determining how people access information. The gravity of these models imparts a responsibility to model developers to ensure that they are…

应用统计 · 统计学 2020-07-13 Cyrus DiCiccio , Sriram Vasudevan , Kinjal Basu , Krishnaram Kenthapadi , Deepak Agarwal

As the use of artificial intelligence rapidly increases, the development of trustworthy artificial intelligence has become important. However, recent studies have shown that deep neural networks are susceptible to learn spurious…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Yooshin Cho , Hanbyel Cho , Janghyeon Lee , HyeongGwon Hong , Jaesung Ahn , Junmo Kim

Deep neural networks have achieved exceptional results across a range of applications. As the demand for efficient and sparse deep learning models escalates, the significance of model compression, particularly pruning, is increasingly…

机器学习 · 计算机科学 2025-04-01 Yucong Dai , Gen Li , Feng Luo , Xiaolong Ma , Yongkai Wu

Improving the fairness of machine learning models is a nuanced task that requires decision makers to reason about multiple, conflicting criteria. The majority of fair machine learning methods transform the error-fairness trade-off into a…

神经与进化计算 · 计算机科学 2023-04-25 William G. La Cava

Parameter fine tuning is a transfer learning approach whereby learned parameters from pre-trained source network are transferred to the target network followed by fine-tuning. Prior research has shown that this approach is capable of…

计算机视觉与模式识别 · 计算机科学 2019-09-20 Tasfia Shermin , Shyh Wei Teng , Manzur Murshed , Guojun Lu , Ferdous Sohel , Manoranjan Paul

Machine learning models are becoming pervasive in high-stakes applications. Despite their clear benefits in terms of performance, the models could show discrimination against minority groups and result in fairness issues in a…

机器学习 · 计算机科学 2022-04-12 Mingyang Wan , Daochen Zha , Ninghao Liu , Na Zou

Despite being widely used, face recognition models suffer from bias: the probability of a false positive (incorrect face match) strongly depends on sensitive attributes such as the ethnicity of the face. As a result, these models can…

计算机视觉与模式识别 · 计算机科学 2022-03-31 Tiago Salvador , Stephanie Cairns , Vikram Voleti , Noah Marshall , Adam Oberman

Developing models with robust group fairness properties is paramount, particularly in ethically sensitive domains such as medical diagnosis. Recent approaches to achieving fairness in machine learning require a substantial amount of…

机器学习 · 计算机科学 2024-10-02 Yuyang Xue , Junyu Yan , Raman Dutt , Fasih Haider , Jingshuai Liu , Steven McDonagh , Sotirios A. Tsaftaris

When using machine learning for automated prediction, it is important to account for fairness in the prediction. Fairness in machine learning aims to ensure that biases in the data and model inaccuracies do not lead to discriminatory…

机器学习 · 计算机科学 2024-12-10 Jan Pablo Burgard , João Vitor Pamplona

Training models with robust group fairness properties is crucial in ethically sensitive application areas such as medical diagnosis. Despite the growing body of work aiming to minimise demographic bias in AI, this problem remains…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Raman Dutt , Ondrej Bohdal , Sotirios A. Tsaftaris , Timothy Hospedales

Many instances of algorithmic bias are caused by subpopulation shifts. For example, ML models often perform worse on demographic groups that are underrepresented in the training data. In this paper, we study whether enforcing algorithmic…

机器学习 · 统计学 2021-10-28 Subha Maity , Debarghya Mukherjee , Mikhail Yurochkin , Yuekai Sun

Many works have shown that deep learning-based medical image classification models can exhibit bias toward certain demographic attributes like race, gender, and age. Existing bias mitigation methods primarily focus on learning debiased…

图像与视频处理 · 电气工程与系统科学 2022-03-07 Yawen Wu , Dewen Zeng , Xiaowei Xu , Yiyu Shi , Jingtong Hu

In inductive transfer learning, fine-tuning pre-trained convolutional networks substantially outperforms training from scratch. When using fine-tuning, the underlying assumption is that the pre-trained model extracts generic features, which…

机器学习 · 计算机科学 2018-06-07 Xuhong Li , Yves Grandvalet , Franck Davoine

Fairness,the impartial treatment towards individuals or groups regardless of their inherent or acquired characteristics [20], is a critical challenge for the successful implementation of Artificial Intelligence (AI) in multiple fields like…

神经与进化计算 · 计算机科学 2025-05-19 Catalina M Jaramillo , Paul Squires , Julian Togelius

With the fast development of algorithmic governance, fairness has become a compulsory property for machine learning models to suppress unintentional discrimination. In this paper, we focus on the pre-processing aspect for achieving…

机器学习 · 计算机科学 2022-06-20 Peizhao Li , Hongfu Liu

As a dominant paradigm, fine-tuning a pre-trained model on the target data is widely used in many deep learning applications, especially for small data sets. However, recent studies have empirically shown that training from scratch has the…

计算机视觉与模式识别 · 计算机科学 2022-05-27 Ziquan Liu , Yi Xu , Yuanhong Xu , Qi Qian , Hao Li , Xiangyang Ji , Antoni Chan , Rong Jin

Data sets for fairness relevant tasks can lack examples or be biased according to a specific label in a sensitive attribute. We demonstrate the usefulness of weight based meta-learning approaches in such situations. For models that can be…

机器学习 · 计算机科学 2019-11-12 Dylan Slack , Sorelle Friedler , Emile Givental

Pre-training is a widely used approach to develop models that are robust to distribution shifts. However, in practice, its effectiveness varies: fine-tuning a pre-trained model improves robustness significantly in some cases but not at all…

机器学习 · 计算机科学 2024-12-24 Benjamin Cohen-Wang , Joshua Vendrow , Aleksander Madry