English
Related papers

Related papers: Parameter-efficient Modularised Bias Mitigation vi…

200 papers

Sparse additive models have attracted much attention in high-dimensional data analysis due to their flexible representation and strong interpretability. However, most existing models are limited to single-level learning under the…

Machine Learning · Computer Science 2026-04-23 Xuelin Zhang , Xinyue Liu , Lingjuan Wu , Hong Chen

The increasing use of foundation models highlights the urgent need to address and eliminate implicit biases present in them that arise during pretraining. In this paper, we introduce PEFTDebias, a novel approach that employs…

Machine Learning · Computer Science 2023-12-04 Sumit Agarwal , Aditya Srikanth Veerubhotla , Srijan Bansal

Recent studies have revealed that the widely-used Pre-trained Language Models (PLMs) propagate societal biases from the large unmoderated pre-training corpora. Existing solutions require debiasing training processes and datasets for…

Computation and Language · Computer Science 2023-07-25 Somayeh Ghanbarzadeh , Yan Huang , Hamid Palangi , Radames Cruz Moreno , Hamed Khanpour

Data fusion enables powerful and generalizable analyses across multiple sources. However, different data collection capacities across different sources lead to blockwise missingness (BM), which poses challenges in practice. Meanwhile, the…

Methodology · Statistics 2025-12-09 Yiming Li , Ying Wei , Molei Liu

Fine-tuned language models have been shown to exhibit biases against protected groups in a host of modeling tasks such as text classification and coreference resolution. Previous works focus on detecting these biases, reducing bias in data…

Computation and Language · Computer Science 2021-04-13 Xisen Jin , Francesco Barbieri , Brendan Kennedy , Aida Mostafazadeh Davani , Leonardo Neves , Xiang Ren

Gender bias exists in natural language datasets which neural language models tend to learn, resulting in biased text generation. In this research, we propose a debiasing approach based on the loss function modification. We introduce a new…

Computation and Language · Computer Science 2019-06-05 Yusu Qian , Urwa Muaz , Ben Zhang , Jae Won Hyun

Traditional approaches to learning fair machine learning models often require rebuilding models from scratch, typically without considering potentially existing models. In a context where models need to be retrained frequently, this can…

Machine Learning · Computer Science 2025-07-22 Federico Di Gennaro , Thibault Laugel , Vincent Grari , Marcin Detyniecki

We present a parameter-efficient method for continual video question-answering (VidQA) learning. Our method, named DAM, uses the proposed Dynamic Adapter Merging to (i) mitigate catastrophic forgetting, (ii) enable efficient adaptation to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Feng Cheng , Ziyang Wang , Yi-Lin Sung , Yan-Bo Lin , Mohit Bansal , Gedas Bertasius

Pre-trained language models (PLMs) are trained on data that inherently contains gender biases, leading to undesirable impacts. Traditional debiasing methods often rely on external corpora, which may lack quality, diversity, or demographic…

Computation and Language · Computer Science 2025-03-13 Liu Yu , Ludie Guo , Ping Kuang , Fan Zhou

Multi-prompt learning methods have emerged as an effective approach for facilitating the rapid adaptation of vision-language models to downstream tasks with limited resources. Existing multi-prompt learning methods primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Fei Song , Yi Li , Jiangmeng Li , Rui Wang , Changwen Zheng , Fanjiang Xu , Hui Xiong

Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is…

Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic…

Human-Computer Interaction · Computer Science 2022-03-02 Wencan Zhang , Mariella Dimiccoli , Brian Y. Lim

Language model debiasing has emerged as an important field of study in the NLP community. Numerous debiasing techniques were proposed, but bias ablation remains an unaddressed issue. We demonstrate a novel framework for inspecting bias in…

Computation and Language · Computer Science 2022-07-07 Przemyslaw Joniak , Akiko Aizawa

Deep learning model effectiveness in classification tasks is often challenged by the quality and quantity of training data whenever they are affected by strong spurious correlations between specific attributes and target labels. This…

If our models are used in new or unexpected cases, do we know if they will make fair predictions? Previously, researchers developed ways to debias a model for a single problem domain. However, this is often not how models are trained and…

Machine Learning · Computer Science 2019-11-18 Candice Schumann , Xuezhi Wang , Alex Beutel , Jilin Chen , Hai Qian , Ed H. Chi

Bias mitigation in machine learning models is imperative, yet challenging. While several approaches have been proposed, one view towards mitigating bias is through adversarial learning. A discriminator is used to identify the bias…

Machine Learning · Computer Science 2022-02-23 Vinod K Kurmi , Rishabh Sharma , Yash Vardhan Sharma , Vinay P. Namboodiri

Although federated learning has achieved many breakthroughs recently, the heterogeneous nature of the learning environment greatly limits its performance and hinders its real-world applications. The heterogeneous data, time-varying wireless…

Machine Learning · Computer Science 2023-02-22 Jingxin Li , Toktam Mahmoodi , Hak-Keung Lam

The biases and discrimination of machine learning algorithms have attracted significant attention, leading to the development of various algorithms tailored to specific contexts. However, these solutions often fall short of addressing…

Machine Learning · Computer Science 2025-08-05 Yinghui Huang , Zihao Tang , Xiangyu Chang

Continual learning is an essential capability of human cognition, yet it poses significant challenges for current deep learning models. The primary issue is that new knowledge can interfere with previously learned information, causing the…

Machine Learning · Computer Science 2025-09-19 Eric Nuertey Coleman , Luigi Quarantiello , Samrat Mukherjee , Julio Hurtado , Vincenzo Lomonaco

Large language models (LLMs) trained on vast corpora suffer from inevitable stereotype biases. Mitigating these biases with fine-tuning could be both costly and data-hungry. Model editing methods, which focus on modifying LLMs in a post-hoc…

Computation and Language · Computer Science 2024-02-22 Jianhao Yan , Futing Wang , Yafu Li , Yue Zhang