English
Related papers

Related papers: RobustDebias: Debiasing Language Models using Dist…

200 papers

Recent work has focused on compressing pre-trained language models (PLMs) like BERT where the major focus has been to improve the in-distribution performance for downstream tasks. However, very few of these studies have analyzed the impact…

Computation and Language · Computer Science 2023-02-28 Mengnan Du , Subhabrata Mukherjee , Yu Cheng , Milad Shokouhi , Xia Hu , Ahmed Hassan Awadallah

Vision-Language Models (VLMs) and generative image models have achieved remarkable performance across multimodal tasks, yet their robustness and fairness under input transformations remain insufficiently explored. This work investigates…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Tarannum Mithila

The use of large pretrained neural networks to create contextualized word embeddings has drastically improved performance on several natural language processing (NLP) tasks. These computationally expensive models have begun to be applied to…

Computers and Society · Computer Science 2019-12-03 Benjamin Clavié , Kobi Gal

Bridging the gap between diffusion models and human preferences is crucial for their integration into practical generative workflows. While optimizing downstream reward models has emerged as a promising alignment strategy, concerns arise…

Machine Learning · Computer Science 2026-03-02 Ziyi Zhang , Sen Zhang , Yibing Zhan , Yong Luo , Yonggang Wen , Dacheng Tao

In the realms of computer vision and natural language processing, Multimodal Large Language Models (MLLMs) have become indispensable tools, proficient in generating textual responses based on visual inputs. Despite their advancements, our…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 YiFan Zhang , Yang Shi , Weichen Yu , Qingsong Wen , Xue Wang , Wenjing Yang , Zhang Zhang , Liang Wang , Rong Jin

The output tendencies of Pre-trained Language Models (PLM) vary markedly before and after Fine-Tuning (FT) due to the updates to the model parameters. These divergences in output tendencies result in a gap in the social biases of PLMs. For…

Computation and Language · Computer Science 2024-01-17 Masahiro Kaneko , Danushka Bollegala , Timothy Baldwin

Debiasing language models from unwanted behaviors in Natural Language Understanding tasks is a topic with rapidly increasing interest in the NLP community. Spurious statistical correlations in the data allow models to perform shortcuts and…

Computation and Language · Computer Science 2022-12-06 Johannes Mario Meissner , Saku Sugawara , Akiko Aizawa

Large Language models (LLMs), such as ChatGPT, have gained popularity in recent years with the advancement of Natural Language Processing (NLP), with use cases spanning many disciplines and daily lives as well. LLMs inherit explicit and…

Computation and Language · Computer Science 2025-12-01 Fatima Kazi

Vision-language model (VLM) embeddings have been shown to encode biases present in their training data, such as societal biases that prescribe negative characteristics to members of various racial and gender identities. VLMs are being…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Walter Gerych , Haoran Zhang , Kimia Hamidieh , Eileen Pan , Maanas Sharma , Thomas Hartvigsen , Marzyeh Ghassemi

The rapid advancement of large-language models (LLMs) has driven extensive research into parameter compression after training has been completed, yet compression during the training phase remains largely unexplored. In this work, we…

Machine Learning · Computer Science 2025-11-19 Jun Wu , Jiangtao Wen , Yuxing Han

There is growing evidence that pretrained language models improve task-specific fine-tuning not just for the languages seen in pretraining, but also for new languages and even non-linguistic data. What is the nature of this surprising…

Computation and Language · Computer Science 2021-04-20 Zhengxuan Wu , Nelson F. Liu , Christopher Potts

Large Language Models (LLMs) inherit societal biases from their training data, potentially leading to harmful or unfair outputs. While various techniques aim to mitigate these biases, their effects are often evaluated only along the…

Computation and Language · Computer Science 2025-11-25 Shireen Chand , Faith Baca , Emilio Ferrara

In the current landscape of language model research, larger models, larger datasets and more compute seems to be the only way to advance towards intelligence. While there have been extensive studies of scaling laws and models' scaling…

Computation and Language · Computer Science 2024-08-01 Muhammad Ali , Swetasudha Panda , Qinlan Shen , Michael Wick , Ari Kobren

Deep models trained on large amounts of data often incorporate implicit biases present during training time. If later such a bias is discovered during inference or deployment, it is often necessary to acquire new data and retrain the model.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Niklas Penzel , Gideon Stein , Joachim Denzler

Preference alignment methods are increasingly critical for steering large language models (LLMs) to generate outputs consistent with human values. While recent approaches often rely on synthetic data generated by LLMs for scalability and…

Computation and Language · Computer Science 2025-10-21 Mingye Zhu , Yi Liu , Zheren Fu , Yongdong Zhang , Zhendong Mao

Large Language models (LLMs), while powerful, exhibit harmful social biases. Debiasing is often challenging due to computational costs, data constraints, and potential degradation of multi-task language capabilities. This work introduces a…

Computation and Language · Computer Science 2024-09-17 Pengrui Han , Rafal Kocielnik , Adhithya Saravanan , Roy Jiang , Or Sharir , Anima Anandkumar

Spurious correlation caused by subgroup underrepresentation has received increasing attention as a source of bias that can be perpetuated by deep neural networks (DNNs). Distributionally robust optimization has shown success in addressing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Nilesh Kumar , Ruby Shrestha , Zhiyuan Li , Linwei Wang

Large language models (LLMs) exhibit cognitive biases -- systematic tendencies of irrational decision-making, similar to those seen in humans. Prior work has found that these biases vary across models and can be amplified by instruction…

Computation and Language · Computer Science 2025-07-15 Itay Itzhak , Yonatan Belinkov , Gabriel Stanovsky

With the widespread deployment of deep learning models, they influence their environment in various ways. The induced distribution shifts can lead to unexpected performance degradation in deployed models. Existing methods to anticipate…

Several works have proven that finetuning is an applicable approach for debiasing contextualized word embeddings. Similarly, discrete prompts with semantic meanings have shown to be effective in debiasing tasks. With unfixed mathematical…

Computation and Language · Computer Science 2025-05-27 Ke Yang , Charles Yu , Yi Fung , Manling Li , Heng Ji