English
Related papers

Related papers: Towards Debiasing NLU Models from Unknown Biases

200 papers

While deep learning models often achieve strong task performance, their successes are hampered by their inability to disentangle spurious correlations from causative factors, such as when they use protected attributes (e.g., race, gender,…

Machine Learning · Computer Science 2020-11-17 Kurtis Evan David , Qiang Liu , Ruth Fong

Recent work on transformer-based neural networks has led to impressive advances on multiple-choice natural language understanding (NLU) problems, such as Question Answering (QA) and abductive reasoning. Despite these advances, there is…

Computation and Language · Computer Science 2022-10-05 Ke Shen , Mayank Kejriwal

Large Language Models (LLMs) have revolutionized Recommender Systems (RS) through advanced generative user modeling. However, LLM-based RS (LLM-RS) often inadvertently perpetuates bias present in the training data, leading to severe…

Information Retrieval · Computer Science 2026-02-03 Jin Li , Huilin Gu , Shoujin Wang , Qi Zhang , Shui Yu , Chen Wang , Xiwei Xu , Fang Chen

The issue of algorithmic biases in deep learning has led to the development of various debiasing techniques, many of which perform complex training procedures or dataset manipulation. However, an intriguing question arises: is it possible…

Pseudo-labels are confident predictions made on unlabeled target data by a classifier trained on labeled source data. They are widely used for adapting a model to unlabeled data, e.g., in a semi-supervised learning setting. Our key insight…

Machine Learning · Computer Science 2022-04-22 Xudong Wang , Zhirong Wu , Long Lian , Stella X. Yu

The deployment of large-scale models, such as large language models (LLMs), incurs substantial costs due to their computational demands. To mitigate these costs and address challenges related to scalability and data security, there is a…

Large Multi-Modal Models (LMMs) have demonstrated impressive capabilities as general-purpose chatbots able to engage in conversations about visual inputs. However, their responses are influenced by societal biases present in their training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Neale Ratzlaff , Matthew Lyle Olson , Musashi Hinck , Estelle Aflalo , Shao-Yen Tseng , Vasudev Lal , Phillip Howard

We present a data-driven modeling strategy to overcome improperly modeled dynamics for systems exhibiting complex spatio-temporal behaviors. We propose a Deep Learning framework to resolve the differences between the true dynamics of the…

Machine Learning · Computer Science 2020-10-28 Maan Qraitem , Dhanushka Kularatne , Eric Forgoston , M. Ani Hsieh

Although large language models (LLMs) have achieved significant success, their vulnerability to adversarial perturbations, including recent jailbreak attacks, has raised considerable concerns. However, the increasing size of these models…

Computation and Language · Computer Science 2024-04-19 Jiabao Ji , Bairu Hou , Zhen Zhang , Guanhua Zhang , Wenqi Fan , Qing Li , Yang Zhang , Gaowen Liu , Sijia Liu , Shiyu Chang

Machine learned models exhibit bias, often because the datasets used to train them are biased. This presents a serious problem for the deployment of such technology, as the resulting models might perform poorly on populations that are…

Machine Learning · Computer Science 2018-10-02 Daniel McDuff , Roger Cheng , Ashish Kapoor

Vision-language model (VLM) embeddings have been shown to encode biases present in their training data, such as societal biases that prescribe negative characteristics to members of various racial and gender identities. VLMs are being…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Walter Gerych , Haoran Zhang , Kimia Hamidieh , Eileen Pan , Maanas Sharma , Thomas Hartvigsen , Marzyeh Ghassemi

Large pre-trained vision-language models (VLMs) reduce the time for developing predictive models for various vision-grounded language downstream tasks by providing rich, adaptable image and text representations. However, these models suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Ashish Seth , Mayur Hemani , Chirag Agarwal

As machine learning increasingly influences critical domains such as credit underwriting, public policy, and talent acquisition, ensuring compliance with fairness constraints is both a legal and ethical imperative. This paper introduces a…

Machine Learning · Computer Science 2025-04-24 Léandre Eberhard , Nirek Sharma , Filipp Shelobolin , Aalok Ganesh Shanbhag

In various statistical settings, the goal is to estimate a function which is restricted by the statistical model only through a conditional moment restriction. Prominent examples include the nonparametric instrumental variable framework for…

Methodology · Statistics 2025-05-28 AmirEmad Ghassami , James M. Robins , Andrea Rotnitzky

The presence of a bias in each image data collection has recently attracted a lot of attention in the computer vision community showing the limits in generalization of any learning method trained on a specific dataset. At the same time,…

Computer Vision and Pattern Recognition · Computer Science 2015-05-07 Tatiana Tommasi , Novi Patricia , Barbara Caputo , Tinne Tuytelaars

The increasing use of foundation models highlights the urgent need to address and eliminate implicit biases present in them that arise during pretraining. In this paper, we introduce PEFTDebias, a novel approach that employs…

Machine Learning · Computer Science 2023-12-04 Sumit Agarwal , Aditya Srikanth Veerubhotla , Srijan Bansal

Supervised machine learning models often associate irrelevant nuisance factors with the prediction target, which hurts generalization. We propose a framework for training robust neural networks that induces invariance to nuisances through…

Machine Learning · Computer Science 2019-12-03 Ayush Jaiswal , Rob Brekelmans , Daniel Moyer , Greg Ver Steeg , Wael AbdAlmageed , Premkumar Natarajan

Machine learning models can fail on subgroups that are underrepresented during training. While techniques such as dataset balancing can improve performance on underperforming groups, they require access to training group annotations and can…

Machine Learning · Computer Science 2024-06-25 Saachi Jain , Kimia Hamidieh , Kristian Georgiev , Andrew Ilyas , Marzyeh Ghassemi , Aleksander Madry

Bias in AI/ML-based systems is a ubiquitous problem and bias in AI/ML systems may negatively impact society. There are many reasons behind a system being biased. The bias can be due to the algorithm we are using for our problem or may be…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Vedant V. Kandge , Siddhant V. Kandge , Kajal Kumbharkar , Tanuja Pattanshetti

Denoising diffusion models are a novel class of generative algorithms that achieve state-of-the-art performance across a range of domains, including image generation and text-to-image tasks. Building on this success, diffusion models have…

Machine Learning · Computer Science 2024-03-08 Nic Fishman , Leo Klarner , Valentin De Bortoli , Emile Mathieu , Michael Hutchinson