English
Related papers

Related papers: Uncovering Implicit Bias in Large Language Models …

200 papers

Concept guidance has emerged as a cheap and simple way to control the behavior of language models by probing their hidden representations for concept vectors and using them to perturb activations at inference time. While the focus of…

Computation and Language · Computer Science 2024-02-23 Dimitri von Rütte , Sotiris Anagnostidis , Gregor Bachmann , Thomas Hofmann

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Large language models (LLMs) have achieved state-of-the-art performance on a series of natural language understanding tasks. However, these LLMs might rely on dataset bias and artifacts as shortcuts for prediction. This has significantly…

Computation and Language · Computer Science 2023-05-09 Mengnan Du , Fengxiang He , Na Zou , Dacheng Tao , Xia Hu

Language modeling on large-scale datasets leads to impressive performance gains on various downstream language tasks. The validation pre-training loss (or perplexity in autoregressive language modeling) is often used as the evaluation…

Machine Learning · Computer Science 2022-10-26 Hong Liu , Sang Michael Xie , Zhiyuan Li , Tengyu Ma

In this paper, we investigate the extrapolation capabilities of implicit deep learning models in handling unobserved data, where traditional deep neural networks may falter. Implicit models, distinguished by their adaptability in layer…

Machine Learning · Computer Science 2024-07-22 Juliette Decugis , Alicia Y. Tsai , Max Emerling , Ashwin Ganesh , Laurent El Ghaoui

Language model alignment research often attempts to ensure that models are not only helpful and harmless, but also truthful and unbiased. However, optimizing these objectives simultaneously can obscure how improving one aspect might impact…

Computation and Language · Computer Science 2024-12-02 Suyash Fulay , William Brannon , Shrestha Mohanty , Cassandra Overney , Elinor Poole-Dayan , Deb Roy , Jad Kabbara

Detecting biases in the outputs produced by generative models is essential to reduce the potential risks associated with their application in critical settings. However, the majority of existing methodologies for identifying biases in…

Computation and Language · Computer Science 2025-02-04 Erica Coppolillo , Giuseppe Manco , Luca Maria Aiello

In-context learning (ICL) using large language models for tasks with many labels is challenging due to the limited context window, which makes it difficult to fit a sufficient number of examples in the prompt. In this paper, we use a…

Computation and Language · Computer Science 2023-12-07 Aristides Milios , Siva Reddy , Dzmitry Bahdanau

Gradient-based deep-learning algorithms exhibit remarkable performance in practice, but it is not well-understood why they are able to generalize despite having more parameters than training examples. It is believed that implicit bias is a…

Machine Learning · Computer Science 2022-11-08 Gal Vardi

Large language models (LLMs) are trained on extensive text corpora, which inevitably include biased information. Although techniques such as Affective Alignment can mitigate some negative impacts of these biases, existing prompt-based…

Computation and Language · Computer Science 2024-08-21 Yongxin Deng , Xihe Qiu , Xiaoyu Tan , Jing Pan , Chen Jue , Zhijun Fang , Yinghui Xu , Wei Chu , Yuan Qi

This paper investigates the influence of cognitive biases on Large Language Models (LLMs) outputs. Cognitive biases, such as confirmation and availability biases, can distort user inputs through prompts, potentially leading to unfaithful…

Computation and Language · Computer Science 2025-06-17 Yan Sun , Stanley Kok

Grasping the commonsense properties of everyday concepts is an important prerequisite to language understanding. While contextualised language models are reportedly capable of predicting such commonsense properties with human-level…

Computation and Language · Computer Science 2022-10-07 Amit Gajbhiye , Luis Espinosa-Anke , Steven Schockaert

Large Language Models (LLMs) exhibit In-Context Learning (ICL), which enables the model to perform new tasks conditioning only on the examples provided in the context without updating the model's weights. While ICL offers fast adaptation…

Large Language Models increasingly suppress biased outputs when demographic identity is stated explicitly, yet may still exhibit implicit biases when identity is conveyed indirectly. Existing benchmarks use name based proxies to detect…

Computation and Language · Computer Science 2026-04-03 Bhaskara Hanuma Vedula , Darshan Anghan , Ishita Goyal , Ponnurangam Kumaraguru , Abhijnan Chakraborty

In-context learning (ICL) derives its power from enabling Large Language Models to adapt to new tasks via prompt-based reasoning alone, entirely bypassing the need for parameter updates. Existing theories primarily study ICL in single-task…

Machine Learning · Computer Science 2026-05-28 Guangyu Li , Meng Ding , Lijie Hu

Progress in pre-trained language models has led to a surge of impressive results on downstream tasks for natural language understanding. Recent work on probing pre-trained language models uncovered a wide range of linguistic properties…

Computation and Language · Computer Science 2022-03-22 Zeming Chen , Qiyue Gao

Language models have been shown to perform better with an increase in scale on a wide variety of tasks via the in-context learning paradigm. In this paper, we investigate the hypothesis that the ability of a large language model to…

Computation and Language · Computer Science 2023-08-17 Hritik Bansal , Karthik Gopalakrishnan , Saket Dingliwal , Sravan Bodapati , Katrin Kirchhoff , Dan Roth

Concept-based explainability methods provide insight into deep learning systems by constructing explanations using human-understandable concepts. While the literature on human reasoning demonstrates that we exploit relationships between…

Machine Learning · Computer Science 2024-05-29 Naveen Raman , Mateo Espinosa Zarlenga , Mateja Jamnik

Inductive biases are inherent in every machine learning system, shaping how models generalize from finite data. In the case of neural language models (LMs), debates persist as to whether these biases align with or diverge from human…

Computation and Language · Computer Science 2025-06-06 Taiga Someya , Anej Svete , Brian DuSell , Timothy J. O'Donnell , Mario Giulianelli , Ryan Cotterell

Deep vision models often rely on biases learned from spurious correlations in datasets. To identify these biases, methods that interpret high-level, human-understandable concepts are more effective than those relying primarily on low-level…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 David Méndez , Gianpaolo Bontempo , Elisa Ficarra , Roberto Confalonieri , Natalia Díaz-Rodríguez