English
Related papers

Related papers: On Measuring Social Biases in Prompt-Based Multi-T…

200 papers

This paper investigates the influence of cognitive biases on Large Language Models (LLMs) outputs. Cognitive biases, such as confirmation and availability biases, can distort user inputs through prompts, potentially leading to unfaithful…

Computation and Language · Computer Science 2025-06-17 Yan Sun , Stanley Kok

Large language models have demonstrated surprising ability to perform in-context learning, i.e., these models can be directly applied to solve numerous downstream tasks by conditioning on a prompt constructed by a few input-output examples.…

Computation and Language · Computer Science 2023-04-03 Huan Ma , Changqing Zhang , Yatao Bian , Lemao Liu , Zhirui Zhang , Peilin Zhao , Shu Zhang , Huazhu Fu , Qinghua Hu , Bingzhe Wu

Large vision-language model (LVLM) based text-to-image (T2I) systems have become the dominant paradigm in image generation, yet whether they amplify social biases remains insufficiently understood. In this paper, we show that LVLM-based…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 NaHyeon Park , Namin An , Kunhee Kim , Soyeon Yoon , Jiahao Huo , Hyunjung Shim

The emergence of large language models (LLMs) has opened up exciting possibilities for simulating human behavior and cognitive processes, with potential applications in various domains, including marketing research and consumer behavior…

Computation and Language · Computer Science 2024-11-13 Behnam Mohammadi

Negative bias refers to the tendency of large language models (LLMs) to excessively generate negative responses in binary decision tasks (e.g., yes-no question answering). Previous research has focused on detecting and addressing negative…

Computation and Language · Computer Science 2025-11-17 Jongyoon Song , Sangwon Yu , Sungroh Yoon

Large language models (LLMs) can be used as accessible and intelligent chatbots by constructing natural language queries and directly inputting the prompt into the large language model. However, different prompt' constructions often lead to…

Computation and Language · Computer Science 2023-12-14 Jinta Weng , Jiarui Zhang , Yue Hu , Daidong Fa , Xiaofeng Xuand , Heyan Huang

Due to the superior performance, large-scale pre-trained language models (PLMs) have been widely adopted in many aspects of human society. However, we still lack effective tools to understand the potential bias embedded in the black-box…

Computation and Language · Computer Science 2022-04-18 Apoorv Garg , Deval Srivastava , Zhiyang Xu , Lifu Huang

Pre-trained language models derive substantial linguistic and factual knowledge from the massive corpora on which they are trained, and prompt engineering seeks to align these models to specific tasks. Unfortunately, existing prompt…

Large language models (LLMs) can pass explicit social bias tests but still harbor implicit biases, similar to humans who endorse egalitarian beliefs yet exhibit subtle biases. Measuring such implicit biases can be a challenge: as LLMs…

Computers and Society · Computer Science 2024-05-24 Xuechunzi Bai , Angelina Wang , Ilia Sucholutsky , Thomas L. Griffiths

We present a robust methodology for evaluating biases in natural language generation(NLG) systems. Previous works use fixed hand-crafted prefix templates with mentions of various demographic groups to prompt models to generate continuations…

Computation and Language · Computer Science 2022-12-06 Arshiya Aggarwal , Jiao Sun , Nanyun Peng

Large language models (LLMs) have shown remarkable abilities in different fields, including standard Natural Language Processing (NLP) tasks. To elicit knowledge from LLMs, prompts play a key role, consisting of natural language…

Computation and Language · Computer Science 2024-10-08 Mohamed Bayan Kmainasi , Rakif Khan , Ali Ezzat Shahroor , Boushra Bendou , Maram Hasanain , Firoj Alam

Language models have steadily increased in size over the past few years. They achieve a high level of performance on various natural language processing (NLP) tasks such as question answering and summarization. Large language models (LLMs)…

Computation and Language · Computer Science 2023-01-31 Jessica Huynh , Cathy Jiao , Prakhar Gupta , Shikib Mehri , Payal Bajaj , Vishrav Chaudhary , Maxine Eskenazi

The rise of large language models (LLMs) has revolutionized natural language processing (NLP), yet the influence of prompt sentiment, a latent affective characteristic of input text, remains underexplored. This study systematically examines…

Computation and Language · Computer Science 2025-03-19 Vishal Gandhi , Sagar Gandhi

Large language models (LLMs), such as GPT series and Llama series have demonstrated strong capabilities in natural language processing, contextual understanding, and text generation. In recent years, researchers are trying to enhance the…

Computation and Language · Computer Science 2024-10-08 Ziyang Chen , Stylios Moscholios

Text-to-image (TTI) diffusion models have achieved remarkable visual quality, yet they have been repeatedly shown to exhibit social biases across sensitive attributes such as gender, race and age. To mitigate these biases, existing…

Machine Learning · Computer Science 2026-03-18 Manos Plitsis , Giorgos Bouritsas , Vassilis Katsouros , Yannis Panagakis

Large language models (LLMs) are known to be sensitive to input phrasing, but the mechanisms by which semantic cues shape reasoning remain poorly understood. We investigate this phenomenon in the context of comparative math problems with…

Computation and Language · Computer Science 2025-06-05 Mohammadamin Shafiei , Hamidreza Saffari , Nafise Sadat Moosavi

Text matching is a fundamental technique in both information retrieval and natural language processing. Text matching tasks share the same paradigm that determines the relationship between two given texts. The relationships vary from task…

Information Retrieval · Computer Science 2022-08-23 Shicheng Xu , Liang Pang , Huawei Shen , Xueqi Cheng

Despite advances in the multilingual capabilities of Large Language Models (LLMs) across diverse tasks, English remains the dominant language for LLM research and development. So, when working with a different language, this has led to the…

Computation and Language · Computer Science 2025-02-14 Itai Mondshine , Tzuf Paz-Argaman , Reut Tsarfaty

Prompting inputs with natural language task descriptions has emerged as a popular mechanism to elicit reasonably accurate outputs from large-scale generative language models with little to no in-context supervision. This also helps gain…

Computation and Language · Computer Science 2023-08-17 Lisa Bauer , Karthik Gopalakrishnan , Spandana Gella , Yang Liu , Mohit Bansal , Dilek Hakkani-Tur

Prompt-based language models like GPT4 and LLaMa have been used for a wide variety of use cases such as simulating agents, searching for information, or for content analysis. For all of these applications and others, political biases in…

Computers and Society · Computer Science 2025-07-22 Mats Faulborn , Indira Sen , Max Pellert , Andreas Spitz , David Garcia