English
Related papers

Related papers: Reducing Sentiment Bias in Language Models via Cou…

200 papers

Large Language Models have been shown to demonstrate stereotypical biases in their representations and behavior due to the discriminative nature of the data that they have been trained on. Despite significant progress in the development of…

Computation and Language · Computer Science 2025-10-29 Kaveh Eskandari Miandoab , Mahammed Kamruzzaman , Arshia Gharooni , Gene Louis Kim , Vasanth Sarathy , Ninareh Mehrabi

While various approaches have recently been studied for bias identification, little is known about how implicit language that does not explicitly convey a viewpoint affects bias amplification in large language models. To examine the…

Computation and Language · Computer Science 2024-08-19 Abeer Aldayel , Areej Alokaili , Rehab Alahmadi

Our society is plagued by several biases, including racial biases, caste biases, and gender bias. As a matter of fact, several years ago, most of these notions were unheard of. These biases passed through generations along with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Lavisha Aggarwal , Shruti Bhargava

The societal impact of pre-trained language models has prompted researchers to probe them for strong associations between protected attributes and value-loaded terms, from slur to prestigious job titles. Such work is said to probe models…

Computation and Language · Computer Science 2023-04-21 Laura Cabello , Anna Katrine Jørgensen , Anders Søgaard

As natural language processing methods are increasingly deployed in real-world scenarios such as healthcare, legal systems, and social science, it becomes necessary to recognize the role they potentially play in shaping social biases and…

Computation and Language · Computer Science 2020-07-17 Paul Pu Liang , Irene Mengze Li , Emily Zheng , Yao Chong Lim , Ruslan Salakhutdinov , Louis-Philippe Morency

We investigate the potential for nationality biases in natural language processing (NLP) models using human evaluation methods. Biased NLP models can perpetuate stereotypes and lead to algorithmic discrimination, posing a significant…

Computation and Language · Computer Science 2023-08-09 Pranav Narayanan Venkit , Sanjana Gautam , Ruchi Panchanadikar , Ting-Hao `Kenneth' Huang , Shomir Wilson

Pretrained language models (PLMs), such as GPT2, have achieved remarkable empirical performance in text generation tasks. However, pretrained on large-scale natural language corpora, the generated text from PLMs may exhibit social bias…

Computation and Language · Computer Science 2023-02-28 Rui Wang , Pengyu Cheng , Ricardo Henao

Multimodal Sentiment Analysis (MSA) aims to understand human intentions by integrating emotion-related clues from diverse modalities, such as visual, language, and audio. Unfortunately, the current MSA task invariably suffers from unplanned…

Computation and Language · Computer Science 2024-07-08 Dingkang Yang , Mingcheng Li , Dongling Xiao , Yang Liu , Kun Yang , Zhaoyu Chen , Yuzheng Wang , Peng Zhai , Ke Li , Lihua Zhang

Counterfactual explanations (CFEs) offer a tangible and actionable way to explain recommendations by showing users a "what-if" scenario that demonstrates how small changes in their history would alter the system's output. However, existing…

Information Retrieval · Computer Science 2025-08-13 Arjan Hasami , Masoud Mansoury

The impressive performance of language models is undeniable. However, the presence of biases based on gender, race, socio-economic status, physical appearance, and sexual orientation makes the deployment of language models challenging. This…

Computation and Language · Computer Science 2025-08-13 Swati Rajwal , Shivank Garg , Reem Abdel-Salam , Abdelrahman Zayed

Recently, sentiment-aware pre-trained language models (PLMs) demonstrate impressive results in downstream sentiment analysis tasks. However, they neglect to evaluate the quality of their constructed sentiment representations; they just…

Computation and Language · Computer Science 2024-04-02 Jaemin Kim , Yohan Na , Kangmin Kim , Sang Rak Lee , Dong-Kyu Chae

When pre-trained on large unsupervised textual corpora, language models are able to store and retrieve factual knowledge to some extent, making it possible to use them directly for zero-shot cloze-style question answering. However, storing…

Computation and Language · Computer Science 2020-05-12 Fabio Petroni , Patrick Lewis , Aleksandra Piktus , Tim Rocktäschel , Yuxiang Wu , Alexander H. Miller , Sebastian Riedel

From disinformation spread by AI chatbots to AI recommendations that inadvertently reinforce stereotypes, textual bias poses a significant challenge to the trustworthiness of large language models (LLMs). In this paper, we propose a…

Computation and Language · Computer Science 2025-03-04 Tianyi Huang , Elsa Fan

Present language understanding methods have demonstrated extraordinary ability of recognizing patterns in texts via machine learning. However, existing methods indiscriminately use the recognized patterns in the testing phase that is…

Computation and Language · Computer Science 2021-06-08 Fuli Feng , Jizhi Zhang , Xiangnan He , Hanwang Zhang , Tat-Seng Chua

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

Computation and Language · Computer Science 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

Recent studies have shown that generative language models often reflect and amplify societal biases in their outputs. However, these studies frequently conflate observed biases with other task-specific shortcomings, such as comprehension…

Computation and Language · Computer Science 2024-12-17 Akshita Jha , Sanchit Kabra , Chandan K. Reddy

Artificial intelligence (AI) systems, particularly those based on deep learning models, have increasingly achieved expert-level performance in medical applications. However, there is growing concern that such AI systems may reflect and…

Computation and Language · Computer Science 2025-04-25 Xiuying Chen , Tairan Wang , Juexiao Zhou , Zirui Song , Xin Gao , Xiangliang Zhang

The power of machine learning systems not only promises great technical progress, but risks societal harm. As a recent example, researchers have shown that popular word embedding algorithms exhibit stereotypical biases, such as gender bias.…

Machine Learning · Computer Science 2019-06-11 Marc-Etienne Brunet , Colleen Alkalay-Houlihan , Ashton Anderson , Richard Zemel

Prompting inputs with natural language task descriptions has emerged as a popular mechanism to elicit reasonably accurate outputs from large-scale generative language models with little to no in-context supervision. This also helps gain…

Computation and Language · Computer Science 2023-08-17 Lisa Bauer , Karthik Gopalakrishnan , Spandana Gella , Yang Liu , Mohit Bansal , Dilek Hakkani-Tur

In recent years, multimodal natural language processing, aimed at learning from diverse data types, has garnered significant attention. However, there needs to be more clarity when it comes to analysing multimodal tasks in multi-lingual…

Computation and Language · Computer Science 2024-06-13 Gaurish Thakkar , Sherzod Hakimov , Marko Tadić