English
Related papers

Related papers: Analyzing Political Bias in LLMs via Target-Orient…

200 papers

Existing evaluations of political bias in large language models (LLMs) typically classify outputs as left- or right-leaning. We extend this perspective by examining how ideological tendencies vary across topics and how consistently models…

Computation and Language · Computer Science 2026-02-16 Shariar Kabir , Kevin Esterling , Yue Dong

The use of Large Language Models (LLMs) has proven to be a tool that could help in the automatic detection of sexism. Previous studies have shown that these models contain biases that do not accurately reflect reality, especially for…

Computation and Language · Computer Science 2025-08-26 Judith Tavarez-Rodríguez , Fernando Sánchez-Vega , A. Pastor López-Monroy

Search query suggestions affect users' interactions with search engines, which then influences the information they encounter. Thus, bias in search query suggestions can lead to exposure to biased search results and can impact opinion…

Information Retrieval · Computer Science 2024-11-01 Fabian Haak , Björn Engelmann , Christin Katharina Kreutz , Philipp Schaer

Large language models (LLMs) are trained on vast amounts of data to generate natural language, enabling them to perform tasks like text summarization and question answering. These models have become popular in artificial intelligence (AI)…

LLMs internally organize political ideology along low-dimensional structures that are partially, but not fully aligned with human ideological space. This misalignment is systematic, model specific, and measurable. We introduce a lightweight…

Computation and Language · Computer Science 2026-01-09 Wei Xia , Haowen Tang , Luozheng Li

This study attempts to advancing content analysis methodology from consensus-oriented to coordination-oriented practices, thereby embracing diverse coding outputs and exploring the dynamics among differential perspectives. As an exploratory…

Computation and Language · Computer Science 2025-12-25 Taewoo Kang , Kjerstin Thorson , Tai-Quan Peng , Dan Hiaeshutter-Rice , Sanguk Lee , Stuart Soroka

The rapid development of Large Language Models (LLMs) creates new opportunities for recommender systems, especially by exploiting the side information (e.g., descriptions and analyses of items) generated by these models. However, aligning…

Information Retrieval · Computer Science 2025-04-14 Guixian Zhang , Guan Yuan , Debo Cheng , Lin Liu , Jiuyong Li , Shichao Zhang

Large language models (LLMs) are known to generate biased responses where the opinions of certain groups and populations are underrepresented. Here, we present a novel approach to achieve controllable generation of specific viewpoints using…

Computation and Language · Computer Science 2024-04-04 Junyi Li , Ninareh Mehrabi , Charith Peris , Palash Goyal , Kai-Wei Chang , Aram Galstyan , Richard Zemel , Rahul Gupta

Large language models (LLMs) are known to be sensitive to input phrasing, but the mechanisms by which semantic cues shape reasoning remain poorly understood. We investigate this phenomenon in the context of comparative math problems with…

Computation and Language · Computer Science 2025-06-05 Mohammadamin Shafiei , Hamidreza Saffari , Nafise Sadat Moosavi

This paper explores the design of a propaganda detection tool using Large Language Models (LLMs). Acknowledging the inherent biases in AI models, especially in political contexts, we investigate how these biases might be leveraged to…

Human-Computer Interaction · Computer Science 2025-12-01 Liudmila Zavolokina , Kilian Sprenkamp , Zoya Katashinskaya , Daniel Gordon Jones

Large language models (LLMs) make it possible to generate synthetic behavioural data at scale, offering an ethical and low-cost alternative to human experiments. Whether such data can faithfully capture psychological differences driven by…

Computation and Language · Computer Science 2025-11-27 Manuel Pratelli , Marinella Petrocchi

How biased is a language model? The answer depends on how you ask. A model that refuses to choose between castes for a leadership role will, in a fill-in-the-blank task, reliably associate upper castes with purity and lower castes with lack…

Computation and Language · Computer Science 2026-04-06 Divyanshu Kumar , Ishita Gupta , Nitin Aravind Birur , Tanay Baswa , Sahil Agarwal , Prashanth Harshangi

We investigate the efficacy of Large Language Models (LLMs) in detecting implicit and explicit hate speech, examining how models with minimal safety alignment (uncensored) compare with more heavily aligned (censored) counterparts in a…

Computation and Language · Computer Science 2026-05-05 Sanjeeevan Selvaganapathy , Mehwish Nasim

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

Computation and Language · Computer Science 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

Large Language Models (LLMs) are increasingly used in decision-making, yet their susceptibility to cognitive biases remains a pressing challenge. This study explores how personality traits influence these biases and evaluates the…

Artificial Intelligence · Computer Science 2025-02-21 Jiangen He , Jiqun Liu

Large language models (LLMs) are revolutionizing every aspect of society. They are increasingly used in problem-solving tasks to substitute human assessment and reasoning. LLMs are trained on what humans write and are thus exposed to human…

Software Engineering · Computer Science 2025-10-14 Fengfei Sun , Ningke Li , Kailong Wang , Lorenz Goette

Sentiment Analysis (SA) models harbor inherent social biases that can be harmful in real-world applications. These biases are identified by examining the output of SA models for sentences that only vary in the identity groups of the…

Computation and Language · Computer Science 2025-10-16 Zsolt T. Kardkovacs , Lynda Djennane , Anna Field , Boualem Benatallah , Yacine Gaci , Fabio Casati , Walid Gaaloul

Amidst the rapid normalization of generative artificial intelligence (GAI), intelligent systems have come to dominate political discourse across information media. However, internalized political biases stemming from training data skews,…

Computation and Language · Computer Science 2025-11-04 Nathan Junzi Chen

As Large Language Models (LLMs) are increasingly embedded in real-world decision-making processes, it becomes crucial to examine the extent to which they exhibit cognitive biases. Extensively studied in the field of psychology, cognitive…

Computation and Language · Computer Science 2025-09-30 R. Alexander Knipper , Charles S. Knipper , Kaiqi Zhang , Valerie Sims , Clint Bowers , Santu Karmaker

Large Language Models (LLMs) inherit explicit and implicit biases from their training datasets. Identifying and mitigating biases in LLMs is crucial to ensure fair outputs, as they can perpetuate harmful stereotypes and misinformation. This…

Machine Learning · Computer Science 2025-11-19 Fatima Kazi , Alex Young , Yash Inani , Setareh Rafatirad