English
Related papers

Related papers: Revealing Fine-Grained Values and Opinions in Larg…

200 papers

With the incredible advancements in Large Language Models (LLMs), many people have started using them to satisfy their information needs. However, utilizing LLMs might be problematic for political issues where disagreement is common and…

Computers and Society · Computer Science 2026-01-27 Salah Feras Alali , Mohammad Nashat Maasfeh , Mucahid Kutlu , Saban Kardas

The analysis of political biases in large language models (LLMs) has primarily examined these systems as single entities with fixed viewpoints. While various methods exist for measuring such biases, the impact of persona-based prompting on…

Computation and Language · Computer Science 2025-02-27 Pietro Bernardelle , Leon Fröhling , Stefano Civelli , Riccardo Lunardi , Kevin Roitero , Gianluca Demartini

Large language models (LLMs) are increasingly being utilised across a range of tasks and domains, with a burgeoning interest in their application within the field of journalism. This trend raises concerns due to our limited understanding of…

Computation and Language · Computer Science 2024-06-18 Filip Trhlik , Pontus Stenetorp

The versatility of Large Language Models (LLMs) on natural language understanding tasks has made them popular for research in social sciences. To properly understand the properties and innate personas of LLMs, researchers have performed…

Computation and Language · Computer Science 2024-04-03 Bangzhao Shu , Lechen Zhang , Minje Choi , Lavinia Dunagan , Lajanugen Logeswaran , Moontae Lee , Dallas Card , David Jurgens

Today's large language models (LLMs) are capable of supporting multilingual scenarios, allowing users to interact with LLMs in their native languages. When LLMs respond to subjective questions posed by users, they are expected to align with…

Computation and Language · Computer Science 2025-11-20 Yang Liu , Masahiro Kaneko , Chenhui Chu

Large Language Models (LLMs) are increasingly used as proxies for human subjects in social science surveys, but their reliability and susceptibility to known human-like response biases, such as central tendency, opinion floating and primacy…

Computation and Language · Computer Science 2025-10-17 Jens Rupprecht , Georg Ahnert , Markus Strohmaier

As large language models (LLMs) are increasingly deployed, understanding how they express political positioning is important for evaluating alignment and downstream effects. We audit 26 contemporary LLMs using three political psychometric…

Computers and Society · Computer Science 2026-03-18 Adib Sakhawat , Tahsin Islam , Takia Farhin , Syed Rifat Raiyan , Hasan Mahmud , Md Kamrul Hasan

Social media platforms are rife with politically charged discussions. Therefore, accurately deciphering and predicting partisan biases using Large Language Models (LLMs) is increasingly critical. In this study, we address the challenge of…

Computation and Language · Computer Science 2023-11-17 Zihao He , Siyi Guo , Ashwin Rao , Kristina Lerman

This study systematically analyzes geopolitical bias across 11 prominent Large Language Models (LLMs) by examining their responses to seven critical topics in U.S.-China relations. Utilizing a bilingual (English and Chinese) and…

Computation and Language · Computer Science 2025-04-01 William Guey , Pierrick Bougault , Vitor D. de Moura , Wei Zhang , Jose O. Gomes

Political polarization emerges from a complex interplay of beliefs about policies, figures, and issues. However, most computational analyses reduce discourse to coarse partisan labels, overlooking how these beliefs interact. This is…

Computation and Language · Computer Science 2026-05-21 Özgür Togay , Javier Garcia-Bernardo , Florian Kunneman , Anastasia Giachanou

Large language models (LLMs) are trained on vast amounts of data to generate natural language, enabling them to perform tasks like text summarization and question answering. These models have become popular in artificial intelligence (AI)…

Large Language Models (LLMs) have transformed natural language processing, but concerns have emerged about their susceptibility to ideological manipulation, particularly in politically sensitive areas. Prior work has focused on binary…

Computation and Language · Computer Science 2025-04-22 Demetris Paschalides , George Pallis , Marios D. Dikaiakos

The widespread integration of Large Language Models (LLMs) across various sectors has highlighted the need for empirical research to understand their biases, thought patterns, and societal implications to ensure ethical and effective use.…

Computation and Language · Computer Science 2025-05-20 Manari Hirose , Masato Uchida

Large language models (LLMs) have demonstrated impressive capabilities in various reasoning tasks, aided by techniques like chain-of-thought prompting that elicits verbalized reasoning. However, LLMs often generate text with obvious…

Artificial Intelligence · Computer Science 2024-12-06 Zhihui Xie , Jizhou Guo , Tong Yu , Shuai Li

Large language models (LLMs) exhibit systematic political bias across a variety of sensitive contexts. We find that LLMs handle counterpart topics from opposing political sides asymmetrically. We refer to this phenomenon as covert political…

Computation and Language · Computer Science 2026-05-29 Long Phan , Devin Kim , Alexander Pan , Alice Blair , Adam Khoja , Dan Hendrycks

Large Language Models (LLMs) are widely used in Automated Essay Scoring (AES) due to their ability to capture semantic meaning. Traditional fine-tuning approaches required technical expertise, limiting accessibility for educators with…

Computation and Language · Computer Science 2025-05-01 Kaixun Yang , Mladen Raković , Dragan Gašević , Guanliang Chen

Recent advances in Large Language Models (LLMs) highlight the need to align their behaviors with human values. A critical, yet understudied, issue is the potential divergence between an LLM's stated preferences (its reported alignment with…

Artificial Intelligence · Computer Science 2025-06-03 Zhuojun Gu , Quan Wang , Shuchu Han

As large language models (LLMs) increasingly mediate ethically sensitive decisions, understanding their moral reasoning processes becomes imperative. This study presents a comprehensive empirical evaluation of 14 leading LLMs, both…

Computation and Language · Computer Science 2025-08-12 Junchen Ding , Penghao Jiang , Zihao Xu , Ziqi Ding , Yichen Zhu , Jiaojiao Jiang , Yuekang Li

Large Language Models (LLMs) are rapidly being adopted by users across the globe, who interact with them in a diverse range of languages. At the same time, there are well-documented imbalances in the training data and optimisation…

Artificial Intelligence · Computer Science 2025-11-07 Bram Bulté , Ayla Rigouts Terryn

The widespread adoption of large language models (LLMs) underscores the urgent need to ensure their fairness. However, LLMs frequently present dominant viewpoints while ignoring alternative perspectives from minority parties, resulting in…

Computation and Language · Computer Science 2024-02-20 Tianlin Li , Xiaoyu Zhang , Chao Du , Tianyu Pang , Qian Liu , Qing Guo , Chao Shen , Yang Liu