English
Related papers

Related papers: How Susceptible are Large Language Models to Ideol…

200 papers

We are exposed to much information trying to influence us, such as teaser messages, debates, politically framed news, and propaganda - all of which use persuasive language. With the recent interest in Large Language Models (LLMs), we study…

Computation and Language · Computer Science 2025-02-24 Amalie Brogaard Pauli , Isabelle Augenstein , Ira Assent

Large Language Models (LLMs) trained with self-supervision on vast corpora of web text fit to the social biases of that text. Without intervention, these social biases persist in the model's predictions in downstream tasks, leading to…

Computation and Language · Computer Science 2023-12-13 Gustavo Gonçalves , Emma Strubell

The advent of Large Language Models (LLMs) has revolutionized product recommenders, yet their susceptibility to adversarial manipulation poses critical challenges, particularly in real-world commercial applications. Our approach is the…

Computation and Language · Computer Science 2025-10-23 Giorgos Filandrianos , Angeliki Dimitriou , Maria Lymperaiou , Konstantinos Thomas , Giorgos Stamou

Large language models (LLMs) have significantly advanced dialogue systems and role-playing agents through their ability to generate human-like text. While prior studies have shown that LLMs can exhibit distinct and consistent personalities,…

Computation and Language · Computer Science 2025-02-18 Shu Yang , Shenzhe Zhu , Liang Liu , Lijie Hu , Mengdi Li , Di Wang

The guiding principle of AI alignment is to train large language models (LLMs) to be harmless, helpful, and honest (HHH). At the same time, there are mounting concerns that LLMs exhibit a left-wing political bias. Yet, the commitment to AI…

Computation and Language · Computer Science 2025-07-22 Thilo Hagendorff

How might messages about large language models (LLMs) found in public discourse influence the way people think about and interact with these models? To explore this question, we randomly assigned participants (N = 470) to watch short…

Human-Computer Interaction · Computer Science 2026-03-05 Allison Chen , Sunnie S. Y. Kim , Angel Franyutti , Amaya Dharmasiri , Kushin Mukherjee , Olga Russakovsky , Judith E. Fan

Cognitive diversity, reflected in variations of language, perspective, and reasoning, is essential to creativity and collective intelligence. This diversity is rich and grounded in culture, history, and individual experience. Yet as large…

Computation and Language · Computer Science 2026-01-07 Zhivar Sourati , Alireza S. Ziabari , Morteza Dehghani

Recent literature has suggested the potential of using large language models (LLMs) to make classifications for tabular tasks. However, LLMs have been shown to exhibit harmful social biases that reflect the stereotypes and inequalities…

Computation and Language · Computer Science 2024-04-04 Yanchen Liu , Srishti Gautam , Jiaqi Ma , Himabindu Lakkaraju

Large Language Models (LLMs) have shown capabilities close to human performance in various analytical tasks, leading researchers to use them for time and labor-intensive analyses. However, their capability to handle highly specialized and…

Computation and Language · Computer Science 2024-10-08 Alexander S. Choi , Syeda Sabrina Akter , JP Singh , Antonios Anastasopoulos

As Large Language Models (LLMs) become widely used to model and simulate human behavior, understanding their biases becomes critical. We developed an experimental framework using Big Five personality surveys and uncovered a previously…

Artificial Intelligence · Computer Science 2024-11-25 Aadesh Salecha , Molly E. Ireland , Shashanka Subrahmanya , João Sedoc , Lyle H. Ungar , Johannes C. Eichstaedt

Do large language models (LLMs) exhibit systematic ideological bias when reasoning about economic causal effects? As LLMs are increasingly used in policy analysis and economic reporting, where directionally correct causal judgments are…

Artificial Intelligence · Computer Science 2026-04-24 Donggyu Lee , Hyeok Yun , Jungwon Kim , Junsik Min , Sungwon Park , Sangyoon Park , Jihee Kim

The opacity in developing large language models (LLMs) is raising growing concerns about the potential contamination of public benchmarks in the pre-training data. Existing contamination detection methods are typically based on the text…

Computation and Language · Computer Science 2024-10-31 Feng Yao , Yufan Zhuang , Zihao Sun , Sunan Xu , Animesh Kumar , Jingbo Shang

There have been rapid advancements in the capabilities of large language models (LLMs) in recent years, greatly revolutionizing the field of natural language processing (NLP) and artificial intelligence (AI) to understand and interact with…

Computation and Language · Computer Science 2024-09-26 Zeyneb N. Kaya , Souvick Ghosh

Large language models (LLMs) are supposed to acquire unconscious human knowledge and feelings, such as social common sense and biases, by training models from large amounts of text. However, it is not clear how much the sentiments of…

Computation and Language · Computer Science 2024-08-09 Kunitomo Tanaka , Ryohei Sasano , Koichi Takeda

Grammatical features across human languages show intriguing correlations often attributed to learning biases in humans. However, empirical evidence has been limited to experiments with highly simplified artificial languages, and whether…

Computation and Language · Computer Science 2025-02-19 Tianyang Xu , Tatsuki Kuribayashi , Yohei Oseki , Ryan Cotterell , Alex Warstadt

Large Language Models (LLMs) are being enhanced with the ability to use tools and to process multiple modalities. These new capabilities bring new benefits and also new security risks. In this work, we show that an attacker can use visual…

Cryptography and Security · Computer Science 2023-10-06 Xiaohan Fu , Zihan Wang , Shuheng Li , Rajesh K. Gupta , Niloofar Mireshghallah , Taylor Berg-Kirkpatrick , Earlence Fernandes

Large language models (LLMs) are increasingly being used in user-facing applications, from providing medical consultations to job interview advice. Recent research suggests that these models are becoming increasingly proficient at inferring…

Computation and Language · Computer Science 2025-07-22 Matthew Kearney , Reuben Binns , Yarin Gal

The advent of Large Language Models (LLMs) has marked significant achievements in language processing and reasoning capabilities. Despite their advancements, LLMs face vulnerabilities to data poisoning attacks, where the adversary inserts…

Machine Learning · Computer Science 2025-05-30 Xiangyu Zhou , Yao Qiang , Saleh Zare Zade , Mohammad Amin Roshani , Prashant Khanduri , Douglas Zytko , Dongxiao Zhu

Large language models (LLMs) are increasingly being utilised across a range of tasks and domains, with a burgeoning interest in their application within the field of journalism. This trend raises concerns due to our limited understanding of…

Computation and Language · Computer Science 2024-06-18 Filip Trhlik , Pontus Stenetorp

Large language models (LLMs) are able to engage in natural-sounding conversations with humans, showcasing unprecedented capabilities for information retrieval and automated decision support. They have disrupted human-technology interaction…

Computation and Language · Computer Science 2025-02-18 Wolfgang Messner , Tatum Greene , Josephine Matalone