English
Related papers

Related papers: Implicit Bias-Like Patterns in Reasoning Models

200 papers

Large Language Models (LLMs) are known to exhibit social, demographic, and gender biases, often as a consequence of the data on which they are trained. In this work, we adopt a mechanistic interpretability approach to analyze how such…

Computation and Language · Computer Science 2025-06-09 Bhavik Chandna , Zubair Bashir , Procheta Sen

We investigate whether Large Language Models (LLMs) exhibit altruistic tendencies, and critically, whether their implicit associations and self-reports predict actual altruistic behavior. Using a multi-method approach inspired by human…

Machine Learning · Computer Science 2025-12-03 Sandro Andric

We investigate the effectiveness of large language models (LLMs), including reasoning-based and non-reasoning models, in performing zero-shot financial sentiment analysis. Using the Financial PhraseBank dataset annotated by domain experts,…

Computation and Language · Computer Science 2025-06-06 Dimitris Vamvourellis , Dhagash Mehta

This article introduces the concept of the algorithmic unconscious to designate the set of structural determinations that operate within large language models (LLMs) without being accessible either to the model's own reflexivity or to that…

Computers and Society · Computer Science 2026-02-24 Philippe Boisnard

Despite LLMs' explicit alignment against demographic stereotypes, they have been shown to exhibit biases under various social contexts. In this work, we find that LLMs exhibit concerning biases in how they associate solution veracity with…

Computation and Language · Computer Science 2025-05-27 Yue Zhou , Barbara Di Eugenio

The "LLM-as-a-Judge" paradigm, using Large Language Models (LLMs) as automated evaluators, is pivotal to LLM development, offering scalable feedback for complex tasks. However, the reliability of these judges is compromised by various…

Computation and Language · Computer Science 2026-05-22 Qingquan Li , Shaoyu Dou , Kailai Shao , Chao Chen , Haixiang Hu

Large language models (LLMs) are increasingly employed for decision-support across multiple domains. We investigate whether these models display a systematic preferential bias in favor of artificial intelligence (AI) itself. Across three…

Computation and Language · Computer Science 2026-01-21 Benaya Trabelsi , Jonathan Shaki , Sarit Kraus

This paper presents a systematic analysis of biases in open-source Large Language Models (LLMs), across gender, religion, and race. Our study evaluates bias in smaller-scale Llama and Gemma models using the SALT ($\textbf{S}$ocial…

Computation and Language · Computer Science 2025-02-19 Samee Arif , Zohaib Khan , Maaidah Kaleem , Suhaib Rashid , Agha Ali Raza , Awais Athar

Large Language Models (LLMs) are increasingly positioned as decision engines for hiring, healthcare, and economic judgment, yet real-world human judgment reflects a balance between rational deliberation and emotion-driven bias. If LLMs are…

Large language models (LLMs) are trained on vast, uncurated datasets that contain various forms of biases and language reinforcing harmful stereotypes that may be subsequently inherited by the models themselves. Therefore, it is essential…

Computation and Language · Computer Science 2024-10-01 Jacob-Junqi Tian , Omkar Dige , D. B. Emerson , Faiza Khan Khattak

Language is not only a tool for communication but also a medium for human cognition and reasoning. If, as linguistic relativity suggests, the structure of language shapes cognitive patterns, then large language models (LLMs) trained on…

Computation and Language · Computer Science 2025-06-23 Chenxi Wang , Yixuan Zhang , Lang Gao , Zixiang Xu , Zirui Song , Yanbo Wang , Xiuying Chen

Humans acquire language through implicit learning, absorbing complex patterns without explicit awareness. While LLMs demonstrate impressive linguistic capabilities, it remains unclear whether they exhibit human-like pattern recognition…

Computation and Language · Computer Science 2025-04-01 Xiaomeng Ma , Qihui Xu

Intrinsic self-correction was proposed to improve LLMs' responses via feedback prompts solely based on their inherent capability. However, recent works show that LLMs' intrinsic self-correction fails without oracle labels as feedback…

Computation and Language · Computer Science 2025-07-16 Qingjie Zhang , Di Wang , Haoting Qian , Yiming Li , Tianwei Zhang , Minlie Huang , Ke Xu , Hewu Li , Yan Liu , Han Qiu

Recent progress in reasoning-oriented Large Language Models (LLMs) has been driven by introducing Chain-of-Thought (CoT) traces, where models generate intermediate reasoning traces before producing an answer. These traces, as in DeepSeek…

Computation and Language · Computer Science 2025-08-26 Siddhant Bhambri , Upasana Biswas , Subbarao Kambhampati

Attribution theory explains how individuals interpret and attribute others' behavior in a social context by employing personal (dispositional) and impersonal (situational) causality. Large Language Models (LLMs), trained on human-generated…

Computation and Language · Computer Science 2026-03-31 Hossein Salemi , Jitin Krishnan , Hemant Purohit

Implicit sentiment analysis (ISA) presents significant challenges due to the absence of salient cue words. Previous methods have struggled with insufficient data and limited reasoning capabilities to infer underlying opinions. Integrating…

Computation and Language · Computer Science 2024-12-13 Wenna Lai , Haoran Xie , Guandong Xu , Qing Li

We investigate how LLMs encode sociodemographic attributes of human conversational partners inferred from indirect cues such as names and occupations. We show that LLMs develop linear representations of user demographics within activation…

Artificial Intelligence · Computer Science 2025-12-12 Paul Bouchaud , Pedro Ramaciotti

This survey explores recent advancements in reasoning large language models (LLMs) designed to mimic "slow thinking" - a reasoning process inspired by human cognition, as described in Kahneman's Thinking, Fast and Slow. These models, like…

Artificial Intelligence · Computer Science 2025-05-09 Qianjun Pan , Wenkai Ji , Yuyang Ding , Junsong Li , Shilian Chen , Junyi Wang , Jie Zhou , Qin Chen , Min Zhang , Yulan Wu , Liang He

Large Vision Language Models (LVLMs) have achieved remarkable progress in multimodal tasks, yet they also exhibit notable social biases. These biases often manifest as unintended associations between neutral concepts and sensitive human…

Artificial Intelligence · Computer Science 2025-05-28 Zhengyang Ji , Yifan Jia , Shang Gao , Yutao Yue

Large Language Models (LLMs) are increasingly used as scalable evaluators of model outputs, but their preference judgments exhibit systematic biases and can diverge from human evaluations. Prior work on LLM-as-a-judge has largely focused on…

Computation and Language · Computer Science 2026-03-05 James Wedgwood , Chhavi Yadav , Virginia Smith