English
Related papers

Related papers: Mechanistic Indicators of Understanding in Large L…

200 papers

Large Language Models (LLMs) are recruited in applications that span from clinical assistance and legal support to question answering and education. Their success in specialized tasks has led to the claim that they possess human-like…

Computation and Language · Computer Science 2024-07-10 Vittoria Dentella , Fritz Guenther , Elliot Murphy , Gary Marcus , Evelina Leivada

Humans organize knowledge into compact conceptual categories that balance compression with semantic richness. Large Language Models (LLMs) exhibit impressive linguistic abilities, but whether they navigate this same compression-meaning…

Computation and Language · Computer Science 2025-12-03 Chen Shani , Liron Soffer , Dan Jurafsky , Yann LeCun , Ravid Shwartz-Ziv

Subjective language understanding refers to a broad set of natural language processing tasks where the goal is to interpret or generate content that conveys personal feelings, opinions, or figurative meanings rather than objective facts.…

Computation and Language · Computer Science 2025-08-12 Changhao Song , Yazhou Zhang , Hui Gao , Ben Yao , Peng Zhang

The rapid advancement of image generation technologies intensifies the demand for interpretable and robust detection methods. Although existing approaches often attain high accuracy, they typically operate as black boxes without providing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yikun Ji , Hong Yan , Jun Lan , Huijia Zhu , Weiqiang Wang , Qi Fan , Liqing Zhang , Jianfu Zhang

Large Language Models (LLMs) have experienced a rapid rise in AI, changing a wide range of applications with their advanced capabilities. As these models become increasingly integral to decision-making, the need for thorough…

Machine Learning · Computer Science 2024-01-09 Jatin Nainani

Can multi-modal large language models (MLLMs) truly understand what they can see? Extending Searle's Chinese Room into the multi-modal domain, this paper proposes the Visual Room argument: MLLMs may describe every visual detail precisely…

Computation and Language · Computer Science 2025-11-18 Haokun Li , Yazhou Zhang , Jizhi Ding , Qiuchi Li , Peng Zhang

Large Language Models (LLMs) have emerged as dominant foundational models in modern NLP. However, the understanding of their prediction processes and internal mechanisms, such as feed-forward networks (FFN) and multi-head self-attention…

Computation and Language · Computer Science 2024-04-16 Xintong Wang , Xiaoyu Li , Xingshan Li , Chris Biemann

The age of social media is rife with memes. Understanding and detecting harmful memes pose a significant challenge due to their implicit meaning that is not explicitly conveyed through the surface text and image. However, existing harmful…

Computation and Language · Computer Science 2023-12-12 Hongzhan Lin , Ziyang Luo , Jing Ma , Long Chen

Recent advancements in artificial intelligence have sparked interest in the parallels between large language models (LLMs) and human neural processing, particularly in language comprehension. While prior research has established…

Computation and Language · Computer Science 2024-12-10 Gavin Mischler , Yinghao Aaron Li , Stephan Bickel , Ashesh D. Mehta , Nima Mesgarani

We investigate whether Large Language Models (LLMs) exhibit human-like cognitive patterns under four established frameworks from psychology: Thematic Apperception Test (TAT), Framing Bias, Moral Foundations Theory (MFT), and Cognitive…

Artificial Intelligence · Computer Science 2025-12-12 Akash Kundu , Rishika Goswami

Recent work suggests that large language models (LLMs) can perform multi-hop reasoning implicitly -- producing correct answers without explicitly verbalizing intermediate steps -- but the underlying mechanisms remain poorly understood. In…

Machine Learning · Computer Science 2025-11-07 Jiaran Ye , Zijun Yao , Zhidian Huang , Liangming Pan , Jinxin Liu , Yushi Bai , Amy Xin , Weichuan Liu , Xiaoyin Che , Lei Hou , Juanzi Li

Large language models (LLMs) contain substantial factual knowledge which is commonly elicited by multiple-choice question-answering prompts. Internally, such models process the prompt through multiple transformer layers, building varying…

Computation and Language · Computer Science 2025-01-31 Didier Chételat , Joseph Cotnareanu , Rylee Thompson , Yingxue Zhang , Mark Coates

Developments in the field of Artificial Intelligence (AI), and particularly large language models (LLMs), have created a 'perfect storm' for observing 'sparks' of Artificial General Intelligence (AGI) that are spurious. Like simpler models,…

Artificial Intelligence · Computer Science 2024-06-03 Patrick Altmeyer , Andrew M. Demetriou , Antony Bartlett , Cynthia C. S. Liem

Large Language Models (LLMs) demonstrate an impressive capacity to recall a vast range of factual knowledge. However, understanding their underlying reasoning and internal mechanisms in exploiting this knowledge remains a key research area.…

Computation and Language · Computer Science 2024-08-07 Marco Bronzini , Carlo Nicolini , Bruno Lepri , Jacopo Staiano , Andrea Passerini

Understanding knowledge mechanisms in Large Language Models (LLMs) is crucial for advancing towards trustworthy AGI. This paper reviews knowledge mechanism analysis from a novel taxonomy including knowledge utilization and evolution.…

Computation and Language · Computer Science 2024-12-05 Mengru Wang , Yunzhi Yao , Ziwen Xu , Shuofei Qiao , Shumin Deng , Peng Wang , Xiang Chen , Jia-Chen Gu , Yong Jiang , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

Large language models (LLMs) show promising capabilities in predicting human emotions from text. However, the mechanisms through which these models process emotional stimuli remain largely unexplored. Our study addresses this gap by…

Computation and Language · Computer Science 2025-07-01 Ala N. Tak , Amin Banayeeanzade , Anahita Bolourani , Mina Kian , Robin Jia , Jonathan Gratch

While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and…

Computation and Language · Computer Science 2025-10-14 Jialu Du , Guiyang Hou , Yihui Fu , Chen Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu

Human social interactions depend on the ability to infer others' unspoken intentions, emotions, and beliefs-a cognitive skill grounded in the psychological concept of Theory of Mind (ToM). While large language models (LLMs) excel in…

Computation and Language · Computer Science 2025-10-15 Xuanming Zhang , Yuxuan Chen , Samuel Yeh , Sharon Li

Theory based AI research has had a hard time recently and the aim here is to propose a model of what LLMs are actually doing when they impress us with their language skills. The model integrates three established theories of human…

Computation and Language · Computer Science 2025-08-01 Peter Wallis

Large Language Models (LLMs) have significantly advanced the field of Natural Language Processing (NLP), but their lack of interpretability has been a major concern. Current methods for interpreting LLMs are post hoc, applied after…

Computation and Language · Computer Science 2023-11-14 Sean Xie , Soroush Vosoughi , Saeed Hassanpour