English
Related papers

Related papers: Context Limitations Make Neural Language Models Mo…

200 papers

There is increasing interest in employing large language models (LLMs) as cognitive models. For such purposes, it is central to understand which properties of human cognition are well-modeled by LLMs, and which are not. In this work, we…

Understanding context is key to understanding human language, an ability which Large Language Models (LLMs) have been increasingly seen to demonstrate to an impressive extent. However, though the evaluation of LLMs encompasses various…

Computation and Language · Computer Science 2024-02-02 Yilun Zhu , Joel Ruben Antony Moniz , Shruti Bhargava , Jiarui Lu , Dhivya Piraviperumal , Site Li , Yuan Zhang , Hong Yu , Bo-Hsiang Tseng

Recent advancements in artificial intelligence have sparked interest in the parallels between large language models (LLMs) and human neural processing, particularly in language comprehension. While prior research has established…

Computation and Language · Computer Science 2024-12-10 Gavin Mischler , Yinghao Aaron Li , Stephan Bickel , Ashesh D. Mehta , Nima Mesgarani

People acquire concepts through rich physical and social experiences and use them to understand and navigate the world. In contrast, large language models (LLMs), trained solely through next-token prediction on text, exhibit strikingly…

Computation and Language · Computer Science 2025-11-11 Ningyu Xu , Qi Zhang , Chao Du , Qiang Luo , Xipeng Qiu , Xuanjing Huang , Menghan Zhang

We consider the possible role of current large language models (LLMs) in the study of human linguistic cognition. We focus on the use of such models as proxies for theories of cognition that are relatively linguistically-neutral in their…

Computation and Language · Computer Science 2026-01-27 Imry Ziv , Nur Lan , Emmanuel Chemla , Roni Katzir

Large Language Models (LLMs) have revolutionised the capability of AI models in comprehending and generating natural language text. They are increasingly being used to empower and deploy agents in real-world scenarios, which make decisions…

Artificial Intelligence · Computer Science 2024-08-21 Sagar Uprety , Amit Kumar Jaiswal , Haiming Liu , Dawei Song

It has been argued that humans rapidly adapt their lexical and syntactic expectations to match the statistics of the current linguistic context. We provide further support to this claim by showing that the addition of a simple adaptation…

Computation and Language · Computer Science 2018-10-29 Marten van Schijndel , Tal Linzen

The emergence of Large Language Models (LLMs), has opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. Current research suggests that LLM-based agents become increasingly…

Computation and Language · Computer Science 2024-12-18 Amir Taubenfeld , Yaniv Dover , Roi Reichart , Ariel Goldstein

When we read, we make predictions about upcoming words; these predictions influence our reading behavior. The success of large language models (LLMs), which, like humans, make predictions about upcoming words, has motivated their use as…

Computation and Language · Computer Science 2026-05-27 Byung-Doh Oh , Tal Linzen

Human cognition is constrained by processing limitations, leading to cognitive overload and inefficiencies in knowledge synthesis and decision-making. Large Language Models (LLMs) present an opportunity for cognitive augmentation, but their…

Human-Computer Interaction · Computer Science 2025-04-21 Xiangrong , Zhu , Yuan Xu , Tianjian Liu , Jingwei Sun , Yu Zhang , Xin Tong

Language models (LMs) have been argued to overlap substantially with human beings in grammaticality judgment tasks. But when humans systematically make errors in language processing, should we expect LMs to behave like cognitive models of…

Computation and Language · Computer Science 2024-02-06 Yuhan Zhang , Edward Gibson , Forrest Davis

Large language models (LLMs) are increasingly explored as substitutes for human participants in cognitive tasks, but their ability to simulate human behavioral variability remains unclear. This study examines whether LLMs can approximate…

Computation and Language · Computer Science 2026-02-27 Mengyang Qiu , Zoe Brisebois , Siena Sun

Analogical reasoning -- the capacity to identify and map structural relationships between different domains -- is fundamental to human cognition and learning. Recent studies have shown that large language models (LLMs) can sometimes match…

Computation and Language · Computer Science 2025-11-21 Sam Musker , Alex Duchnowski , Raphaël Millière , Ellie Pavlick

What factors contribute to the relative success and corresponding difficulties of in-context learning for Large Language Models (LLMs)? Drawing on insights from the literature on human concept learning, we test LLMs on carefully designed…

Computation and Language · Computer Science 2024-12-05 Leroy Z. Wang , R. Thomas McCoy , Shane Steinert-Threlkeld

What role can the otherwise successful Large Language Models (LLMs) play in the understanding of human cognition, and in particular in terms of informing language acquisition debates? To contribute to this question, we first argue that…

Computation and Language · Computer Science 2024-08-22 Emmanuel Chemla , Ryan M. Nefdt

Neural network models of language have long been used as a tool for developing hypotheses about conceptual representation in the mind and brain. For many years, such use involved extracting vector-space representations of words and using…

Artificial Intelligence · Computer Science 2023-11-13 Siddharth Suresh , Kushin Mukherjee , Xizheng Yu , Wei-Chun Huang , Lisa Padua , Timothy T Rogers

Modern neural language models (LMs) are powerful tools for modeling human sentence production and comprehension, and their internal representations are remarkably well-aligned with representations of language in the human brain. But to…

Computation and Language · Computer Science 2024-03-27 Chengxu Zhuang , Evelina Fedorenko , Jacob Andreas

Large language models (LLMs) that fluently converse with humans are a reality - but do LLMs experience human-like processing difficulties? We systematically compare human and LLM sentence comprehension across seven challenging linguistic…

Computation and Language · Computer Science 2025-10-17 Samuel Joseph Amouyal , Aya Meltzer-Asscher , Jonathan Berant

The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning…

Computation and Language · Computer Science 2024-04-16 Spencer M. Seals , Valerie L. Shalin

Language models (LMs) are pretrained to imitate internet text, including content that would violate human preferences if generated by an LM: falsehoods, offensive comments, personally identifiable information, low-quality or buggy code, and…

Computation and Language · Computer Science 2023-06-16 Tomasz Korbak , Kejian Shi , Angelica Chen , Rasika Bhalerao , Christopher L. Buckley , Jason Phang , Samuel R. Bowman , Ethan Perez