English
Related papers

Related papers: CogLM: Tracking Cognitive Development of Large Lan…

200 papers

Cognitive psychology investigates perception, attention, memory, language, problem-solving, decision-making, and reasoning. Kahneman's dual-system theory elucidates the human decision-making process, distinguishing between the rapid,…

Computation and Language · Computer Science 2024-09-09 Yongxin Deng , Xihe Qiu , Xiaoyu Tan , Chao Qu , Jing Pan , Yuan Cheng , Yinghui Xu , Wei Chu

While Multi-modal Large Language Models (MLLMs) demonstrate impressive abilities over high-level perception and reasoning, their robustness in the wild remains limited, often falling short on tasks that are intuitive and effortless for…

Computation and Language · Computer Science 2025-06-23 Yijiang Li , Qingying Gao , Tianwei Zhao , Bingyang Wang , Haoran Sun , Haiyun Lyu , Robert D. Hawkins , Nuno Vasconcelos , Tal Golan , Dezhi Luo , Hokin Deng

Large language models (LLMs) have demonstrated their remarkable performance across various language understanding tasks. While emerging benchmarks have been proposed to evaluate LLMs in various domains such as mathematics and computer…

Artificial Intelligence · Computer Science 2024-10-28 Junnan Dong , Zijin Hong , Yuanchen Bei , Feiran Huang , Xinrun Wang , Xiao Huang

As mental health issues continue to rise globally, there is an increasing demand for accessible and scalable therapeutic solutions. Many individuals currently seek support from Large Language Models (LLMs), even though these models have not…

Computation and Language · Computer Science 2026-03-05 Navdeep Singh Bedi , Ana-Maria Bucur , Noriko Kando , Fabio Crestani

Analogical reasoning -- the capacity to identify and map structural relationships between different domains -- is fundamental to human cognition and learning. Recent studies have shown that large language models (LLMs) can sometimes match…

Computation and Language · Computer Science 2025-11-21 Sam Musker , Alex Duchnowski , Raphaël Millière , Ellie Pavlick

Large language models (LLMs) are increasingly embedded in AI-based tutoring systems. Can they faithfully model novice reasoning and metacognitive judgments? Existing evaluations emphasize problem-solving accuracy, overlooking the fragmented…

Computation and Language · Computer Science 2026-05-12 Conrad Borchers , Jill-Jênn Vie , Roger Azevedo

Students' handwritten math work provides a rich resource for diagnosing cognitive skills, as it captures intermediate reasoning beyond final answers. We investigate how current large language models (LLMs) perform in diagnosing cognitive…

Artificial Intelligence · Computer Science 2026-02-05 Yoonsu Kim , Hyoungwook Jin , Hayeon Doh , Eunhye Kim , Dongyun Jung , Seungju Kim , Kiyoon Choi , Jinho Son , Juho Kim

Large Language Models (LLMs) have demonstrated remarkable abilities in text comprehension and logical reasoning, indicating that the text representations learned by LLMs can facilitate their language processing capabilities. In…

Artificial Intelligence · Computer Science 2025-01-16 Yuqi Ren , Renren Jin , Tongxuan Zhang , Deyi Xiong

Research on the cognitive plausibility of language models (LMs) has so far mostly concentrated on modelling psycholinguistic response variables such as reading times, gaze durations and N400/P600 EEG signals, while mostly leaving out the…

Computation and Language · Computer Science 2023-11-09 Julius Steuer , Marius Mosbach , Dietrich Klakow

Computational cognitive models, which formalize theories of cognition, enable researchers to quantify cognitive processes and arbitrate between competing theories by fitting models to behavioral data. Traditionally, these models are…

Machine Learning · Computer Science 2025-11-10 Milena Rmus , Akshay K. Jagadish , Marvin Mathony , Tobias Ludwig , Eric Schulz

Large Language Models (LLMs) have demonstrated exceptional natural language understanding abilities and have excelled in a variety of natural language processing (NLP)tasks in recent years. Despite the fact that most LLMs are trained…

Computation and Language · Computer Science 2023-10-25 Xiang Zhang , Senyu Li , Bradley Hauer , Ning Shi , Grzegorz Kondrak

This paper investigates the utilization of Large Language Models (LLMs) for solving complex linguistic puzzles, a domain requiring advanced reasoning and adept translation capabilities akin to human cognitive processes. We explore specific…

Computation and Language · Computer Science 2025-02-04 Zheng-Lin Lin , Yu-Fei Shih , Shu-Kai Hsieh

Large language models (LLMs) increasingly reach real-world applications, necessitating a better understanding of their behaviour. Their size and complexity complicate traditional assessment methods, causing the emergence of alternative…

Artificial Intelligence · Computer Science 2025-05-13 Sanne Peereboom , Inga Schwabe , Bennett Kleinberg

Large language models (LLMs) perform substantially below human level on existing theory-of-mind (ToM) benchmarks, even when augmented with chain-of-thought prompting or probabilistic belief updates. We argue that these failures primarily…

Computation and Language · Computer Science 2026-04-21 Wang Bill Zhu , Qiutong Tony Yi , Robin Jia , Jesse Thomason

Reasoning has long been viewed as an emergent property of large language models (LLMs). However, recent studies challenge this assumption, showing that small language models (SLMs) can also achieve competitive reasoning performance. This…

Computation and Language · Computer Science 2025-10-01 Gaurav Srivastava , Shuxiang Cao , Xuan Wang

Metacognition--the capacity to monitor and evaluate one's own knowledge and performance--is foundational to human decision-making, learning, and communication. As large language models (LLMs) become increasingly embedded in both high-stakes…

Artificial Intelligence · Computer Science 2025-10-14 Mark Steyvers , Megan A. K. Peters

Users of Large Language Models (LLMs) often perceive these models as intelligent entities with human-like capabilities. However, the extent to which LLMs' capabilities truly approximate human abilities remains a topic of debate. In this…

Computation and Language · Computer Science 2025-04-18 Mingrui Zan , Yunquan Zhang , Boyang Zhang , Fangming Liu , Daning Cheng

Neural network models of language have long been used as a tool for developing hypotheses about conceptual representation in the mind and brain. For many years, such use involved extracting vector-space representations of words and using…

Artificial Intelligence · Computer Science 2023-11-13 Siddharth Suresh , Kushin Mukherjee , Xizheng Yu , Wei-Chun Huang , Lisa Padua , Timothy T Rogers

Large Vision-Language Models (LVLMs), despite their recent success, are hardly comprehensively tested for their cognitive abilities. Inspired by the prevalent use of the Cookie Theft task in human cognitive tests, we propose a novel…

Artificial Intelligence · Computer Science 2025-02-14 Xiujie Song , Mengyue Wu , Kenny Q. Zhu , Chunhao Zhang , Yanyi Chen

Large language models (LLMs) have demonstrated human-like abilities in language-based tasks. While language is a defining feature of human intelligence, it emerges from more fundamental neurophysical processes rather than constituting the…

Neurons and Cognition · Quantitative Biology 2025-09-12 Doai Ngo , Mingxuan Sun , Zhengji Zhang , Ashwin G Ramayya , Mark Schnitzer , Zhe Zhao