English
Related papers

Related papers: Exploring the LLM Journey from Cognition to Expres…

200 papers

Pre-trained language models learn informative word representations on a large-scale text corpus through self-supervised learning, which has achieved promising performance in fields of natural language processing (NLP) after fine-tuning.…

Computation and Language · Computer Science 2023-10-31 Jian Yang , Xinyu Hu , Gang Xiao , Yulong Shen

Training Large Language Models (LLMs) typically involves a two-stage pipeline at the output layer: hidden states are projected into vocabulary logits via a linear transformation (lm_head), followed by cross-entropy loss computation against…

Machine Learning · Computer Science 2025-11-25 Jianbing Dong , Jianbin Chang

Multimodal Large Language Models (MLLMs) have achieved remarkable success in open-vocabulary perceptual tasks, yet their ability to solve complex cognitive problems remains limited, especially when visual details are abstract and require…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Boyi Li , Yifan Shen , Yuanzhe Liu , Yifan Xu , Jiateng Liu , Xinzhuo Li , Zhengyuan Li , Jingyuan Zhu , Yunhan Zhong , Fangzhou Lan , Jianguo Cao , James M. Rehg , Heng Ji , Ismini Lourentzou , Xu Cao

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape.…

Computation and Language · Computer Science 2024-12-23 Zhisheng Tang , Mayank Kejriwal

The rise of generative large language models (LLMs) has opened new opportunities for automating knowledge representation through concept maps, a long-standing pedagogical tool valued for fostering meaningful learning and higher-order…

Computers and Society · Computer Science 2025-09-19 Xiaoming Zhai

Large Language Models (LLMs) demonstrate an impressive capacity to recall a vast range of factual knowledge. However, understanding their underlying reasoning and internal mechanisms in exploiting this knowledge remains a key research area.…

Computation and Language · Computer Science 2024-08-07 Marco Bronzini , Carlo Nicolini , Bruno Lepri , Jacopo Staiano , Andrea Passerini

Research has repeatedly demonstrated that intermediate hidden states extracted from large language models are able to predict measured brain response to natural language stimuli. Yet, very little is known about the representation properties…

Computation and Language · Computer Science 2026-03-16 Emily Cheng , Richard J. Antonello

Associative learning--forming links between co-occurring items--is fundamental to human cognition, reshaping internal representations in complex ways. Testing hypotheses on how representational changes occur in biological systems is…

Machine Learning · Computer Science 2025-10-27 Camila Kolling , Vy Ai Vo , Mariya Toneva

Modeling human cognitive states is essential for advanced artificial intelligence. Existing Large Language Models (LLMs) mainly address isolated tasks such as emotion analysis or stance detection, and fail to capture interactions among…

Computation and Language · Computer Science 2026-04-21 Lin Zhong , Siyu Zhu , Zizhen Yuan , Jinhao Cui , Xinyang Zhao , Lingzhi Wang , Hao Chen , Qing Liao

Building a theoretical understanding of the capabilities of large language models (LLMs) is vital for our ability to predict and explain the behavior of these systems. Here, we investigate the structure of LLM capabilities by extracting…

Computation and Language · Computer Science 2023-06-21 Ryan Burnell , Han Hao , Andrew R. A. Conway , Jose Hernandez Orallo

Rapid advancements in Large Language models (LLMs) has significantly enhanced their reasoning capabilities. Despite improved performance on benchmarks, LLMs exhibit notable gaps in their cognitive processes. Additionally, as reflections of…

Computation and Language · Computer Science 2024-12-06 Ammar Shaikh , Raj Abhijit Dandekar , Sreedath Panat , Rajat Dandekar

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

Computation and Language · Computer Science 2025-05-29 Avinash Patil , Aryan Jadon

Large Language Models (LLMs) have come closest among all models to date to mastering human language, yet opinions about their linguistic and cognitive capabilities remain split. Here, we evaluate LLMs using a distinction between formal…

Computation and Language · Computer Science 2024-04-14 Kyle Mahowald , Anna A. Ivanova , Idan A. Blank , Nancy Kanwisher , Joshua B. Tenenbaum , Evelina Fedorenko

Recent advances in Large Language Models (LLMs) have opened new perspectives for automation in optimization. While several studies have explored how LLMs can generate or solve optimization models, far less is understood about what these…

Artificial Intelligence · Computer Science 2025-12-16 Francesca Da Ros , Luca Di Gaspero , Kevin Roitero

Large language models (LLMs) have demonstrated remarkable performance on various medical benchmarks, but their capabilities across different cognitive levels remain underexplored. Inspired by Bloom's Taxonomy, we propose a…

Computation and Language · Computer Science 2025-06-11 Yuxuan Zhou , Xien Liu , Chenwei Yan , Chen Ning , Xiao Zhang , Boxun Li , Xiangling Fu , Shijin Wang , Guoping Hu , Yu Wang , Ji Wu

Large Language Models (LLMs) can be understood as Collective Knowledge (CK): a condensation of human cultural and technical output, whose apparent intelligence emerges in dialogue. This perspective article, drawing on extended interaction…

Human-Computer Interaction · Computer Science 2025-11-04 Eleni Vasilaki

While large language models (LLMs) leverage both knowledge and reasoning during inference, the capacity to distinguish between them plays a pivotal role in model analysis, interpretability, and development. Inspired by dual-system cognitive…

Artificial Intelligence · Computer Science 2025-07-25 Mutian Yang , Jiandong Gao , Ji Wu

Language serves as a vehicle for conveying thought, enabling communication among individuals. The ability to distinguish between diverse concepts, identify fairness and injustice, and comprehend a range of legal notions fundamentally relies…

Computation and Language · Computer Science 2023-11-23 Ha-Thanh Nguyen , Wachara Fungwacharakorn , Ken Satoh

Large Language Models (LLMs), despite being trained on text alone, surprisingly develop rich visual priors. These priors allow latent visual capabilities to be unlocked for vision tasks with a relatively small amount of multimodal data, and…

Machine Learning · Computer Science 2025-10-01 Junlin Han , Shengbang Tong , David Fan , Yufan Ren , Koustuv Sinha , Philip Torr , Filippos Kokkinos

Intelligent systems must maintain and manipulate task-relevant information online to adapt to dynamic environments and changing goals. This capacity, known as working memory, is fundamental to human reasoning and intelligence. Despite…

Machine Learning · Computer Science 2026-04-14 Hua-Dong Xiong , Li Ji-An , Jiaqi Huang , Robert C. Wilson , Kwonjoon Lee , Xue-Xin Wei