English
Related papers

Related papers: Elements of World Knowledge (EWoK): A Cognition-In…

200 papers

Large Language Models are increasingly deployed as educational tools, yet existing benchmarks focus on narrow skills and lack grounding in learning sciences. We introduce OpenLearnLM Benchmark, a theory-grounded framework evaluating LLMs…

World models have garnered substantial interest in the AI community. These are internal representations that simulate aspects of the external world, track entities and states, capture causal relationships, and enable prediction of…

Artificial Intelligence · Computer Science 2025-11-18 Tarun Gupta , Danish Pruthi

Large language models (LLMs) solve complex problems yet fail on simpler variants, suggesting they achieve correct outputs through mechanisms fundamentally different from human reasoning. To understand this gap, we synthesize cognitive…

Knowledge utilization is a critical aspect of LLMs, and understanding how they adapt to evolving knowledge is essential for their effective deployment. However, existing benchmarks are predominantly static, failing to capture the evolving…

Computation and Language · Computer Science 2024-12-19 Wei Tang , Yixin Cao , Yang Deng , Jiahao Ying , Bo Wang , Yizhe Yang , Yuyue Zhao , Qi Zhang , Xuanjing Huang , Yugang Jiang , Yong Liao

Recent advances in creative AI have enabled the synthesis of high-fidelity images and videos conditioned on language instructions. Building on these developments, text-to-video diffusion models have evolved into embodied world models (EWMs)…

Robotics · Computer Science 2025-05-20 Hu Yue , Siyuan Huang , Yue Liao , Shengcong Chen , Pengfei Zhou , Liliang Chen , Maoqing Yao , Guanghui Ren

Internal world models (WMs) enable agents to understand the world's state and predict transitions, serving as the basis for advanced deliberative reasoning. Recent large Vision-Language Models (VLMs), such as OpenAI o3, GPT-4o and Gemini,…

Despite significant progress in multimodal language models (LMs), it remains unclear whether visual grounding enhances their understanding of embodied knowledge compared to text-only models. To address this question, we propose a novel…

Computation and Language · Computer Science 2025-10-21 Zhihui Yang , Yupei Wang , Kaijie Mo , Zhe Zhao , Renfen Hu

Humankind's understanding of the world is fundamentally linked to our perception and cognition, with \emph{human languages} serving as one of the major carriers of \emph{world knowledge}. In this vein, \emph{Large Language Models} (LLMs)…

Artificial Intelligence · Computer Science 2024-06-27 Huajun Chen

This comprehensive report distinguishes prior works by the cognitive functions they innovate. Many works claim an almost "human-like" cognitive capability in their world models. To evaluate these claims requires a proper grounding in first…

As Large Language Models (LLMs) rise in popularity, it is necessary to assess their capability in critically relevant domains. We present a comprehensive evaluation framework, grounded in science communication research, to assess LLM…

In this work, we introduce Erasure of Language Memory (ELM), a principled approach to concept-level unlearning that operates by matching distributions defined by the model's own introspective classification capabilities. Our key insight is…

Computation and Language · Computer Science 2025-07-23 Rohit Gandikota , Sheridan Feucht , Samuel Marks , David Bau

Current Large Language Models (LLMs) exhibit a critical modal disconnect: they possess vast semantic knowledge but lack the procedural grounding to respect the immutable laws of the physical world. Consequently, while these agents…

Computation and Language · Computer Science 2026-01-21 Baochang Ren , Yunzhi Yao , Rui Sun , Shuofei Qiao , Ningyu Zhang , Huajun Chen

World models are central to building AI agents capable of flexible reasoning and planning. Yet current evaluations (i) test only properties measurable from observed interactions, such as next-frame prediction or task return, and (ii) do not…

Large language models show human-like performance in knowledge extraction, reasoning and dialogue, but it remains controversial whether this performance is best explained by memorization and pattern matching, or whether it reflects…

Machine Learning · Computer Science 2023-08-30 Mathias Lykke Gammelgaard , Jonathan Gabel Christiansen , Anders Søgaard

The role of world knowledge has been particularly crucial to predict the discourse connective that marks the discourse relation between two arguments, with language models (LMs) being generally successful at this task. We flip this premise…

Computation and Language · Computer Science 2026-02-03 Daniel Brubaker , William Sheffield , Junyi Jessy Li , Kanishka Misra

Large language models (LLMs) frequently encode factual and reasoning knowledge in their internal representations that is not faithfully reflected in their surface-level outputs -- a phenomenon known as \emph{latent knowledge}. Existing…

Computation and Language · Computer Science 2026-05-29 Ji-jun Park , Soo-joon Choi , Jiwon Jeong , Taeyang Yoon , Ju-Wan Lee

The capability of Unified Multimodal Models (UMMs) to apply world knowledge across diverse tasks remains a critical, unresolved challenge. Existing benchmarks fall short, offering only siloed, single-task evaluations with limited diagnostic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Jintao Lin , Bowen Dong , Weikang Shi , Chenyang Lei , Suiyun Zhang , Rui Liu , Xihui Liu

Automated kernel design is critical for overcoming software ecosystem barriers in emerging hardware platforms like RISC-V. While large language models (LLMs) have shown promise for automated kernel optimization, demonstrating success in…

Software Engineering · Computer Science 2025-09-19 Siyuan Chen , Zhichao Lu , Qingfu Zhang

Text-to-video (T2V) models have shown remarkable performance in generating visually reasonable scenes, while their capability to leverage world knowledge for ensuring semantic consistency and factual accuracy remains largely understudied.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Yubin Chen , Xuyang Guo , Zhenmei Shi , Zhao Song , Jiahao Zhang

Language agents increasingly require persistent worlds in which they can act, remember, and learn. Existing approaches sit at two extremes: conventional web frameworks provide reliable but fixed contexts backed by databases, while fully…

Artificial Intelligence · Computer Science 2025-12-30 Jichen Feng , Yifan Zhang , Chenggong Zhang , Yifu Lu , Shilong Liu , Mengdi Wang