English
Related papers

Related papers: HaM-World: Soft-Hamiltonian World Models with Sele…

200 papers

Safe L2/L3 driving automation requires anticipating human-in-the-loop reactions during shared-control transitions. While most driving world models forecast the external environment, in-cabin intelligence remains strictly…

Robotics · Computer Science 2026-05-07 Haozhuang Chi , Daosheng Qiu , Hao Su , Haochen Liu , Zirui Li , Haoruo Zhang , Chen Lv

Autonomous agents operating in dynamic and safety-critical environments require decision-making frameworks that are both computationally efficient and physically grounded. However, many existing approaches rely on end-to-end learning, which…

Machine Learning · Computer Science 2026-05-01 Zhaowen Fan , Rongchao Zhang

Large language models (LLMs) have advanced significantly due to the attention mechanism, but their quadratic complexity and linear memory demands limit their performance on long-context tasks. Recently, researchers introduced Mamba, an…

Computation and Language · Computer Science 2024-10-22 Wangjie You , Zecheng Tang , Juntao Li , Lili Yao , Min Zhang

The field of world modeling is fragmented, with researchers developing bespoke architectures that rarely build upon each other. We propose a framework that specifies the natural building blocks for structured world models based on the…

Machine Learning · Computer Science 2025-11-05 Lancelot Da Costa , Sanjeev Namjoshi , Mohammed Abbas Ansari , Bernhard Schölkopf

Despite the popularity of reinforcement learning (RL) in wireless networks, existing approaches that rely on model-free RL (MFRL) and model-based RL (MBRL) are data inefficient and short-sighted. Such RL-based solutions cannot generalize to…

Information Theory · Computer Science 2025-10-29 Lingyi Wang , Rashed Shelim , Walid Saad , Naren Ramakrishnan

Large Vision-Language Models (LVLMs) show promise for embodied planning tasks but struggle with complex scenarios involving unfamiliar environments and multi-step goals. Current approaches rely on environment-agnostic imitation learning…

Artificial Intelligence · Computer Science 2025-07-03 Junhao Shi , Zhaoye Fei , Siyin Wang , Qipeng Guo , Jingjing Gong , Xipeng Qiu

Motion planning for autonomous driving must handle multiple plausible futures while remaining computationally efficient. Recent end-to-end systems and world-model-based planners predict rich multi-modal trajectories, but typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Bin Hu , Zijian Lu , Haicheng Liao , Chengran Yuan , Bin Rao , Yongkang Li , Guofa Li , Zhiyong Cui , Cheng-zhong Xu , Zhenning Li

Modeling complex phenomena typically involves the use of both discrete and continuous variables. Such a setting applies across a wide range of problems, from identifying trends in time-series data to performing effective compositional scene…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Tuan Anh Le , Katherine M. Collins , Luke Hewitt , Kevin Ellis , N. Siddharth , Samuel J. Gershman , Joshua B. Tenenbaum

World Action Models (WAMs) have emerged as a promising paradigm for robot control by modeling physical dynamics. Current WAMs generally follow two paradigms: the "Imagine-then-Execute" approach, which uses video prediction to infer actions…

With the explosive growth of data, long-sequence modeling has become increasingly important in tasks such as natural language processing and bioinformatics. However, existing methods face inherent trade-offs between efficiency and memory.…

Machine Learning · Computer Science 2025-10-07 Youjin Wang , Yangjingyi Chen , Jiahao Yan , Jiaxuan Lu , Xiao Sun

Reinforcement Learning (RL) has made significant strides in complex tasks but struggles in multi-task settings with different embodiments. World model methods offer scalability by learning a simulation of the environment but often rely on…

Machine Learning · Computer Science 2025-02-25 Ignat Georgiev , Varun Giridhar , Nicklas Hansen , Animesh Garg

Humans leverage rich internal models of the world to reason about the future, imagine counterfactuals, and adapt flexibly to new situations. In Reinforcement Learning (RL), world models aim to capture how the environment evolves in response…

Artificial Intelligence · Computer Science 2025-10-29 Léopold Maytié , Roland Bertin Johannet , Rufin VanRullen

Deploying learned control policies in real-world environments poses a fundamental challenge. When system dynamics change unexpectedly, performance degrades until models are retrained on new data. We introduce Reflexive World Models (RWM), a…

Machine Learning · Computer Science 2025-05-22 Carlos Stein Brito , Daniel McNamee

Large Language Models (LLMs) can serve as world models to enhance agent decision-making in digital environments by simulating future states and predicting action outcomes, potentially eliminating costly trial-and-error exploration. However,…

Computation and Language · Computer Science 2026-03-10 Kai Mei , Jiang Guo , Shuaichen Chang , Mingwen Dong , Dongkyu Lee , Xing Niu , Jiarong Jiang

World models aim to predict plausible futures consistent with past observations, a capability central to planning and decision-making in reinforcement learning. Yet, existing architectures face a fundamental memory trade-off: transformers…

Machine Learning · Computer Science 2026-05-20 Sebastian Stapf , Pablo Acuaviva Huertos , Aram Davtyan , Paolo Favaro

Planning - the ability to analyze the structure of a problem in the large and decompose it into interrelated subproblems - is a hallmark of human intelligence. While deep reinforcement learning (RL) has shown great promise for solving…

Artificial Intelligence · Computer Science 2021-07-02 Lunjun Zhang , Ge Yang , Bradly C. Stadie

Efficient exploration remains a central challenge in reinforcement learning (RL), particularly in sparse-reward environments. We introduce Optimistic World Models (OWMs), a principled and scalable framework for optimistic exploration that…

Machine Learning · Computer Science 2026-02-11 Akshay Mete , Shahid Aamir Sheikh , Tzu-Hsiang Lin , Dileep Kalathil , P. R. Kumar

We propose a novel framework based on neural network that reformulates classical mechanics as an operator learning problem. A machine directly maps a potential function to its corresponding trajectory in phase space without solving the…

Machine Learning · Computer Science 2024-11-11 Tae-Geun Kim , Seong Chan Park

In this work, we introduce the Time-Aware World Model (TAWM), a model-based approach that explicitly incorporates temporal dynamics. By conditioning on the time-step size, {\Delta}t, and training over a diverse range of {\Delta}t values --…

Machine Learning · Computer Science 2025-06-11 Anh N. Nhu , Sanghyun Son , Ming Lin

World models are essential for autonomous robotic planning. However, the substantial computational overhead of existing dense Transformerbased models significantly hinders real-time deployment. To address this efficiency-performance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Shicheng Yin , Kaixuan Yin , Weixing Chen , Yang Liu , Guanbin Li , Liang Lin