English
Related papers

Related papers: AdaPower: Specializing World Foundation Models for…

200 papers

Multivariate time series forecasting involves predicting future values based on historical observations. However, existing approaches primarily rely on predefined single-scale patches or lack effective mechanisms for multi-scale feature…

Machine Learning · Computer Science 2025-09-24 Huanyao Zhang , Jiaye Lin , Wentao Zhang , Haitao Yuan , Guoliang Li

Vision-Language-Action (VLA) models demonstrate remarkable potential for generalizable robotic manipulation. The execution of complex multi-step behaviors in VLA models can be improved by robust instruction grounding, a critical component…

Imitation learning is a powerful paradigm for training robotic policies, yet its performance is limited by compounding errors: minor policy inaccuracies could drive robots into unseen out-of-distribution (OOD) states in the training set,…

Robotics · Computer Science 2026-04-14 Anlan Yu , Zaishu Chen , Peili Song , Zhiqing Hong , Haotian Wang , Desheng Zhang , Tian He , Yi Ding , Daqing Zhang

Imitation learning has emerged as a promising approach towards building generalist robots. However, scaling imitation learning for large robot foundation models remains challenging due to its reliance on high-quality expert demonstrations.…

Robotics · Computer Science 2025-05-26 Chuning Zhu , Raymond Yu , Siyuan Feng , Benjamin Burchfiel , Paarth Shah , Abhishek Gupta

Language-aligned vision foundation models (VFMs) enable versatile visual understanding for always-on contextual AI, but their deployment on edge devices is hindered by strict latency and power constraints. We present AdaVFM, an adaptive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yiwei Zhao , Yi Zheng , Huapeng Su , Jieyu Lin , Stefano Ambrogio , Cijo Jose , Michael Ramamonjisoa , Patrick Labatut , Barbara De Salvo , Chiao Liu , Phillip B. Gibbons , Ziyun Li

World foundation models, which simulate the physical world by predicting future states from current observations and inputs, have become central to many applications in physical intelligence, including autonomous driving and robotics.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Wenyan Cong , Hanqing Zhu , Peihao Wang , Bangya Liu , Dejia Xu , Kevin Wang , David Z. Pan , Yan Wang , Zhiwen Fan , Zhangyang Wang

In this work, we introduce the Time-Aware World Model (TAWM), a model-based approach that explicitly incorporates temporal dynamics. By conditioning on the time-step size, {\Delta}t, and training over a diverse range of {\Delta}t values --…

Machine Learning · Computer Science 2025-06-11 Anh N. Nhu , Sanghyun Son , Ming Lin

Vision-Language-Action (VLA) models have gained popularity for learning robotic manipulation tasks that follow language instructions. State-of-the-art VLAs, such as OpenVLA and $\pi_{0}$, were trained on large-scale, manually labeled action…

Robotics · Computer Science 2025-09-24 Bahey Tharwat , Yara Nasser , Ali Abouzeid , Ian Reid

Robotic manipulation requires sophisticated commonsense reasoning, a capability naturally possessed by large-scale Vision-Language Models (VLMs). While VLMs show promise as zero-shot planners, their lack of grounded physical understanding…

Robotics · Computer Science 2026-03-18 Emily Yue-Ting Jia , Weiduo Yuan , Tianheng Shi , Vitor Guizilini , Jiageng Mao , Yue Wang

Mobile manipulation is the fundamental challenge for robotics to assist humans with diverse tasks and environments in everyday life. However, conventional mobile manipulation approaches often struggle to generalize across different tasks…

Robotics · Computer Science 2025-03-18 Zhenyu Wu , Yuheng Zhou , Xiuwei Xu , Ziwei Wang , Haibin Yan

Vision-Language-Action (VLA) models have achieved strong semantic generalization for embodied policy learning, yet they learn reactive observation-to-action mappings without explicitly modeling how the physical world evolves under…

Conventional visuomotor imitation learning usually predicts future robot actions directly in the time domain. Such formulations often have limited physical scene awareness and weak long-horizon memory. In contrast, world-model-based…

Robotics · Computer Science 2026-05-12 Changchuan Yang , Yuhang Dong , Guanzhong Tian , Haizhou Ge , Hongrui Zhu

Reinforcement Learning (RL) applications in real-world scenarios must prioritize safety and reliability, which impose strict constraints on agent behavior. Model-based RL leverages predictive world models for action planning and policy…

Artificial Intelligence · Computer Science 2025-06-06 Artem Latyshev , Gregory Gorbov , Aleksandr I. Panov

World Action Models (WAMs) have recently emerged as a promising paradigm for robotic manipulation by jointly predicting future visual observations and future actions. However, current WAMs typically execute a fixed number of predicted…

Robotics · Computer Science 2026-05-12 Rui Wang , Yue Zhang , Jiehong Lin , Kuncheng Luo , Jianan Wang , Zhongrui Wang , Xiaojuan Qi

Robot learning requires a considerable amount of high-quality data to realize the promise of generalization. However, large data sets are costly to collect in the real world. Physics simulators can cheaply generate vast data sets with broad…

Learning-based controllers are often purposefully kept out of real-world applications due to concerns about their safety and reliability. We explore how state-of-the-art world models in Model-Based Reinforcement Learning can be utilized…

Robotics · Computer Science 2025-03-05 Fabian Domberg , Georg Schildbach

World Action Models (WAMs) have emerged as a promising alternative to Vision-Language-Action (VLA) models for embodied control because they explicitly model how visual observations may evolve under action. Most existing WAMs follow an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Tianyuan Yuan , Zibin Dong , Yicheng Liu , Hang Zhao

The surface pressure field of transportation systems, including cars, trains, and aircraft, is critical for aerodynamic analysis and design. In recent years, deep neural networks have emerged as promising and efficient methods for modeling…

Computational Engineering, Finance, and Science · Computer Science 2026-01-13 Junhong Zou , Wei Qiu , Zhenxu Sun , Xiaomei Zhang , Zhaoxiang Zhang , Xiangyu Zhu

The power of foundation models (FMs) lies in their capacity to learn highly expressive representations that can be adapted to a broad spectrum of tasks. However, these pretrained models require additional training stages to become effective…

Machine Learning · Computer Science 2025-10-24 Jacob L. Block , Sundararajan Srinivasan , Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

The strong performance of large vision-language models (VLMs) trained with reinforcement learning (RL) has motivated similar approaches for fine-tuning vision-language-action (VLA) models in robotics. Many recent works fine-tune VLAs…

Robotics · Computer Science 2026-03-31 Andrew Choi , Xinjie Wang , Zhizhong Su , Wei Xu