English
Related papers

Related papers: WorldGym: World Model as An Environment for Policy…

200 papers

As AI agents leave the lab and venture into the real world as autonomous vehicles, delivery robots, and cooking robots, it is increasingly necessary to design and comprehensively evaluate algorithms that tackle the ``open-world''. To this…

Artificial Intelligence · Computer Science 2024-06-09 Shivam Goel , Yichen Wei , Panagiotis Lymperopoulos , Klara Chura , Matthias Scheutz , Jivko Sinapov

Vision-language-action models (VLAs) have been extensively used in robotics applications, achieving great success in various manipulation problems. More recently, VLAs have been used in long-horizon tasks and evaluated on benchmarks, such…

Robotics · Computer Science 2026-04-24 Amir Rasouli , Yangzheng Wu , Zhiyuan Li , Rui Heng Yang , Xuan Zhao , Charles Eret , Sajjad Pakdamansavoji

The task of estimating the world model describing the dynamics of a real world process assumes immense importance for anticipating and preparing for future outcomes. For applications such as video surveillance, robotics applications,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Hao Tang , Kevin Ellis , Suhas Lohit , Michael J. Jones , Moitreya Chatterjee

Robotic manipulation requires sophisticated commonsense reasoning, a capability naturally possessed by large-scale Vision-Language Models (VLMs). While VLMs show promise as zero-shot planners, their lack of grounded physical understanding…

Robotics · Computer Science 2026-03-18 Emily Yue-Ting Jia , Weiduo Yuan , Tianheng Shi , Vitor Guizilini , Jiageng Mao , Yue Wang

Autonomous agents are increasingly expected to operate in complex, dynamic, and uncertain environments, performing tasks such as manipulation, navigation, and decision-making. Achieving these capabilities requires agents to understand the…

Robotics · Computer Science 2025-11-11 Peng-Fei Zhang , Ying Cheng , Xiaofan Sun , Shijie Wang , Fengling Li , Lei Zhu , Heng Tao Shen

We propose Heterogeneous Masked Autoregression (HMA) for modeling action-video dynamics to generate high-quality data and evaluation in scaling robot learning. Building interactive video world models and policies for robotics is difficult…

Robotics · Computer Science 2025-02-07 Lirui Wang , Kevin Zhao , Chaoqi Liu , Xinlei Chen

Reward design remains a critical bottleneck in visual reinforcement learning (RL) for robotic manipulation. In simulated environments, rewards are conventionally designed based on the distance to a target position. However, such precise…

Machine Learning · Computer Science 2025-09-29 Nan Tang , Jing-Cheng Pang , Guanlin Li , Chao Qian , Yang Yu

Vision-Language-Action (VLA) models have gained popularity for learning robotic manipulation tasks that follow language instructions. State-of-the-art VLAs, such as OpenVLA and $\pi_{0}$, were trained on large-scale, manually labeled action…

Robotics · Computer Science 2025-09-24 Bahey Tharwat , Yara Nasser , Ali Abouzeid , Ian Reid

Learning natural, stable, and compositionally generalizable whole-body control policies for humanoid robots performing simultaneous locomotion and manipulation (loco-manipulation) remains a fundamental challenge in robotics. Existing…

The rise of embodied AI has greatly improved the possibility of general mobile agent systems. At present, many evaluation platforms with rich scenes, high visual fidelity and various application scenarios have been developed. In this paper,…

Robotics · Computer Science 2024-10-30 Haoran Li , Shasha Liu , Mingjun Ma , Guangzheng Hu , Yaran Chen , Dongbin Zhao

Evaluating learned robot control policies to determine their physical task-level capabilities costs experimenter time and effort. The growing number of policies and tasks exacerbates this issue. It is impractical to test every policy on…

Robotics · Computer Science 2025-02-17 Abrar Anwar , Rohan Gupta , Zain Merchant , Sayan Ghosh , Willie Neiswanger , Jesse Thomason

While generative robot policies have demonstrated significant potential in learning complex, multimodal behaviors from demonstrations, they still exhibit diverse failures at deployment-time. Policy steering offers an elegant solution to…

Robotics · Computer Science 2025-05-05 Yilin Wu , Ran Tian , Gokul Swamy , Andrea Bajcsy

Vision-Language Models (VLMs) encode knowledge and reasoning capabilities for robotic manipulation within high-dimensional representation spaces. However, current approaches often project them into compressed intermediate representations,…

Robotics · Computer Science 2025-06-25 Wenbo Li , Shiyi Wang , Yiteng Chen , Huiping Zhuang , Qingyao Wu

Solving complex, long-horizon robotic manipulation tasks requires a deep understanding of physical interactions, reasoning about their long-term consequences, and precise high-level planning. Vision-Language Models (VLMs) offer a general…

Robotics · Computer Science 2026-02-24 Yanting Yang , Shenyuan Gao , Qingwen Bu , Li Chen , Dimitris N. Metaxas

With the rise of stochastic generative models in robot policy learning, end-to-end visuomotor policies are increasingly successful at solving complex tasks by learning from human demonstrations. Nevertheless, since real-world evaluation…

Robotics · Computer Science 2024-10-24 Joseph A. Vincent , Haruki Nishimura , Masha Itkina , Paarth Shah , Mac Schwager , Thomas Kollar

Large Language Models (LLMs) and strong vision models have enabled rapid research and development in the field of Vision-Language-Action models that enable robotic control. The main objective of these methods is to develop a generalist…

Learned world models hold significant potential for robotic manipulation, as they can serve as simulator for real-world interactions. While extensive progress has been made in 2D video-based world models, these approaches often lack…

Robotics · Computer Science 2025-10-13 Chuanrui Zhang , Zhengxian Wu , Guanxing Lu , Yansong Tang , Ziwei Wang

Vision language models (VLMs) achieve strong performance on general image understanding but struggle to think with medical images, especially when performing multi-step reasoning through iterative visual interaction. Medical VLMs often rely…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Meng Lu , Yuxing Lu , Yuchen Zhuang , Megan Mullins , Yang Xie , Guanghua Xiao , Charles Fleming , Wenqi Shi , Xuan Wang

Vision-Language-Action (VLA) models offer a compelling framework for tackling complex robotic manipulation tasks, but they are often expensive to train. In this paper, we propose a novel VLA approach that leverages the competitive…

Robotics · Computer Science 2025-12-23 Max Argus , Jelena Bratulic , Houman Masnavi , Maxim Velikanov , Nick Heppert , Abhinav Valada , Thomas Brox

World model-based policy evaluation is a practical proxy for testing real-world robot control by rolling out candidate actions in action-conditioned video diffusion models. As these models increasingly adopt latent diffusion modeling (LDM),…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Nilaksh , Saurav Jha , Artem Zholus , Sarath Chandar