English
Related papers

Related papers: LDA-1B: Scaling Latent Dynamics Action Model via U…

200 papers

Explainable robots require not only successful task execution but also the ability to expose internal decision-making process in a user-friendly manner. However, most imitation learning methods are trained solely on task-level…

Robotics · Computer Science 2026-05-19 Site Hu , Takato Horii

Reduced-order modelling and low-dimensional surrogate models generated using machine learning algorithms have been widely applied in high-dimensional dynamical systems to improve the algorithmic efficiency. In this paper, we develop a…

Model-based reinforcement learning attempts to use an available or learned model to improve the data efficiency of reinforcement learning. This work proposes a one-step lookback approach that jointly learns the deep incremental model and…

Robotics · Computer Science 2025-02-28 Cong Li

Realizing scaling laws in embodied AI has become a focus. However, previous work has been scattered across diverse simulation platforms, with assets and models lacking unified interfaces, which has led to inefficiencies in research. To…

While a general embodied agent must function as a unified system, current methods are built on isolated models for understanding, world modeling, and control. This fragmentation prevents unifying multimodal generative capabilities and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Hongzhe Bi , Hengkai Tan , Shenghao Xie , Zeyuan Wang , Shuhe Huang , Haitian Liu , Ruowen Zhao , Yao Feng , Chendong Xiang , Yinze Rong , Hongyan Zhao , Hanyu Liu , Zhizhong Su , Lei Ma , Hang Su , Jun Zhu

Digital agents require diverse, large-scale UI trajectories to generalize across real-world tasks, yet collecting such data is prohibitively expensive in both human annotation, infra and engineering perspectives. To this end, we introduce…

Computation and Language · Computer Science 2025-10-17 Yiming Wang , Da Yin , Yuedong Cui , Ruichen Zheng , Zhiqian Li , Zongyu Lin , Di Wu , Xueqing Wu , Chenchen Ye , Yu Zhou , Kai-Wei Chang

Building general-purpose embodied agents across diverse hardware remains a central challenge in robotics, often framed as the ''one-brain, many-forms'' paradigm. Progress is hindered by fragmented data, inconsistent representations, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yandan Yang , Shuang Zeng , Tong Lin , Xinyuan Chang , Dekang Qi , Junjin Xiao , Haoyun Liu , Ronghan Chen , Yuzhi Chen , Dongjie Huo , Feng Xiong , Xing Wei , Zhiheng Ma , Mu Xu

Large language models leverage internet-scale text data, yet embodied AI remains constrained by the prohibitive costs of physical trajectory collection. Desktop environments -- particularly gaming -- offer a compelling alternative: they…

Artificial Intelligence · Computer Science 2026-03-04 Suhwan Choi , Jaeyoon Jung , Haebin Seong , Minchan Kim , Minyeong Kim , Yongjun Cho , Yoonshik Kim , Yubeen Park , Youngjae Yu , Yunsung Lee

Learning universal policies from cross-embodied data remains a fundamental challenge in robotics. Although Vision-Language-Action (VLA) models are pre-trained on large and diverse datasets, they typically rely on embodiment-specific…

Robotics · Computer Science 2026-05-26 Boyu Li , Chaoyi Xu , Haoqi Yuan , Xinrun Xu , Börje F. Karlsson , Dongbin Zhao , Haoran Li , Zongqing Lu

Imitation learning offers a promising path for robots to learn general-purpose behaviors, but traditionally has exhibited limited scalability due to high data supervision requirements and brittle generalization. Inspired by recent advances…

Machine Learning · Computer Science 2022-11-16 Soroush Nasiriany , Tian Gao , Ajay Mandlekar , Yuke Zhu

A large body of compelling evidence has been accumulated demonstrating that embodiment - the agent's physical setup, including its shape, materials, sensors and actuators - is constitutive for any form of cognition and as a consequence,…

Artificial Intelligence · Computer Science 2021-10-20 Matej Hoffmann , Rolf Pfeifer

With the rapid development of embodied intelligence, leveraging large-scale human data for high-level imitation learning on humanoid robots has become a focal point of interest in both academia and industry. However, applying humanoid…

Robotics · Computer Science 2025-03-28 Yongxu Wang , Weiyun Yi , Xinhao Kong , Wanting Li

We present a model-based framework for robot locomotion that achieves walking based on only 4.5 minutes (45,000 control steps) of data collected on a quadruped robot. To accurately model the robot's dynamics over a long horizon, we…

Machine Learning · Computer Science 2019-10-08 Yuxiang Yang , Ken Caluwaerts , Atil Iscen , Tingnan Zhang , Jie Tan , Vikas Sindhwani

We present Pelican-Unify 1.0, the first embodied foundation model trained according to the principle of unification. Pelican-Unify 1.0 uses a single VLM as a unified understanding module, mapping scenes, instructions, visual contexts, and…

Large-scale foundation models (LFMs) have recently made impressive progress in text-to-motion generation by learning strong generative priors from massive 3D human motion datasets and paired text descriptions. However, how to effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Xiaoyan Cong , Zekun Li , Zhiyang Dou , Hongyu Li , Omid Taheri , Chuan Guo , Abhay Mittal , Sizhe An , Taku Komura , Wojciech Matusik , Michael J. Black , Srinath Sridhar

Whole-body control (WBC) of humanoid robots has witnessed remarkable progress in skill versatility, enabling a wide range of applications such as locomotion, teleoperation, and motion tracking. Despite these achievements, existing WBC…

Robotics · Computer Science 2025-09-18 Weishuai Zeng , Shunlin Lu , Kangning Yin , Xiaojie Niu , Minyue Dai , Jingbo Wang , Jiangmiao Pang

Behavior cloning methods for robot learning suffer from poor generalization due to limited data support beyond expert demonstrations. Recent approaches leveraging video prediction models have shown promising results by learning rich…

Embodied AI requires agents that perceive, act, and anticipate how actions reshape future world states. World models serve as internal simulators that capture environment dynamics, enabling forward and counterfactual rollouts to support…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xinqing Li , Xin He , Le Zhang , Min Wu , Xiaoli Li , Yun Liu

The heterogeneity between high-level vision-language understanding and low-level action control remains a fundamental challenge in robotic manipulation. Although recent methods have advanced task-specific action alignment, they often…

Robotics · Computer Science 2026-03-16 Wuding Weng , Tongshu Wu , Liucheng Chen , Siyu Xie , Zheng Wang , Xing Xu , Jingkuan Song , Heng Tao Shen

Navigation is a fundamental capability in embodied AI, representing the intelligence required to perceive and interact within physical environments following language instructions. Despite significant progress in large Vision-Language…