English
Related papers

Related papers: R2RGEN: Real-to-Real 3D Data Generation for Spatia…

200 papers

Our goal is to train control policies that generalize well to unseen environments. Inspired by the Distributionally Robust Optimization (DRO) framework, we propose DRAGEN - Distributionally Robust policy learning via Adversarial Generation…

Robotics · Computer Science 2022-07-08 Allen Z. Ren , Anirudha Majumdar

Reliable autonomous driving relies on large-scale, well-labeled data and robust models. However, manual data collection is resource-intensive, and traditional simulation suffers from a persistent reality gap. While recent generative…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Kaicong Huang , Talha Azfar , Weisong Shi , Ruimin Ke

Capturing and labeling real-world 3D data is laborious and time-consuming, which makes it costly to train strong 3D models. To address this issue, recent works present a simple method by generating randomized 3D scenes without simulation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Lanxiao Li , Michael Heizmann

Generating robot demonstrations through simulation is widely recognized as an effective way to scale up robot data. Previous work often trained reinforcement learning agents to generate expert policies, but this approach lacks sample…

Robotics · Computer Science 2024-05-14 Yang Jin , Jun Lv , Shuqiang Jiang , Cewu Lu

Robotic simulation today remains challenging to scale up due to the human efforts required to create diverse simulation tasks and scenes. Simulation-trained policies also face scalability issues as many sim-to-real methods focus on a single…

Robotics · Computer Science 2024-10-07 Pu Hua , Minghuan Liu , Annabella Macaluso , Yunfeng Lin , Weinan Zhang , Huazhe Xu , Lirui Wang

Imitation learning is a promising paradigm for training robot control policies, but these policies can suffer from distribution shift, where the conditions at evaluation time differ from those in the training data. A popular approach for…

Robotics · Computer Science 2024-05-03 Ryan Hoque , Ajay Mandlekar , Caelan Garrett , Ken Goldberg , Dieter Fox

Robot learning methods have the potential for widespread generalization across tasks, environments, and objects. However, these methods require large diverse datasets that are expensive to collect in real-world robotics settings. For robot…

Robotics · Computer Science 2023-02-24 Zoey Chen , Sho Kiami , Abhishek Gupta , Vikash Kumar

Despite the recent success of modern imitation learning methods in robot manipulation, their performance is often constrained by geometric variations due to limited data diversity. Leveraging powerful 3D generative models and vision…

Robotics · Computer Science 2026-04-14 Jiawei Zhang , Kaizhe Hu , Yingqian Huang , Yuanchen Ju , Zhengrong Xue , Huazhe Xu

Recent advances in Vision-Language-Action (VLA) and world-model methods have improved generalization in tasks such as robotic manipulation and object interaction. However, Successful execution of such tasks depends on large, costly…

Robotics · Computer Science 2026-03-16 Yulu Wu , Jiujun Cheng , Haowen Wang , Dengyang Suo , Pei Ren , Qichao Mao , Shangce Gao , Yakun Huang

This paper presents GenH2R, a framework for learning generalizable vision-based human-to-robot (H2R) handover skills. The goal is to equip robots with the ability to reliably receive objects with unseen geometry handed over by humans in…

Robotics · Computer Science 2024-06-17 Zifan Wang , Junyu Chen , Ziqing Chen , Pengwei Xie , Rui Chen , Li Yi

We present ReinDriveGen, a framework that enables full controllability over dynamic driving scenes, allowing users to freely edit actor trajectories to simulate safety-critical corner cases such as front-vehicle collisions, drifting cars,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hao Zhang , Lue Fan , Weikang Bian , Zehuan Wu , Lewei Lu , Zhaoxiang Zhang , Hongsheng Li

Creating high-fidelity 3D models of indoor environments is essential for applications in design, virtual reality, and robotics. However, manual 3D modeling remains time-consuming and labor-intensive. While recent advances in generative AI…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Chuan Fang , Heng Li , Yixun Liang , Jia Zheng , Yongsen Mao , Yuan Liu , Rui Tang , Zihan Zhou , Ping Tan

Remote sensing vision tasks require extensive labeled data across multiple, interconnected domains. However, current generative data augmentation frameworks are task-isolated, i.e., each vision task requires training an independent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Datao Tang , Hao Wang , Yudeng Xin , Hui Qiao , Dongsheng Jiang , Yin Li , Zhiheng Yu , Xiangyong Cao

Efficiently leveraging simulation to acquire advanced manipulation skills is both challenging and highly significant. We introduce \textit{ForeRobo}, a generative robotic agent that utilizes generative simulations to autonomously acquire…

Robotics · Computer Science 2025-11-07 Dexin wang , Faliang Chang , Chunsheng Liu

Simulating object dynamics from real-world perception shows great promise for digital twins and robotic manipulation but often demands labor-intensive measurements and expertise. We present a fully automated Real2Sim pipeline that generates…

Robotics · Computer Science 2025-04-02 Nicholas Pfaff , Evelyn Fu , Jeremy Binagia , Phillip Isola , Russ Tedrake

The strong performance of large vision-language models (VLMs) trained with reinforcement learning (RL) has motivated similar approaches for fine-tuning vision-language-action (VLA) models in robotics. Many recent works fine-tune VLAs…

Robotics · Computer Science 2026-03-31 Andrew Choi , Xinjie Wang , Zhizhong Su , Wei Xu

Imitation learning from human demonstrations is an effective paradigm for robot manipulation, but acquiring large datasets is costly and resource-intensive, especially for long-horizon tasks. To address this issue, we propose SkillMimicGen…

Robotics · Computer Science 2024-10-25 Caelan Garrett , Ajay Mandlekar , Bowen Wen , Dieter Fox

Constructing a physically realistic and accurately scaled simulated 3D world is crucial for the training and evaluation of embodied intelligence tasks. The diversity, realism, low cost accessibility and affordability of 3D data assets are…

Robotics · Computer Science 2025-06-17 Xinjie Wang , Liu Liu , Yu Cao , Ruiqi Wu , Wenkang Qin , Dehui Wang , Wei Sui , Zhizhong Su

Despite recent advances in 3D human motion generation (MoGen) on standard benchmarks, existing text-to-motion models still face a fundamental bottleneck in their generalization capability. In contrast, adjacent generative fields, most…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jing Lin , Ruisi Wang , Junzhe Lu , Ziqi Huang , Guorui Song , Ailing Zeng , Xian Liu , Chen Wei , Wanqi Yin , Qingping Sun , Zhongang Cai , Lei Yang , Ziwei Liu

Over the past few years there has been major progress in the field of synthetic data generation using simulation based techniques. These methods use high-end graphics engines and physics-based ray-tracing rendering in order to represent the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Paul Yudkin , Eli Friedman , Orly Zvitia , Gil Elbaz