English
Related papers

Related papers: ManiTwin: Scaling Data-Generation-Ready Digital Ob…

200 papers

Recent advances in robotics have been largely driven by imitation learning, which depends critically on large-scale, high-quality demonstration data. However, collecting such data remains a significant challenge-particularly for mobile…

Robotics · Computer Science 2025-10-07 Yilin Mei , Peng Qiu , Wei Zhang , WenChao Zhang , Wenjie Song

Imitation learning from human demonstrations is an effective means to teach robots manipulation skills. But data acquisition is a major bottleneck in applying this paradigm more broadly, due to the amount of cost and human effort involved.…

Robotics · Computer Science 2025-03-07 Zhenyu Jiang , Yuqi Xie , Kevin Lin , Zhenjia Xu , Weikang Wan , Ajay Mandlekar , Linxi Fan , Yuke Zhu

This article presents UrbanTwin datasets, high-fidelity, realistic replicas of three public roadside lidar datasets: LUMPI, V2X-Real-IC, and TUMTraf-I. Each UrbanTwin dataset contains 10K annotated frames corresponding to one of the public…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Muhammad Shahbaz , Shaurya Agarwal

Accelerated materials discovery is critical for addressing global challenges. However, developing new laboratory workflows relies heavily on real-world experimental trials, and this can hinder scalability because of the need for numerous…

Simulation is increasingly being used for generating large labelled datasets in many machine learning problems. Recent methods have focused on adjusting simulator parameters with the goal of maximising accuracy on a validation task, usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Harkirat Singh Behl , Atılım Güneş Baydin , Ran Gal , Philip H. S. Torr , Vibhav Vineet

Converting static 3D meshes into interactable articulated assets is crucial for embodied AI and robotic simulation. However, existing zero-shot pipelines struggle with complex assets due to a critical lack of physical grounding.…

Robotics · Computer Science 2026-03-16 WenBo Xu , Liu Liu , Li Zhang , Dan Guo , RuoNan Liu

Omnia presents a synthetic data driven pipeline to accelerate the training, validation, and deployment readiness of militarized humanoids. The approach converts first-person spatial observations captured from point-of-view recordings, smart…

Robotics · Computer Science 2025-12-17 Mohammed Ayman Habib , Aldo Petruzzelli

Services for Cyber-Physical Systems based on Artificial Intelligence and Machine Learning require a virtual representation of the physical. To reduce modeling efforts and to synchronize results, for each system, a common and unique virtual…

Artificial Intelligence · Computer Science 2020-10-28 Oliver Niggemann , Alexander Diedrich , Christian Kuehnert , Erik Pfannstiel , Joshua Schraven

Multi-robot system for manufacturing is an Industry Internet of Things (IIoT) paradigm with significant operational cost savings and productivity improvement, where Unmanned Aerial Vehicles (UAVs) are employed to control and implement…

Information Theory · Computer Science 2023-05-04 Kai Xiong , Zhihong Wang , Supeng Leng , Jianhua He

Generalizable manipulation skills, which can be composed to tackle long-horizon and complex daily chores, are one of the cornerstones of Embodied AI. However, existing benchmarks, mostly composed of a suite of simulatable environments, are…

Rigging and skinning are essential steps to create realistic 3D animations, often requiring significant expertise and manual effort. Traditional attempts at automating these processes rely heavily on geometric heuristics and often struggle…

Graphics · Computer Science 2025-07-08 Yufan Deng , Yuhao Zhang , Chen Geng , Shangzhe Wu , Jiajun Wu

This survey examines recent advances in generating digital twins from visual data. These digital twins - virtual 3D replicas of physical assets - can be applied to robotics, media content creation, design or construction workflows. We…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Andrew Melnik , Benjamin Alt , Giang Nguyen , Artur Wilkowski , Maciej Stefańczyk , Qirui Wu , Sinan Harms , Helge Rhodin , Manolis Savva , Michael Beetz

This paper introduces a pipeline to parametrically sample and render multi-task vision datasets from comprehensive 3D scans from the real world. Changing the sampling parameters allows one to "steer" the generated datasets to emphasize…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Ainaz Eftekhar , Alexander Sax , Roman Bachmann , Jitendra Malik , Amir Zamir

Digital twins, as precise digital representations of physical systems, have evolved from passive simulation tools into intelligent and autonomous entities through the integration of artificial intelligence technologies. This paper presents…

The use of machine learning (ML) methods for development of robust and flexible visual inspection system has shown promising. However their performance is highly dependent on the amount and diversity of training data. This is often…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Juraj Fulir , Natascha Jeziorski , Lovro Bosnar , Hans Hagen , Claudia Redenbach , Petra Gospodnetić , Tobias Herrfurth , Marcus Trost , Thomas Gischkat

Digital twin (DT) offers significant opportunities for enhancing facility management (FM) in campus environments. However, existing research often focuses narrowly on isolated domains, such as point-cloud geometry or energy analytics,…

Systems and Control · Electrical Eng. & Systems 2025-12-16 Thyda Siv

This paper presents a comprehensive workflow for generating and validating a synthetic dataset designed for robotic surgery instrument segmentation. A 3D reconstruction of the Da Vinci robotic arms was refined and animated in Autodesk Maya…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Giorgio Chiesa , Rossella Borra , Vittorio Lauro , Sabrina De Cillis , Daniele Amparore , Cristian Fiori , Riccardo Renzulli , Marco Grangetto

Digital twins are becoming increasingly popular across many industries for real-time data streaming, processing, and visualization. They allow stakeholders to monitor, diagnose, and optimize assets. Emerging technologies used for immersive…

Signal Processing · Electrical Eng. & Systems 2024-01-05 Florian Stadtmann , Hary Pirajan Mahalingam , Adil Rasheed

Spatial intelligence is emerging as a transformative frontier in AI, yet it remains constrained by the scarcity of large-scale 3D datasets. Unlike the abundant 2D imagery, acquiring 3D data typically requires specialized sensors and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Xingyu Miao , Haoran Duan , Quanhao Qian , Jiuniu Wang , Yang Long , Ling Shao , Deli Zhao , Ran Xu , Gongjie Zhang