English
Related papers

Related papers: Ditto: Building Digital Twins of Articulated Objec…

200 papers

A digital twin is a virtual replica of a real-world physical phenomena that uses mathematical modeling to characterize and simulate its defining features. By constructing digital twins for disease processes, we can perform in-silico…

Machine Learning · Computer Science 2024-11-04 Keying Kuang , Frances Dean , Jack B. Jedlicki , David Ouyang , Anthony Philippakis , David Sontag , Ahmed M. Alaa

We introduce an active 3D reconstruction method which integrates visual perception, robot-object interaction, and 3D scanning to recover both the exterior and interior, i.e., unexposed, geometries of a target 3D object. Unlike other works…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Zihao Yan , Fubao Su , Mingyang Wang , Ruizhen Hu , Hao Zhang , Hui Huang

Human digital twins (HDTs) are dynamic, data-driven virtual representations of individuals, continuously updated with multimodal data to simulate, monitor, and predict health trajectories. By integrating clinical, physiological, behavioral,…

Human-Computer Interaction · Computer Science 2025-08-19 Rong Pan , Hongyue Sun , Xiaoyu Chen , Giulia Pedrielli , Jiapeng Huang

In the rapidly advancing field of robotics, dual-arm coordination and complex object manipulation are essential capabilities for developing advanced autonomous systems. However, the scarcity of diverse, high-quality demonstration data and…

Robotics · Computer Science 2025-04-17 Yao Mu , Tianxing Chen , Shijia Peng , Zanxin Chen , Zeyu Gao , Yude Zou , Lunkai Lin , Zhiqiang Xie , Ping Luo

The concept of creating digital twins, connected digital models of physical systems, is gaining increasing attention for modeling and simulation of whole cities. The basis for building a digital twin of a city is the generation of a 3D city…

Graphics · Computer Science 2022-10-12 Vasilis Naserentin , Anders Logg

In this paper we introduce Y, a new-generation digital twin designed to replicate an online social media platform. Digital twins are virtual replicas of physical systems that allow for advanced analyses and experimentation. In the case of…

Digital twins are sophisticated software systems for the representation, monitoring, and control of cyber-physical systems, including automotive, avionics, smart manufacturing, and many more. Existing definitions and reference models of…

Software Engineering · Computer Science 2025-07-08 Jerome Pfeiffer , Jingxi Zhang , Benoit Combemale , Judith Michael , Bernhard Rumpe , Manuel Wimmer , Andreas Wortmann

Creating virtual digital replicas from real-world data unlocks significant potential across domains like gaming and robotics. In this paper, we present DRAWER, a novel framework that converts a video of a static indoor scene into a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Hongchi Xia , Entong Su , Marius Memmel , Arhan Jain , Raymond Yu , Numfor Mbiziwo-Tiapo , Ali Farhadi , Abhishek Gupta , Shenlong Wang , Wei-Chiu Ma

Central to the digital transformation of the process industry are Digital Twins (DTs), virtual replicas of physical manufacturing systems that combine sensor data with sophisticated data-based or physics-based models, or a combination…

Machine Learning · Computer Science 2024-07-03 Michael Mayr , Georgios C. Chasparis , Josef Küng

Articulated objects are central to interactive 3D applications, including embodied AI, robotics, and VR/AR, where functional part decomposition and kinematic motion are essential. Yet producing high-fidelity articulated assets remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Qingming Liu , Xinyue Yao , Shuyuan Zhang , Yueci Deng , Guiliang Liu , Zhen Liu , Kui Jia

We present methods and applications for the development of digital twins (DT) for urban traffic management. While the majority of studies on the DT focus on its ``eyes," which is the emerging sensing and perception like object detection and…

Systems and Control · Electrical Eng. & Systems 2026-02-05 Yongjie Fu , Mehmet K. Turkcan , Mahshid Ghasemi , Zhaobin Mo , Chengbo Zang , Abhishek Adhikari , Zoran Kostic , Gil Zussman , Xuan Di

Articulated objects are ubiquitous in daily life. In this paper, we present DexSim2Real$^{2}$, a novel framework for goal-conditioned articulated object manipulation. The core of our framework is constructing an explicit world model of…

Robotics · Computer Science 2025-07-15 Taoran Jiang , Yixuan Guan , Liqian Ma , Jing Xu , Jiaojiao Meng , Weihang Chen , Zecui Zeng , Lusong Li , Dan Wu , Rui Chen

This article discusses the use of digital twins for products made of polymer composite materials. The design of new products from polymer composite materials, both within the framework of the traditional and new direction of cloud…

Robotics · Computer Science 2021-09-14 Maksim Kubrikov , Mikhail Saramud , Angelina Petetskaya , Evgeniy Talay

Constructing accurate digital twins of articulated objects is essential for robotic simulation training and embodied AI world model building, yet historically requires painstaking manual modeling or multi-stage pipelines. In this work, we…

Robotics · Computer Science 2025-11-04 Zhe Li , Xiang Bai , Jieyu Zhang , Zhuangzhe Wu , Che Xu , Ying Li , Chengkai Hou , Shanghang Zhang

Automating the checkout process is important in smart retail, where users effortlessly pass products by hand through a camera, triggering automatic product detection, tracking, and counting. In this emerging area, due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yue Yao , Xinyu Tian , Zheng Tang , Sujit Biswas , Huan Lei , Tom Gedeon , Liang Zheng

Smart Cities already surround us, and yet they are still incomprehensibly far from directly impacting everyday life. While current Smart Cities are often inaccessible, the experience of everyday citizens may be enhanced with a combination…

Robotic systems have become integral to smart environments, enabling applications ranging from urban surveillance and automated agriculture to industrial automation. However, their effective operation in dynamic settings - such as smart…

Sim2Real domain transfer offers a cost-effective and scalable approach for developing LiDAR-based perception (e.g., object detection, tracking, segmentation) in Intelligent Transportation Systems (ITS). However, perception models trained in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Muhammad Shahbaz , Shaurya Agarwal

We present an approach to generate high fidelity 3D face avatar with a high-resolution UV texture map from a single image. To estimate the face geometry, we use a deep neural network to directly predict vertex coordinates of the 3D face…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Ruizhe Wang , Chih-Fan Chen , Hao Peng , Xudong Liu , Oliver Liu , Xin Li

With rapid digitization and digitalization, drawing a fine line between the digital and the physical world has become nearly impossible. It has become essential more than ever to integrate all spheres of life into a single Digital Thread to…