English
Related papers

Related papers: Ditto: Building Digital Twins of Articulated Objec…

200 papers

Interactive 3D simulated objects are crucial in AR/VR, animations, and robotics, driving immersive experiences and advanced automation. However, creating these articulated objects requires extensive human effort and expertise, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Long Le , Jason Xie , William Liang , Hung-Ju Wang , Yue Yang , Yecheng Jason Ma , Kyle Vedder , Arjun Krishna , Dinesh Jayaraman , Eric Eaton

Digital capturing of memorable personal items is a key way to archive personal memories. Although current digitization methods (e.g., photos, videos, 3D scanning) can replicate the physical appearance of an item, they often cannot preserve…

Human-Computer Interaction · Computer Science 2025-02-17 Zisu Li , Jiawei Li , Zeyu Xiong , Shumeng Zhang , Faraz Faruqi , Stefanie Mueller , Chen Liang , Xiaojuan Ma , Mingming Fan

Generating articulated objects, such as laptops and microwaves, is a crucial yet challenging task with extensive applications in Embodied AI and AR/VR. Current image-to-3D methods primarily focus on surface geometry and texture, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Ruijie Lu , Yu Liu , Jiaxiang Tang , Junfeng Ni , Yuxiang Wang , Diwen Wan , Gang Zeng , Yixin Chen , Siyuan Huang

Building articulated objects is a key challenge in computer vision. Existing methods often fail to effectively integrate information across different object states, limiting the accuracy of part-mesh reconstruction and part dynamics…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yu Liu , Baoxiong Jia , Ruijie Lu , Junfeng Ni , Song-Chun Zhu , Siyuan Huang

Articulated objects are common in the real world, yet modeling their structure and motion remains a challenging task for 3D reconstruction methods. In this work, we introduce Part$^{2}$GS, a novel framework for modeling articulated digital…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Tianjiao Yu , Vedant Shah , Muntasir Wahed , Ying Shen , Kiet A. Nguyen , Ismini Lourentzou

Understanding articulated objects from monocular video is a crucial yet challenging task in robotics and digital twin creation. Existing methods often rely on complex multi-view setups, high-fidelity object scans, or fragile long-term point…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Arslan Artykov , Tom Ravaud , Corentin Sautier , Vincent Lepetit

We introduce the In Real Life (IRL) Ditto, an AI-driven embodied agent designed to represent remote colleagues in shared office spaces, creating opportunities for real-time exchanges even in their absence. IRL Ditto offers a unique hybrid…

Artificial Intelligence · Computer Science 2025-05-01 Seonghee Lee , Denae Ford , John Tang , Sasa Junuzovic , Asta Roseway , Ed Cutrell , Kori Inkpen

Creating interactive digital environments for gaming, robotics, and simulation relies on articulated 3D objects whose functionality emerges from their part geometry and kinematic structure. However, existing approaches remain fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Penghao Wang , Siyuan Xie , Hongyu Yan , Xianghui Yang , Jingwei Huang , Chunchao Guo , Jiayuan Gu

Insufficient data volume and quality are particularly pressing challenges in the adoption of modern subsymbolic AI. To alleviate these challenges, AI simulation uses virtual training environments in which AI agents can be safely and…

Artificial Intelligence · Computer Science 2025-09-01 Xiaoran Liu , Istvan David

This work is interested in digital twins, and the development of a simplified framework for them, in the context of dynamical systems. Digital twin is an ingenious concept that helps on organizing different areas of expertise aiming at…

Signal Processing · Electrical Eng. & Systems 2021-01-29 TG Ritto , FA Rochinha

A Digital Twin is a virtual system that can fully describe a physical one. It constantly receives data from its counterpart's sensors, consults external sources, and obtains manual inputs from its stakeholders. The DT uses all this…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-02 Laura Bragante Corssac , Juliano Araujo Wickboldt

Three-dimensional imaging through scattering media is important in medical science and astronomy. We propose a digital-twin imaging method based on Gaussian splatting to observe an object behind a scattering medium. A digital twin model…

Optics · Physics 2025-07-04 Suguru Shimomura , Kazuki Yamanouchi , Jun Tanida

Recent advances in robotics have been largely driven by imitation learning, which depends critically on large-scale, high-quality demonstration data. However, collecting such data remains a significant challenge-particularly for mobile…

Robotics · Computer Science 2025-10-07 Yilin Mei , Peng Qiu , Wei Zhang , WenChao Zhang , Wenjie Song

Reconstructing articulated objects into high-fidelity digital twins is crucial for applications such as robotic manipulation and interactive simulation. Recent self-supervised methods using differentiable rendering frameworks like 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Xuelu Li , Zhaonan Wang , Xiaogang Wang , Lei Wu , Manyi Li , Changhe Tu

In this paper, we address the challenge of reconstructing general articulated 3D objects from a single video. Existing works employing dynamic neural radiance fields have advanced the modeling of articulated objects like humans and animals…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Chaoyue Song , Jiacheng Wei , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

Complex IoT ecosystems often require the usage of Digital Twins (DTs) of their physical assets in order to perform predictive analytics and simulate what-if scenarios. DTs are able to replicate IoT devices and adapt over time to their…

Networking and Internet Architecture · Computer Science 2024-01-02 Luca Sciullo , Alberto De Marchi , Angelo Trotta , Federico Montori , Luciano Bononi , Marco Di Felice

Imitation learning methods need significant human supervision to learn policies robust to changes in object poses, physical disturbances, and visual distractors. Reinforcement learning, on the other hand, can explore the environment…

Robotics · Computer Science 2024-11-26 Marcel Torne , Anthony Simeonov , Zechu Li , April Chan , Tao Chen , Abhishek Gupta , Pulkit Agrawal

This study presents a comparative framework for evaluating emotional engagement with textile soft robots and their augmented-reality (AR) counterparts. Four robotic sculptures were developed, each embodying nature-inspired dynamic behaviors…

Human-Computer Interaction · Computer Science 2026-01-21 Berfin Ataman , Rodrigo Gallardo , Qilmeg Doudatcz

Digital twins are virtual replicas of physical entities and are poised to transform personalized medicine through the real-time simulation and prediction of human physiology. Translating this paradigm from engineering to biomedicine…

We introduce the Digital Twin Catalog (DTC), a new large-scale photorealistic 3D object digital twin dataset. A digital twin of a 3D object is a highly detailed, virtually indistinguishable representation of a physical object, accurately…