English
Related papers

Related papers: PhysX-Anything: Simulation-Ready Physical 3D Asset…

200 papers

We present SOPHY, a generative model for 3D physics-aware shape synthesis. Unlike existing 3D generative models that focus solely on static geometry or 4D models that produce physics-agnostic animations, our method jointly synthesizes…

Graphics · Computer Science 2025-08-12 Junyi Cao , Evangelos Kalogerakis

While the generation of 3D content from single-view images has been extensively studied, the creation of physically consistent 3D dynamic scenes from videos remains in its early stages. We propose a novel framework leveraging generative 3D…

Graphics · Computer Science 2025-10-31 Zhiwei Zhao , Alan Zhao , Minchen Li , Yixin Hu

Developing embodied AI agents requires scalable training environments that balance content diversity with physics accuracy. World simulators provide such environments but face distinct limitations: video-based methods generate diverse…

Recent advances in world models have greatly enhanced interactive environment simulation. Existing methods mainly fall into two categories: (1) static world generation models, which construct 3D environments without active agents, and (2)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yitong Wang , Fangyun Wei , Hongyang Zhang , Bo Dai , Yan Lu

Modern video diffusion models excel at appearance synthesis but still struggle with physical consistency: objects drift, collisions lack realistic rebound, and material responses seldom match their underlying properties. We present PhyCo, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Sriram Narayanan , Ziyu Jiang , Srinivasa Narasimhan , Manmohan Chandraker

Simulating object dynamics from real-world perception shows great promise for digital twins and robotic manipulation but often demands labor-intensive measurements and expertise. We present a fully automated Real2Sim pipeline that generates…

Robotics · Computer Science 2025-04-02 Nicholas Pfaff , Evelyn Fu , Jeremy Binagia , Phillip Isola , Russ Tedrake

Large-scale endeavors like and widespread community efforts such as Open-X-Embodiment have contributed to growing the scale of robot demonstration data. However, there is still an opportunity to improve the quality, quantity, and diversity…

Robotics · Computer Science 2024-08-30 Jiafei Duan , Wentao Yuan , Wilbert Pumacay , Yi Ru Wang , Kiana Ehsani , Dieter Fox , Ranjay Krishna

A deep understanding of the physical world is a central goal for embodied AI and realistic simulation. While current models excel at capturing an object's surface geometry and appearance, they largely neglect its internal physical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Jingxuan Zhang , Tianqi Yu , Yatu Zhang , Jinze Wu , Kaixin Yao , Jingyang Liu , Yuyao Zhang , Jiayuan Gu , Jingyi Yu

We address the challenge of creating 3D assets for household articulated objects from a single image. Prior work on articulated object creation either requires multi-view multi-state input, or only allows coarse control over the generation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jiayi Liu , Denys Iliash , Angel X. Chang , Manolis Savva , Ali Mahdavi-Amiri

The emergence of generative artificial intelligence (GenAI) and large language models (LLMs) has revolutionized the landscape of digital content creation in different modalities. However, its potential use in Physical AI for engineering…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Melvin Wong , Yueming Lyu , Thiago Rios , Stefan Menzel , Yew-Soon Ong

3D animation is central to modern visual media, yet traditional production pipelines remain labor-intensive, expertise-demanding, and computationally expensive. Recent AIGC-based approaches partially automate asset creation and rigging, but…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yupeng Zhu , Xiongzhen Zhang , Ye Chen , Bingbing Ni

Generating articulated objects, such as laptops and microwaves, is a crucial yet challenging task with extensive applications in Embodied AI and AR/VR. Current image-to-3D methods primarily focus on surface geometry and texture, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Ruijie Lu , Yu Liu , Jiaxiang Tang , Junfeng Ni , Yuxiang Wang , Diwen Wan , Gang Zeng , Yixin Chen , Siyuan Huang

Converting static 3D meshes into interactable articulated assets is crucial for embodied AI and robotic simulation. However, existing zero-shot pipelines struggle with complex assets due to a critical lack of physical grounding.…

Robotics · Computer Science 2026-03-16 WenBo Xu , Liu Liu , Li Zhang , Dan Guo , RuoNan Liu

As 3D Gaussian Splatting (3DGS) emerges as a leading approach for novel view synthesis and scene reconstruction, its potential in digital asset creation has gained significant attention. An increasing number of asset libraries based on GS…

Human-Computer Interaction · Computer Science 2026-04-16 Haotian Mao , Hangyu Zhou , Zhuoxiong Xu , Siyue Wei , Yule Quan , Yan Zhang , Zixuan Guo , Nianchen Deng , Xubo Yang

Creating realistic virtual assets is a time-consuming process: it usually involves an artist designing the object, then spending a lot of effort on tweaking its appearance. Intricate details and certain effects, such as subsurface…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Aljaž Božič , Denis Gladkov , Luke Doukakis , Christoph Lassner

Conditional motion generation has been extensively studied in computer vision, yet two critical challenges remain. First, while masked autoregressive methods have recently outperformed diffusion-based approaches, existing masking models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Zeyu Zhang , Yiran Wang , Wei Mao , Danning Li , Rui Zhao , Biao Wu , Zirui Song , Bohan Zhuang , Ian Reid , Richard Hartley

Synthesizing 3D human avatars interacting realistically with a scene is an important problem with applications in AR/VR, video games and robotics. Towards this goal, we address the task of generating a virtual human -- hands and full body…

Robotics · Computer Science 2023-03-30 Purva Tendulkar , Dídac Surís , Carl Vondrick

Recent advances in 3D-native generative models have accelerated asset creation for games, film, and design. However, most methods still rely primarily on image or text conditioning and lack fine-grained, cross-modal controls, which limits…

Recent generative video models achieve impressive visual quality but remain constrained by limited physical consistency and controllability. Existing video generation methods provide minimal physical control, and single-image-to-3D…

Graphics · Computer Science 2026-05-21 Xin Zhang , Yabo Chen , Yijie Fang , Wanying Qu , Haibin Huang , Chi Zhang , Feng Xu , Xuelong Li

3D assets are essential in the digital age. While automatic 3D generation, such as image-to-3d, has made significant strides in recent years, it often struggles to achieve fast, detailed, and high-fidelity generation simultaneously. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Huanning Dong , Yinuo Huang , Fan Li , Ping Kuang