English
Related papers

Related papers: Phys4DGen: Physics-Compliant 4D Generation with Mu…

200 papers

Recent advances in 3D content generation have amplified demand for dynamic models that are both visually realistic and physically consistent. However, state-of-the-art video diffusion models frequently produce implausible results such as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Siwei Meng , Yawei Luo , Ping Liu

Generating robot demonstrations through simulation is widely recognized as an effective way to scale up robot data. Previous work often trained reinforcement learning agents to generate expert policies, but this approach lacks sample…

Robotics · Computer Science 2024-05-14 Yang Jin , Jun Lv , Shuqiang Jiang , Cewu Lu

In recent years, there has been rapid development in 3D generation models, opening up new possibilities for applications such as simulating the dynamic movements of 3D objects and customizing their behaviors. However, current 3D generative…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Fangfu Liu , Hanyang Wang , Shunyu Yao , Shengjun Zhang , Jie Zhou , Yueqi Duan

Recent advances in diffusion models have revolutionized 2D and 3D content creation, yet generating photorealistic dynamic 4D scenes remains a significant challenge. Existing dynamic 4D generation methods typically rely on distilling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Vinayak Gupta , Yunze Man , Yu-Xiong Wang

We address the task of generating physically accurate and visually faithful 4D Human-Object Interaction (HOI). Given a static 3D human and target object represented as 3D Gaussian Splats (3DGS), our goal is to synthesize dynamic scenes…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Omer Benishu , Gal Fiebelman , Sagie Benaim

Recent advances in diffusion models have demonstrated exceptional capabilities in image and video generation, further improving the effectiveness of 4D synthesis. Existing 4D generation methods can generate high-quality 4D objects or scenes…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Bohan Zeng , Ling Yang , Siyu Li , Jiaming Liu , Zixiang Zhang , Juanxi Tian , Kaixin Zhu , Yongzhen Guo , Fu-Yun Wang , Minkai Xu , Stefano Ermon , Wentao Zhang

We introduce Drag4D, an interactive framework that integrates object motion control within text-driven 3D scene generation. This framework enables users to define 3D trajectories for the 3D objects generated from a single image, seamlessly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Minjun Kang , Inkyu Shin , Taeyeop Lee , In So Kweon , Kuk-Jin Yoon

The controllability of 3D object generation methods is achieved through input text. Existing text-to-3D object generation methods primarily focus on generating a single object based on a single object description. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Shaorong Sun , Shuchao Pang , Yazhou Yao , Xiaoshui Huang

Recently, the surge of efficient and automated 3D AI-generated content (AIGC) methods has increasingly illuminated the path of transforming human imagination into complex 3D structures. However, the automated generation of 3D content is…

Graphics · Computer Science 2024-12-20 Pei Chen , Fudong Wang , Yixuan Tong , Jingdong Chen , Ming Yang , Minghui Yang

We introduce PhysGaussian, a new method that seamlessly integrates physically grounded Newtonian dynamics within 3D Gaussians to achieve high-quality novel motion synthesis. Employing a custom Material Point Method (MPM), our approach…

Graphics · Computer Science 2024-04-16 Tianyi Xie , Zeshun Zong , Yuxing Qiu , Xuan Li , Yutao Feng , Yin Yang , Chenfanfu Jiang

Simulation-ready physical 3D assets have emerged as a promising direction owing to their broad applicability in downstream tasks. However, most existing 3D generation methods either neglect physical properties or are limited to a single…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Ziang Cao , Yinghao Liu , Haitian Li , Runmao Yao , Fangzhou Hong , Zhaoxi Chen , Liang Pan , Ziwei Liu

Recent developments in 2D visual generation have been remarkably successful. However, 3D and 4D generation remain challenging in real-world applications due to the lack of large-scale 4D data and effective model design. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yuyang Zhao , Chung-Ching Lin , Kevin Lin , Zhiwen Yan , Linjie Li , Zhengyuan Yang , Jianfeng Wang , Gim Hee Lee , Lijuan Wang

Understanding and predicting dynamics of the physical world can enhance a robot's ability to plan and interact effectively in complex environments. While recent video generation models have shown strong potential in modeling dynamic scenes,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zeyi Liu , Shuang Li , Eric Cousineau , Siyuan Feng , Benjamin Burchfiel , Shuran Song

Recent advances in generative video modeling, driven by large-scale datasets and powerful architectures, have yielded remarkable visual realism. However, emerging evidence suggests that simply scaling data and model size does not endow…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Ying Shen , Jerry Xiong , Tianjiao Yu , Ismini Lourentzou

Synthesizing physics-grounded 3D assets is a critical bottleneck for interactive virtual worlds and embodied AI. Existing methods predominantly focus on static geometry, overlooking the functional properties essential for interaction. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yunhan Yang , Chunshi Wang , Junliang Ye , Yang Li , Zanxin Chen , Zehuan Huang , Yao Mu , Zhuo Chen , Chunchao Guo , Xihui Liu

Existing dynamic scene generation methods mostly rely on distilling knowledge from pre-trained 3D generative models, which are typically fine-tuned on synthetic object datasets. As a result, the generated scenes are often object-centric and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Heng Yu , Chaoyang Wang , Peiye Zhuang , Willi Menapace , Aliaksandr Siarohin , Junli Cao , Laszlo A Jeni , Sergey Tulyakov , Hsin-Ying Lee

Advances in generative modeling have significantly enhanced digital content creation, extending from 2D images to complex 3D and 4D scenes. Despite substantial progress, producing high-fidelity and temporally consistent dynamic 4D content…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 DongFu Yin , Xiaotian Chen , Fei Richard Yu , Xuanchen Li , Xinhao Zhang

We introduce Garment3DGen a new method to synthesize 3D garment assets from a base mesh given a single input image as guidance. Our proposed approach allows users to generate 3D textured clothes based on both real and synthetic images, such…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Nikolaos Sarafianos , Tuur Stuyck , Xiaoyu Xiang , Yilei Li , Jovan Popovic , Rakesh Ranjan

Existing image-to-video generation methods often produce physically implausible motions and lack precise control over object dynamics. While prior approaches have incorporated physics simulators, they remain confined to 2D planar motions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Tianyidan Xie , Zhentao Huang , Mingjie Wang , Xin Huang , Jun Zhou , Minglun Gong , Zili Yi

Recent advancements in generative models have enabled the creation of dynamic 4D content - 3D objects in motion - based on text prompts, which holds potential for applications in virtual worlds, media, and gaming. Existing methods provide…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Ohad Rahamim , Ori Malca , Dvir Samuel , Gal Chechik