English
Related papers

Related papers: Phys4DGen: Physics-Compliant 4D Generation with Mu…

200 papers

Modern video diffusion models excel at appearance synthesis but still struggle with physical consistency: objects drift, collisions lack realistic rebound, and material responses seldom match their underlying properties. We present PhyCo, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Sriram Narayanan , Ziyu Jiang , Srinivasa Narasimhan , Manmohan Chandraker

In the field of computer vision, unsupervised learning for 2D object generation has advanced rapidly in the past few years. However, 3D object generation has not garnered the same attention or success as its predecessor. To facilitate novel…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Devendra K. Jangid , Neal R. Brodnik , Amil Khan , McLean P. Echlin , Tresa M. Pollock , Sam Daly , B. S. Manjunath

Recent breakthroughs in 3D generation have enabled the synthesis of high-fidelity individual assets. However, generating 3D compositional objects from single images--particularly under occlusions--remains challenging. Existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hui Shan , Keyang Luo , Ming Li , Sizhe Zheng , Yanwei Fu , Zhen Chen , Xiangru Huang

We present Free4D, a novel tuning-free framework for 4D scene generation from a single image. Existing methods either focus on object-level generation, making scene-level generation infeasible, or rely on large-scale multi-view video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Tianqi Liu , Zihao Huang , Zhaoxi Chen , Guangcong Wang , Shoukang Hu , Liao Shen , Huiqiang Sun , Zhiguo Cao , Wei Li , Ziwei Liu

We present StdGEN++, a novel and comprehensive system for generating high-fidelity, semantically decomposed 3D characters from diverse inputs. Existing 3D generative methods often produce monolithic meshes that lack the structural…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yuze He , Yanning Zhou , Wang Zhao , Jingwen Ye , Zhongkai Wu , Ran Yi , Yong-Jin Liu

Accurately reconstructing complex full multi-object scenes from sparse observations remains a core challenge in computer vision and a key step toward scalable and reliable simulation for robotics. In this work, we introduce RecGen, a…

Digital twin worlds with realistic interactive dynamics presents a new opportunity to develop generalist embodied agents in scannable environments with complex physical behaviors. To this end, we present GDGen (Generalized Representation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Yichen Li , Zhiyi Li , Brandon Feng , Dinghuai Zhang , Antonio Torralba

Driven by powerful image diffusion models, recent research has achieved the automatic creation of 3D objects from textual or visual guidance. By performing score distillation sampling (SDS) iteratively across different views, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Zeyu Li , Ruitong Gan , Chuanchen Luo , Yuxi Wang , Jiaheng Liu , Ziwei Zhu Man Zhang , Qing Li , Xucheng Yin , Zhaoxiang Zhang , Junran Peng

3D Gaussian Splatting (3DGS) has emerged as an efficient and high-fidelity paradigm for novel view synthesis. To adapt 3DGS for dynamic content, deformable 3DGS incorporates temporally deformable primitives with learnable latent embeddings…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Mufan Liu , Qi Yang , He Huang , Wenjie Huang , Zhenlong Yuan , Zhu Li , Yiling Xu

Transforming casually captured, monocular videos into fully immersive dynamic experiences is a highly ill-posed task, and comes with significant challenges, e.g., reconstructing unseen regions, and dealing with the ambiguity in monocular…

Graphics · Computer Science 2026-04-08 Denis Rozumny , Jonathon Luiten , Numair Khan , Johannes Schönberger , Peter Kontschieder

4D content generation has achieved remarkable progress recently. However, existing methods suffer from long optimization times, a lack of motion controllability, and a low quality of details. In this paper, we introduce DreamGaussian4D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jiawei Ren , Liang Pan , Jiaxiang Tang , Chi Zhang , Ang Cao , Gang Zeng , Ziwei Liu

Recent advancements in 3D generation are predominantly propelled by improvements in 3D-aware image diffusion models. These models are pretrained on Internet-scale image data and fine-tuned on massive 3D data, offering the capability of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Zeyu Yang , Zijie Pan , Chun Gu , Li Zhang

3D scene generation has garnered growing attention in recent years and has made significant progress. Generating 4D cities is more challenging than 3D scenes due to the presence of structurally complex, visually diverse objects like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Despite the availability of large-scale 3D datasets and advancements in 3D generative models, the complexity and uneven quality of 3D geometry and texture data continue to hinder the performance of 3D generation techniques. In most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Xin Yang , Jiantao Lin , Yingjie Xu , Haodong Li , Yingcong Chen

Realistic simulation of dynamic scenes requires accurately capturing diverse material properties and modeling complex object interactions grounded in physical principles. However, existing methods are constrained to basic material types…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Zhuoman Liu , Weicai Ye , Yan Luximon , Pengfei Wan , Di Zhang

View-predictive generative models provide strong priors for lifting object-centric images and videos into 3D and 4D through rendering and score distillation objectives. A question then remains: what about lifting complete multi-object…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Wen-Hsuan Chu , Lei Ke , Katerina Fragkiadaki

Existing single-image 3D indoor scene generators often produce results that look visually plausible but fail to obey real-world physics, limiting their reliability in robotics, embodied AI, and design. To examine this gap, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Dongli Wu , Jingyu Hu , Ka-Hei Hui , Xiaobao Wei , Chengwen Luo , Jianqiang Li , Zhengzhe Liu

Can we learn the physics of matter in motion directly from images and video--and trust it? Answering this question requires integrating experiments, physics-based simulation, and data across traditionally separate disciplines. Much of this…

Computational Engineering, Finance, and Science · Computer Science 2026-04-21 Hagen Holthusen , Kevin Linka , Ellen Kuhl

In recent years, the increasing demand for dynamic 3D assets in design and gaming applications has given rise to powerful generative pipelines capable of synthesizing high-quality 4D objects. Previous methods generally rely on score…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Qi Sun , Zhiyang Guo , Ziyu Wan , Jing Nathan Yan , Shengming Yin , Wengang Zhou , Jing Liao , Houqiang Li

We introduce SegviGen, a framework that repurposes native 3D generative models for 3D part segmentation. Existing pipelines either lift strong 2D priors into 3D via distillation or multi-view mask aggregation, often suffering from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Lin Li , Haoran Feng , Zehuan Huang , Haohua Chen , Wenbo Nie , Shaohua Hou , Keqing Fan , Pan Hu , Sheng Wang , Buyu Li , Lu Sheng