English
Related papers

Related papers: PhysX-3D: Physical-Grounded 3D Asset Generation

200 papers

Realistic object interactions are crucial for creating immersive virtual experiences, yet synthesizing realistic 3D object dynamics in response to novel interactions remains a significant challenge. Unlike unconditional or text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Tianyuan Zhang , Hong-Xing Yu , Rundi Wu , Brandon Y. Feng , Changxi Zheng , Noah Snavely , Jiajun Wu , William T. Freeman

We propose a method to create plausible geometric and texture style variations of 3D objects in the quest to democratize 3D content creation. Given a pair of textured source and target objects, our method predicts a part-aware affine…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Kangxue Yin , Jun Gao , Maria Shugrina , Sameh Khamis , Sanja Fidler

Automatic 3D content creation has achieved rapid progress recently due to the availability of pre-trained, large language models and image diffusion models, forming the emerging topic of text-to-3D content creation. Existing text-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Rui Chen , Yongwei Chen , Ningxin Jiao , Kui Jia

3D human digitization has long been a highly pursued yet challenging task. Existing methods aim to generate high-quality 3D digital humans from single or multiple views, but remain primarily constrained by current paradigms and the scarcity…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yuhang Yang , Fengqi Liu , Yixing Lu , Qin Zhao , Pingyu Wu , Wei Zhai , Ran Yi , Yang Cao , Lizhuang Ma , Zheng-Jun Zha , Junting Dong

Creating 3D assets that follow the texture and geometry style of existing ones is often desirable or even inevitable in practical applications like video gaming and virtual reality. While impressive progress has been made in generating 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Zefan Qu , Zhenwei Wang , Haoyuan Wang , Ke Xu , Gerhard Hancke , Rynson W. H. Lau

This article aims to use graphic engines to simulate a large number of training data that have free annotations and possibly strongly resemble to real-world data. Between synthetic and real, a two-level domain gap exists, involving content…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yue Yao , Liang Zheng , Xiaodong Yang , Milind Napthade , Tom Gedeon

Compositional 3D scene generation from a single view requires the simultaneous recovery of scene layout and 3D assets. Existing approaches mainly fall into two categories: feed-forward generation methods and per-instance generation methods.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Ze-Xin Yin , Liu Liu , Xinjie Wang , Wei Sui , Zhizhong Su , Jian Yang , Jin Xie

Recently, the surge of efficient and automated 3D AI-generated content (AIGC) methods has increasingly illuminated the path of transforming human imagination into complex 3D structures. However, the automated generation of 3D content is…

Graphics · Computer Science 2024-12-20 Pei Chen , Fudong Wang , Yixuan Tong , Jingdong Chen , Ming Yang , Minghui Yang

Generating a street-level 3D scene from a single satellite image is a crucial yet challenging task. Current methods present a stark trade-off: geometry-colorization models achieve high geometric fidelity but are typically building-focused…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ming Qian , Zimin Xia , Changkun Liu , Shuailei Ma , Wen Wang , Zeran Ke , Bin Tan , Hang Zhang , Gui-Song Xia

Despite the latest remarkable advances in generative modeling, efficient generation of high-quality 3D assets from textual prompts remains a difficult task. A key challenge lies in data scarcity: the most extensive 3D datasets encompass…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Antoine Mercier , Ramin Nakhli , Mahesh Reddy , Rajeev Yasarla , Hong Cai , Fatih Porikli , Guillaume Berger

Developing embodied AI agents requires scalable training environments that balance content diversity with physics accuracy. World simulators provide such environments but face distinct limitations: video-based methods generate diverse…

Automatic 3D content creation seeks to replace labor-intensive modeling and scanning pipelines with systems that can synthesize or recover 3D assets directly from text or images. Its applications span video games, virtual reality, robotics,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jiahao Li

Diffusion models have achieved great success in generating 2D images. However, the quality and generalizability of 3D content generation remain limited. State-of-the-art methods often require large-scale 3D assets for training, which are…

Graphics · Computer Science 2025-03-24 Jiantao Lin , Xin Yang , Meixi Chen , Yingjie Xu , Dongyu Yan , Leyi Wu , Xinli Xu , Lie XU , Shunsi Zhang , Ying-Cong Chen

We present GuidedSceneGen, a text-to-3D generation framework that produces metrically accurate, globally consistent, and semantically interpretable indoor scenes. Unlike prior text-driven methods that often suffer from geometric drift or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Stefan Ainetter , Thomas Deixelberger , Edoardo A. Dominici , Philipp Drescher , Konstantinos Vardis , Markus Steinberger

Modeling the 3D world from sensor data for simulation is a scalable way of developing testing and validation environments for robotic learning problems such as autonomous driving. However, manually creating or re-creating real-world-like…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Bokui Shen , Xinchen Yan , Charles R. Qi , Mahyar Najibi , Boyang Deng , Leonidas Guibas , Yin Zhou , Dragomir Anguelov

In recent years, autonomous driving has significantly in creased the demand for high-quality data to train 2D and 3D perception models for safety-critical scenarios. Real world datasets struggle to meet this demand as require ments…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Arka Bhowmick , Enes Ozeren , Ahmed Abdullah , Oliver Wasenmuller

While text-to-3D generation has attracted growing interest, existing methods often struggle to produce 3D assets that align well with human preferences. Current preference alignment techniques for 3D content typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Xiandong Zou , Ruihao Xia , Hongsong Wang , Pan Zhou

Scaling laws have validated the success and promise of large-data-trained models in creative generation across text, image, and video domains. However, this paradigm faces data scarcity in the 3D domain, as there is far less of it available…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Xiaochuan Li , Guoguang Du , Runze Zhang , Liang Jin , Qi Jia , Lihua Lu , Zhenhua Guo , Yaqian Zhao , Haiyang Liu , Tianqi Wang , Changsheng Li , Xiaoli Gong , Rengang Li , Baoyu Fan

Recent advances in differentiable rendering have sparked an interest in learning generative models of textured 3D meshes from image collections. These models natively disentangle pose and appearance, enable downstream applications in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Dario Pavllo , Jonas Kohler , Thomas Hofmann , Aurelien Lucchi

Despite the unprecedented progress in the field of 3D generation, current systems still often fail to produce high-quality 3D assets that are visually appealing and geometrically and semantically consistent across multiple viewpoints. To…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Shivam Duggal , Yushi Hu , Oscar Michel , Aniruddha Kembhavi , William T. Freeman , Noah A. Smith , Ranjay Krishna , Antonio Torralba , Ali Farhadi , Wei-Chiu Ma