English
Related papers

Related papers: Cyc3D: Fine-grained Controllable 3D Generation via…

200 papers

Human motion generation is a significant pursuit in generative computer vision with widespread applications in film-making, video games, AR/VR, and human-robot interaction. Current methods mainly utilize either diffusion-based generative…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Canxuan Gang

Recent works have sought to enhance the controllability and precision of text-driven motion generation. Some approaches leverage large language models (LLMs) to produce more detailed texts, while others incorporate global 3D coordinate…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Keming Shen , Bizhu Wu , Junliang Chen , Xiaoqin Wang , Linlin Shen

Controllable generation is considered a potentially vital approach to address the challenge of annotating 3D data, and the precision of such controllable generation becomes particularly imperative in the context of data production for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Jinhua Zhang , Hualian Sheng , Sijia Cai , Bing Deng , Qiao Liang , Wen Li , Ying Fu , Jieping Ye , Shuhang Gu

Recent works on text-to-3d generation show that using only 2D diffusion supervision for 3D generation tends to produce results with inconsistent appearances (e.g., faces on the back view) and inaccurate shapes (e.g., animals with extra…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cheng Chen , Xiaofeng Yang , Fan Yang , Chengzeng Feng , Zhoujie Fu , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

This paper presents a novel framework for modeling and conditional generation of 3D articulated objects. Troubled by flexibility-quality tradeoffs, existing methods are often limited to using predefined structures or retrieving shapes from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Jiayi Su , Youhe Feng , Zheng Li , Jinhua Song , Yangfan He , Botao Ren , Botian Xu

Despite the unprecedented progress in the field of 3D generation, current systems still often fail to produce high-quality 3D assets that are visually appealing and geometrically and semantically consistent across multiple viewpoints. To…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Shivam Duggal , Yushi Hu , Oscar Michel , Aniruddha Kembhavi , William T. Freeman , Noah A. Smith , Ranjay Krishna , Antonio Torralba , Ali Farhadi , Wei-Chiu Ma

Text-to-video generation has shown promising results. However, by taking only natural languages as input, users often face difficulties in providing detailed information to precisely control the model's output. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Hsin-Ping Huang , Yu-Chuan Su , Deqing Sun , Lu Jiang , Xuhui Jia , Yukun Zhu , Ming-Hsuan Yang

Symmetry is a strong prior present in many object categories, yet standard benchmarks for 3D generative models rarely report whether this prior is preserved. We study symmetry preservation in unconditional point cloud generation. We first…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Nicolas Caytuiro , Ivan Sipiran

Capitalizing on the recent advances in image generation models, existing controllable face image synthesis methods are able to generate high-fidelity images with some levels of controllability, e.g., controlling the shapes, expressions,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Keqiang Sun , Shangzhe Wu , Ning Zhang , Zhaoyang Huang , Quan Wang , Hongsheng Li

Text-driven 3D scene generation techniques have made rapid progress in recent years. Their success is mainly attributed to using existing generative models to iteratively perform image warping and inpainting to generate 3D scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Frank Zhang , Yibo Zhang , Quan Zheng , Rui Ma , Wei Hua , Hujun Bao , Weiwei Xu , Changqing Zou

Although recent 3D-native generators have made great progress in synthesizing reliable geometry, they still fall short in achieving realistic appearances. A key obstacle lies in the lack of diverse and high-quality real-world 3D assets with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Xinyue Liang , Zhinyuan Ma , Lingchen Sun , Yanjun Guo , Lei Zhang

Designing and generating new data under targeted properties has been attracting various critical applications such as molecule design, image editing and speech synthesis. Traditional hand-crafted approaches heavily rely on expertise…

Machine Learning · Computer Science 2024-03-19 Shiyu Wang , Yuanqi Du , Xiaojie Guo , Bo Pan , Zhaohui Qin , Liang Zhao

Realistic shadow generation is a critical component for high-quality image compositing and visual effects, yet existing methods suffer from certain limitations: Physics-based approaches require a 3D scene geometry, which is often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Onur Tasar , Clément Chadebec , Benjamin Aubin

Controllable generative models for images and videos have seen significant success, yet 3D scene generation, especially in unbounded scenarios like autonomous driving, remains underdeveloped. Existing methods lack flexible controllability…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Ruiyuan Gao , Kai Chen , Zhihao Li , Lanqing Hong , Zhenguo Li , Qiang Xu

Our ability to sample realistic natural images, particularly faces, has advanced by leaps and bounds in recent years, yet our ability to exert fine-tuned control over the generative process has lagged behind. If this new technology is to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Marek Kowalski , Stephan J. Garbin , Virginia Estellers , Tadas Baltrušaitis , Matthew Johnson , Jamie Shotton

Score distillation sampling (SDS) and its variants have greatly boosted the development of text-to-3D generation, but are vulnerable to geometry collapse and poor textures yet. To solve this issue, we first deeply analyze the SDS and find…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Zike Wu , Pan Zhou , Xuanyu Yi , Xiaoding Yuan , Hanwang Zhang

In this work, we introduce CC3D, a conditional generative model that synthesizes complex 3D scenes conditioned on 2D semantic scene layouts, trained using single-view images. Different from most existing 3D GANs that limit their…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Xingguang Yan , Gordon Wetzstein , Leonidas Guibas , Andrea Tagliasacchi

Generating high-quality 3D content from text, single images, or sparse view images remains a challenging task with broad applications. Existing methods typically employ multi-view diffusion models to synthesize multi-view images, followed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Junlin Han , Jianyuan Wang , Andrea Vedaldi , Philip Torr , Filippos Kokkinos

Generative models for 3D object synthesis have seen significant advancements with the incorporation of prior knowledge distilled from 2D diffusion models. Nevertheless, challenges persist in the form of multi-view geometric inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Lincong Feng , Muyu Wang , Maoyu Wang , Kuo Xu , Xiaoli Liu

Although Score Distillation Sampling (SDS) has exhibited remarkable performance in conditional 3D content generation, a comprehensive understanding of its formulation is still lacking, hindering the development of 3D generation. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Boshi Tang , Jianan Wang , Zhiyong Wu , Lei Zhang