English
Related papers

Related papers: IC3D: Image-Conditioned 3D Diffusion for Shape Gen…

200 papers

3D scene generation is a core technology for gaming, film/VFX, and VR/AR. Growing demand for rapid iteration, high-fidelity detail, and accessible content creation has further increased interest in this area. Existing methods broadly follow…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Haozhi Zhu , Miaomiao Zhao , Dingyao Liu , Runze Tian , Yan Zhang , Jie Guo , Fenggen Yu

Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that supports…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Nicholas Konz , Yuwen Chen , Haoyu Dong , Maciej A. Mazurowski

Diffusion models are at the vanguard of generative AI research with renowned solutions such as ImageGen by Google Brain and DALL.E 3 by OpenAI. Nevertheless, the potential merits of diffusion models for communication engineering…

Information Theory · Computer Science 2023-11-17 Mehdi Letafati , Samad Ali , Matti Latva-aho

In recent years, 3D vision has become a crucial field within computer vision, powering a wide range of applications such as autonomous driving, robotics, augmented reality, and medical imaging. This field relies on accurate perception,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Zhen Wang , Dongyuan Li , Yaozu Wu , Tianyu He , Jiang Bian , Renhe Jiang

Most 3D generation research focuses on up-projecting 2D foundation models into the 3D space, either by minimizing 2D Score Distillation Sampling (SDS) loss or fine-tuning on multi-view datasets. Without explicit 3D priors, these methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Lihe Ding , Shaocong Dong , Zhanpeng Huang , Zibin Wang , Yiyuan Zhang , Kaixiong Gong , Dan Xu , Tianfan Xue

We introduce a new diffusion-based approach for shape completion on 3D range scans. Compared with prior deterministic and probabilistic methods, we strike a balance between realism, multi-modality, and high fidelity. We propose DiffComplete…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Ruihang Chu , Enze Xie , Shentong Mo , Zhenguo Li , Matthias Nießner , Chi-Wing Fu , Jiaya Jia

Continuous Conditional Generative Modeling (CCGM) estimates high-dimensional data distributions, such as images, conditioned on scalar continuous variables (aka regression labels). While Continuous Conditional Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Xin Ding , Yongwei Wang , Kao Zhang , Z. Jane Wang

Generating realistic 3D point clouds is a fundamental problem in computer vision with applications in remote sensing, robotics, and digital object modeling. Existing generative approaches primarily capture geometry, and when semantics are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Gunner Stone , Sushmita Sarker , Alireza Tavakkoli

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Denoising diffusion probabilistic models (DDPM) have shown remarkable performance in unconditional image generation. However, due to the stochasticity of the generative process in DDPM, it is challenging to generate images with the desired…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Jooyoung Choi , Sungwon Kim , Yonghyun Jeong , Youngjune Gwon , Sungroh Yoon

Generating high-quality 3D content from text, single images, or sparse view images remains a challenging task with broad applications. Existing methods typically employ multi-view diffusion models to synthesize multi-view images, followed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Junlin Han , Jianyuan Wang , Andrea Vedaldi , Philip Torr , Filippos Kokkinos

Despite the advancements in 3D full-shape generation, accurately modeling complex geometries and semantics of shape parts remains a significant challenge, particularly for shapes with varying numbers of parts. Current methods struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Lei Cheng , Mahdi Saleh , Qing Cheng , Lu Sang , Hongli Xu , Daniel Cremers , Federico Tombari

The generation of stylistic 3D facial animations driven by speech presents a significant challenge as it requires learning a many-to-many mapping between speech, style, and the corresponding natural facial motion. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Zhiyao Sun , Tian Lv , Sheng Ye , Matthieu Lin , Jenny Sheng , Yu-Hui Wen , Minjing Yu , Yong-Jin Liu

Creative image generation has emerged as a compelling area of research, driven by the need to produce novel and high-quality images that expand the boundaries of imagination. In this work, we propose a novel framework for creative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Kunpeng Song , Ahmed Elgammal

Despite the proliferation of generative models, achieving fast sampling during inference without compromising sample diversity and quality remains challenging. Existing models such as Denoising Diffusion Probabilistic Models (DDPM) deliver…

Machine Learning · Computer Science 2023-10-12 Yanwu Xu , Mingming Gong , Shaoan Xie , Wei Wei , Matthias Grundmann , Kayhan Batmanghelich , Tingbo Hou

Face recognition models embed a face image into a low-dimensional identity vector containing abstract encodings of identity-specific facial features that allow individuals to be distinguished from one another. We tackle the challenging task…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Manuel Kansy , Anton Raël , Graziana Mignone , Jacek Naruniec , Christopher Schroers , Markus Gross , Romann M. Weber

Diffusion models (DMs) excel in photo-realistic image synthesis, but their adaptation to LiDAR scene generation poses a substantial hurdle. This is primarily because DMs operating in the point space struggle to preserve the curve-like…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Haoxi Ran , Vitor Guizilini , Yue Wang

Diffusion models are the current state of the art for generating photorealistic images. Controlling the sampling process for constrained image generation tasks such as inpainting, however, remains challenging since exact conditioning on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Anji Liu , Mathias Niepert , Guy Van den Broeck

Text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models has shown great promise but still suffers from inconsistent 3D geometric structures (Janus problems) and severe artifacts. The aforementioned problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Baorui Ma , Haoge Deng , Junsheng Zhou , Yu-Shen Liu , Tiejun Huang , Xinlong Wang

Large pre-trained models have had a significant impact on computer vision by enabling multi-modal learning, where the CLIP model has achieved impressive results in image classification, object detection, and semantic segmentation. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Sitian Shen , Zilin Zhu , Linqian Fan , Harry Zhang , Xinxiao Wu