中文
相关论文

相关论文: Generating Images with 3D Annotations Using Diffus…

200 篇论文

The success of image generative models has enabled us to build methods that can edit images based on text or other user input. However, these methods are bespoke, imprecise, require additional information, or are limited to only 2D image…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Rahul Sajnani , Jeroen Vanbaar , Jie Min , Kapil Katyal , Srinath Sridhar

The generation of medical images presents significant challenges due to their high-resolution and three-dimensional nature. Existing methods often yield suboptimal performance in generating high-quality 3D medical images, and there is…

图像与视频处理 · 电气工程与系统科学 2025-12-02 Haoshen Wang , Zhentao Liu , Kaicong Sun , Xiaodong Wang , Dinggang Shen , Zhiming Cui

Recent advancements in text-to-image diffusion models have demonstrated remarkable success, yet they often struggle to fully capture the user's intent. Existing approaches using textual inputs combined with bounding boxes or region masks…

计算机视觉与模式识别 · 计算机科学 2024-09-13 Seonho Lee , Jiho Choi , Seohyun Lim , Jiwook Kim , Hyunjung Shim

Diffusion models have achieved great success in generating 2D images. However, the quality and generalizability of 3D content generation remain limited. State-of-the-art methods often require large-scale 3D assets for training, which are…

图形学 · 计算机科学 2025-03-24 Jiantao Lin , Xin Yang , Meixi Chen , Yingjie Xu , Dongyu Yan , Leyi Wu , Xinli Xu , Lie XU , Shunsi Zhang , Ying-Cong Chen

Modeling the physical contacts between the hand and object is standard for refining inaccurate hand poses and generating novel human grasp in 3D hand-object reconstruction. However, existing methods rely on geometric constraints that cannot…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Zhongqun Zhang , Hengfei Wang , Ziwei Yu , Yihua Cheng , Angela Yao , Hyung Jin Chang

The rapid advancement in image generation models has predominantly been driven by diffusion models, which have demonstrated unparalleled success in generating high-fidelity, diverse images from textual prompts. Despite their success,…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Yusuf Dalva , Hidir Yesiltepe , Pinar Yanardag

Recent advancements in 3D generation have leveraged synthetic datasets with ground truth 3D assets and predefined cameras. However, the potential of adopting real-world datasets, which can produce significantly more realistic 3D scenes,…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Xinyang Li , Zhangyu Lai , Linning Xu , Yansong Qu , Liujuan Cao , Shengchuan Zhang , Bo Dai , Rongrong Ji

We propose a novel image editing technique that enables 3D manipulations on single images, such as object rotation and translation. Existing 3D-aware image editing approaches typically rely on synthetic multi-view datasets for training…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Ruicheng Wang , Jianfeng Xiang , Jiaolong Yang , Xin Tong

Deepfake images are fast becoming a serious concern due to their realism. Diffusion models have recently demonstrated highly realistic visual content generation, which makes them an excellent potential tool for Deepfake generation. To curb…

计算机视觉与模式识别 · 计算机科学 2023-09-27 Yunzhuo Chen , Nur Al Hasan Haldar , Naveed Akhtar , Ajmal Mian

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

Denoising diffusion models trained at web-scale have revolutionized image generation. The application of these tools to engineering design is an intriguing possibility, but is currently limited by their inability to parse and enforce…

机器学习 · 计算机科学 2023-06-19 Nikos Arechiga , Frank Permenter , Binyang Song , Chenyang Yuan

Precise geometric control in image generation is essential for engineering \& product design and creative industries to control 3D object features accurately in image space. Traditional 3D editing approaches are time-consuming and demand…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Phillip Mueller , Talip Uenlue , Sebastian Schmidt , Marcel Kollovieh , Jiajie Fan , Stephan Guennemann , Lars Mikelsons

Distilling 3D representations from pretrained 2D diffusion models is essential for 3D creative applications across gaming, film, and interior design. Current SDS-based methods are hindered by inefficient information distillation from…

计算机视觉与模式识别 · 计算机科学 2025-03-13 Haoran Li , Yuli Tian , Yonghui Wang , Yong Liao , Lin Wang , Yuyang Wang , Peng Yuan Zhou

Generative models have been widely studied in computer vision. Recently, diffusion models have drawn substantial attention due to the high quality of their generated images. A key desired property of image generative models is the ability…

计算机视觉与模式识别 · 计算机科学 2022-12-20 Qiucheng Wu , Yujian Liu , Handong Zhao , Ajinkya Kale , Trung Bui , Tong Yu , Zhe Lin , Yang Zhang , Shiyu Chang

Diffusion models emerged as a leading approach in text-to-image generation, producing high-quality images from textual descriptions. However, attempting to achieve detailed control to get a desired image solely through text remains a…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Pablo Domingo-Gregorio , Javier Ruiz-Hidalgo

Although the recent rapid evolution of 3D generative neural networks greatly improves 3D shape generation, it is still not convenient for ordinary users to create 3D shapes and control the local geometry of generated shapes. To address…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Xin-Yang Zheng , Hao Pan , Peng-Shuai Wang , Xin Tong , Yang Liu , Heung-Yeung Shum

Generating novel views of a natural scene, e.g., every-day scenes both indoors and outdoors, from a single view is an under-explored problem, even though it is an organic extension to the object-centric novel view synthesis. Existing…

计算机视觉与模式识别 · 计算机科学 2025-11-13 Wonbong Jang , Jonathan Tremblay , Lourdes Agapito

Image synthesis approaches, e.g., generative adversarial networks, have been popular as a form of data augmentation in medical image analysis tasks. It is primarily beneficial to overcome the shortage of publicly accessible data and…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Shiyi Du , Xiaosong Wang , Yongyi Lu , Yuyin Zhou , Shaoting Zhang , Alan Yuille , Kang Li , Zongwei Zhou

Diffusion models are powerful generative models that map noise to data using stochastic processes. However, for many applications such as image editing, the model input comes from a distribution that is not random noise. As such, diffusion…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Linqi Zhou , Aaron Lou , Samar Khanna , Stefano Ermon

Object-centric learning aims to represent visual data with a set of object entities (a.k.a. slots), providing structured representations that enable systematic generalization. Leveraging advanced architectures like Transformers, recent…

计算机视觉与模式识别 · 计算机科学 2023-09-25 Ziyi Wu , Jingyu Hu , Wuyue Lu , Igor Gilitschenski , Animesh Garg