中文
相关论文

相关论文: Kandinsky 3.0 Technical Report

200 篇论文

Large-scale text-guided image diffusion models have shown astonishing results in text-to-image (T2I) generation. However, applying these models to synthesize textures for 3D geometries remains challenging due to the domain gap between 2D…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Jiawei Lu , Yingpeng Zhang , Zengjun Zhao , He Wang , Kun Zhou , Tianjia Shao

Text-guided diffusion models have revolutionized image generation and editing, offering exceptional realism and diversity. Specifically, in the context of diffusion-based editing, where a source image is edited according to a target prompt,…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Xuan Ju , Ailing Zeng , Yuxuan Bian , Shaoteng Liu , Qiang Xu

We present Dual3D, a novel text-to-3D generation framework that generates high-quality 3D assets from texts in only $1$ minute.The key component is a dual-mode multi-view latent diffusion model. Given the noisy multi-view latents, the 2D…

计算机视觉与模式识别 · 计算机科学 2024-05-17 Xinyang Li , Zhangyu Lai , Linning Xu , Jianfei Guo , Liujuan Cao , Shengchuan Zhang , Bo Dai , Rongrong Ji

Diffusion and flow matching models have achieved remarkable success in text-to-image generation. However, these models typically rely on the predetermined denoising schedules for all prompts. The multi-step reverse diffusion process can be…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Zilyu Ye , Zhiyang Chen , Tiancheng Li , Zemin Huang , Weijian Luo , Guo-Jun Qi

We present DIRECT-3D, a diffusion-based 3D generative model for creating high-quality 3D assets (represented by Neural Radiance Fields) from text prompts. Unlike recent 3D generative models that rely on clean and well-aligned 3D data,…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Qihao Liu , Yi Zhang , Song Bai , Adam Kortylewski , Alan Yuille

Despite the fact that popular text-to-image generation models cope well with international and general cultural queries, they have a significant knowledge gap regarding individual cultures. This is due to the content of existing large…

Recent advancements in 3D generation have leveraged synthetic datasets with ground truth 3D assets and predefined cameras. However, the potential of adopting real-world datasets, which can produce significantly more realistic 3D scenes,…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Xinyang Li , Zhangyu Lai , Linning Xu , Yansong Qu , Liujuan Cao , Shengchuan Zhang , Bo Dai , Rongrong Ji

The advancements in automatic text-to-3D generation have been remarkable. Most existing methods use pre-trained text-to-image diffusion models to optimize 3D representations like Neural Radiance Fields (NeRFs) via latent-space denoising…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Junzhe Zhu , Peiye Zhuang , Sanmi Koyejo

We present Stable Video Diffusion - a latent video diffusion model for high-resolution, state-of-the-art text-to-video and image-to-video generation. Recently, latent diffusion models trained for 2D image synthesis have been turned into…

Flow matching and diffusion models have shown impressive results in text-to-image generation, producing photorealistic images through an iterative denoising process. A common strategy to speed up synthesis is to perform early denoising at…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Jyun-Ze Tang , Chih-Fan Hsu , Jeng-Lin Li , Ming-Ching Chang , Wei-Chao Chen

Diffusion model based Text-to-Image has achieved impressive achievements recently. Although current technology for synthesizing images is highly advanced and capable of generating images with high fidelity, it is still possible to give the…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Yuxiang Tuo , Wangmeng Xiang , Jun-Yan He , Yifeng Geng , Xuansong Xie

Recently, text-to-image generation has exhibited remarkable advancements, with the ability to produce visually impressive results. In contrast, text-to-3D generation has not yet reached a comparable level of quality. Existing methods…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Yukang Cao , Yan-Pei Cao , Kai Han , Ying Shan , Kwan-Yee K. Wong

Diffusion models are the de facto approach for generating high-quality images and videos, but learning high-dimensional models remains a formidable task due to computational and optimization challenges. Existing methods often resort to…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Jiatao Gu , Shuangfei Zhai , Yizhe Zhang , Josh Susskind , Navdeep Jaitly

Autoregressive and diffusion models drive the recent breakthroughs on text-to-image generation. Despite their huge success of generating high-realistic images, a common shortcoming of these models is their high inference latency -…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Zhangyin Feng , Runyi Hu , Liangxin Liu , Fan Zhang , Duyu Tang , Yong Dai , Xiaocheng Feng , Jiwei Li , Bing Qin , Shuming Shi

Recent progress in diffusion models has revolutionized the popular technology of text-to-image generation. While existing approaches could produce photorealistic high-resolution images with text conditions, there are still several open…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Zhida Feng , Zhenyu Zhang , Xintong Yu , Yewei Fang , Lanxin Li , Xuyi Chen , Yuxiang Lu , Jiaxiang Liu , Weichong Yin , Shikun Feng , Yu Sun , Li Chen , Hao Tian , Hua Wu , Haifeng Wang

Recently, the impressive generative capabilities of diffusion models have been demonstrated, producing images with remarkable fidelity. Particularly, existing methods for the 3D object generation tasks, which is one of the fastest-growing…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Jaeseok Lee , Jaekoo Lee

The tremendous progress in neural image generation, coupled with the emergence of seemingly omnipotent vision-language models has finally enabled text-based interfaces for creating and editing images. Handling generic images requires a…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Omri Avrahami , Ohad Fried , Dani Lischinski

Recent advancements in text-to-image models, particularly diffusion models, have shown significant promise. However, compositional text-to-image models frequently encounter difficulties in generating high-quality images that accurately…

计算机视觉与模式识别 · 计算机科学 2023-10-11 Song Wen , Guian Fang , Renrui Zhang , Peng Gao , Hao Dong , Dimitris Metaxas

Generative 3D Painting is among the top productivity boosters in high-resolution 3D asset management and recycling. Ever since text-to-image models became accessible for inference on consumer hardware, the performance of 3D Painting methods…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Tianfu Wang , Anton Obukhov , Konrad Schindler

Controllable image synthesis with user scribbles has gained huge public interest with the recent advent of text-conditioned latent diffusion models. The user scribbles control the color composition while the text prompt provides control…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Jaskirat Singh , Stephen Gould , Liang Zheng