中文
相关论文

相关论文: UniVG: A Generalist Diffusion Model for Unified Im…

200 篇论文

Although significant advancements have been achieved in the progress of keypoint-guided Text-to-Image diffusion models, existing mainstream keypoint-guided models encounter challenges in controlling the generation of more general non-rigid…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Qin Guo , Ailing Zeng , Dongxu Yue , Ceyuan Yang , Yang Cao , Hanzhong Guo , Fei Shen , Wei Liu , Xihui Liu , Dan Xu

Recent years have seen remarkable progress in both multimodal understanding models and image generation models. Despite their respective successes, these two domains have evolved independently, leading to distinct architectural paradigms:…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Shanshan Zhao , Xinjie Zhang , Jintao Guo , Jiakui Hu , Lunhao Duan , Minghao Fu , Yong Xien Chng , Guo-Hua Wang , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang

Recently, text-to-image denoising diffusion probabilistic models (DDPMs) have demonstrated impressive image generation capabilities and have also been successfully applied to image inpainting. However, in practice, users often require more…

计算机视觉与模式识别 · 计算机科学 2023-10-12 Shiyuan Yang , Xiaodong Chen , Jing Liao

Taking advantage of the many recent advances in deep learning, text-to-image generative models currently have the merit of attracting the general public attention. Two of these models, DALL-E 2 and Imagen, have demonstrated that highly…

计算机视觉与模式识别 · 计算机科学 2022-09-23 Robin Zbinden

Text-to-image (T2I) diffusion models have revolutionized generative modeling by producing high-fidelity, diverse, and visually realistic images from textual prompts. Despite these advances, existing models struggle with complex prompts…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Eric Hanchen Jiang , Yasi Zhang , Zhi Zhang , Yixin Wan , Andrew Lizarraga , Shufan Li , Ying Nian Wu

Text-to-image synthesis has made significant progress, benefiting from the strong generative capabilities of diffusion models. However, these models struggle to achieve precise text-to-image alignment within cross-attention maps during the…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Shipeng Cao , Biao Qian , Haipeng Liu , Yang Wang , Meng Wang

Generating visual instructions in a given context is essential for developing interactive world simulators. While prior works address this problem through either text-guided image manipulation or video prediction, these tasks are typically…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Yujiang Pu , Zhanbo Huang , Vishnu Boddeti , Yu Kong

Large-scale Text-to-Image (T2I) diffusion models demonstrate significant generation capabilities based on textual prompts. Based on the T2I diffusion models, text-guided image editing research aims to empower users to manipulate generated…

计算机视觉与模式识别 · 计算机科学 2024-05-03 Chuanming Tang , Kai Wang , Fei Yang , Joost van de Weijer

With recent advances in Multimodal Large Language Models (MLLMs) showing strong visual understanding and reasoning, interest is growing in using them to improve the editing performance of diffusion models. Despite rapid progress, most…

计算机视觉与模式识别 · 计算机科学 2025-10-10 Chong Mou , Qichao Sun , Yanze Wu , Pengze Zhang , Xinghui Li , Fulong Ye , Songtao Zhao , Qian He

The recent popularity of text-to-image diffusion models (DM) can largely be attributed to the intuitive interface they provide to users. The intended generation can be expressed in natural language, with the model producing faithful…

An unpaired image-to-image (I2I) translation technique seeks to find a mapping between two domains of data in a fully unsupervised manner. While initial solutions to the I2I problem were provided by generative adversarial neural networks…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Dmitrii Torbunov , Yi Huang , Huan-Hsin Tseng , Haiwang Yu , Jin Huang , Shinjae Yoo , Meifeng Lin , Brett Viren , Yihui Ren

We present Qwen-Image-2.0, an omni-capable image generation foundation model that unifies high-fidelity generation and precise image editing within a single framework. Despite recent progress, existing models still struggle with ultra-long…

Unified multimodal models have shown promising results in multimodal content generation and editing but remain largely limited to the image domain. In this work, we present UniVideo, a versatile framework that extends unified modeling to…

计算机视觉与模式识别 · 计算机科学 2026-01-08 Cong Wei , Quande Liu , Zixuan Ye , Qiulin Wang , Xintao Wang , Pengfei Wan , Kun Gai , Wenhu Chen

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Although text-to-image (T2I) models have recently thrived as visual generative priors, their reliance on high-quality text-image pairs makes scaling up expensive. We argue that grasping the cross-modality alignment is not a necessity for a…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Shuailei Ma , Kecheng Zheng , Ying Wei , Wei Wu , Fan Lu , Yifei Zhang , Chen-Wei Xie , Biao Gong , Jiapeng Zhu , Yujun Shen

Recent advances in image editing have been driven by the development of denoising diffusion models, marking a significant leap forward in this field. Despite these advances, the generalization capabilities of recent image editing approaches…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Zichong Meng , Changdi Yang , Jun Liu , Hao Tang , Pu Zhao , Yanzhi Wang

Leveraging text, images, structure maps, or motion trajectories as conditional guidance, diffusion models have achieved great success in automated and high-quality video generation. However, generating smooth and rational transition videos…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Zuhao Yang , Jiahui Zhang , Yingchen Yu , Shijian Lu , Song Bai

Generative text-to-image (TTI) models produce high-quality images from short textual descriptions and are widely used in academic and creative domains. Like humans, TTI models have a worldview, a conception of the world learned from their…

机器学习 · 计算机科学 2024-02-06 Zoe De Simone , Angie Boggust , Arvind Satyanarayan , Ashia Wilson

The generative AI revolution has recently expanded to videos. Nevertheless, current state-of-the-art video models are still lagging behind image models in terms of visual quality and user control over the generated content. In this work, we…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Michal Geyer , Omer Bar-Tal , Shai Bagon , Tali Dekel

We introduce a framework for joint grounded scene graph - image generation, a challenging task involving high-dimensional, multi-modal structured data. To effectively model this complex joint distribution, we adopt a factorized approach:…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Bicheng Xu , Qi Yan , Renjie Liao , Lele Wang , Leonid Sigal