中文
相关论文

相关论文: Switti: Designing Scale-Wise Transformers for Text…

200 篇论文

Recent text-to-image (T2I) diffusion models achieve remarkable realism, yet faithful prompt-image alignment remains challenging, particularly for complex prompts with multiple objects, relations, and fine-grained attributes. Existing…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Liyao Jiang , Ruichen Chen , Chao Gao , Di Niu

Although progress has been made for text-to-image synthesis, previous methods fall short of generalizing to unseen or underrepresented attribute compositions in the input text. Lacking compositionality could have severe implications for…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Zhiheng Li , Martin Renqiang Min , Kai Li , Chenliang Xu

Scaling Text-to-speech (TTS) to large-scale datasets has been demonstrated as an effective method for improving the diversity and naturalness of synthesized speech. At the high level, previous large-scale TTS models can be categorized into…

While text-to-image (T2I) models can synthesize high-quality images, their performance degrades significantly when prompted with novel or out-of-distribution (OOD) entities due to inherent knowledge cutoffs. We introduce World-To-Image, a…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Moo Hyun Son , Jintaek Oh , Sun Bin Mun , Jaechul Roh , Sehyun Choi

Representation Autoencoders (RAEs) have shown distinct advantages in diffusion modeling on ImageNet by training in high-dimensional semantic latent spaces. In this work, we investigate whether this framework can scale to large-scale,…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Shengbang Tong , Boyang Zheng , Ziteng Wang , Bingda Tang , Nanye Ma , Ellis Brown , Jihan Yang , Rob Fergus , Yann LeCun , Saining Xie

Diffusion models (DMs) have recently gained attention with state-of-the-art performance in text-to-image synthesis. Abiding by the tradition in deep learning, DMs are trained and evaluated on the images with fixed sizes. However, users are…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Zhiyu Jin , Xuli Shen , Bin Li , Xiangyang Xue

Recent advancements in text-to-image (T2I) generative models have shown remarkable capabilities in producing diverse and imaginative visuals based on text prompts. Despite the advancement, these diffusion models sometimes struggle to…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Xiaohui Chen , Yongfei Liu , Yingxiang Yang , Jianbo Yuan , Quanzeng You , Li-Ping Liu , Hongxia Yang

Text-to-image (T2I) generation has advanced rapidly, making reliable evaluation critical as performance differences between models narrow. Existing evaluation practices typically apply uniform annotation mechanisms, such as Likert-scale or…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Abdelrahman Eldesokey , Merey Ramazanova , Ahmad Sait , Ansar Khangeldin , Karen Sanchez , Tong Zhang , Bernard Ghanem

Text-to-image (T2I) diffusion/flow models have drawn considerable attention recently due to their remarkable ability to deliver flexible visual creations. Still, high-resolution image synthesis presents formidable challenges due to the…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Jiazi Bu , Pengyang Ling , Yujie Zhou , Pan Zhang , Tong Wu , Xiaoyi Dong , Yuhang Zang , Yuhang Cao , Dahua Lin , Jiaqi Wang

Text-to-speech(TTS) has undergone remarkable improvements in performance, particularly with the advent of Denoising Diffusion Probabilistic Models (DDPMs). However, the perceived quality of audio depends not solely on its content, pitch,…

音频与语音处理 · 电气工程与系统科学 2024-04-23 Huadai Liu , Rongjie Huang , Xuan Lin , Wenqiang Xu , Maozong Zheng , Hong Chen , Jinzheng He , Zhou Zhao

The recent wave of AI-generated content has witnessed the great development and success of Text-to-Image (T2I) technologies. By contrast, Text-to-Video (T2V) still falls short of expectations though attracting increasing interests. Existing…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Zhen Xing , Qi Dai , Han Hu , Zuxuan Wu , Yu-Gang Jiang

Large text-to-image models demonstrate impressive generation capabilities; however, their substantial size necessitates expensive cloud servers for deployment. Conversely, light-weight models can be deployed on edge devices at lower cost…

计算机视觉与模式识别 · 计算机科学 2025-08-22 Zewei Xin , Qinya Li , Chaoyue Niu , Fan Wu , Guihai Chen

As recent advances in large-scale Text-to-Image (T2I) diffusion models have yielded remarkable high-quality image generation, diverse downstream Image-to-Image (I2I) applications have emerged. Despite the impressive results achieved by…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Geonung Kim , Beomsu Kim , Eunhyeok Park , Sunghyun Cho

Text-to-image (T2I) generative models have recently emerged as a powerful tool, enabling the creation of photo-realistic images and giving rise to a multitude of applications. However, the effective integration of T2I models into…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Zhicai Wang , Longhui Wei , Tan Wang , Heyu Chen , Yanbin Hao , Xiang Wang , Xiangnan He , Qi Tian

In-context generation significantly enhances Diffusion Transformers (DiTs) by enabling controllable image-to-image generation through reference examples. However, the resulting input concatenation drastically increases sequence length,…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Junqing Lin , Xingyu Zheng , Pei Cheng , Bin Fu , Jingwei Sun , Guangzhong Sun

Test-time scaling (TTS) has demonstrated remarkable success in enhancing large language models, yet its application to next-token prediction (NTP) autoregressive (AR) image generation remains largely uncharted. Existing TTS approaches for…

计算机视觉与模式识别 · 计算机科学 2026-01-07 Harold Haodong Chen , Xianfeng Wu , Wen-Jie Shu , Rongjin Guo , Disen Lan , Harry Yang , Ying-Cong Chen

This survey reviews the progress of diffusion models in generating images from text, ~\textit{i.e.} text-to-image diffusion models. As a self-contained work, this survey starts with a brief introduction of how diffusion models work for…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Chenshuang Zhang , Chaoning Zhang , Mengchun Zhang , In So Kweon , Junmo Kim

We address the problem of interactive text-to-image (T2I) generation, designing a reinforcement learning (RL) agent which iteratively improves a set of generated images for a user through a sequence of prompt expansions. Using human raters,…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Ofir Nabati , Guy Tennenholtz , ChihWei Hsu , Moonkyung Ryu , Deepak Ramachandran , Yinlam Chow , Xiang Li , Craig Boutilier

Large-scale text encoders in text-to-image (T2I) diffusion models have demonstrated exceptional performance in generating high-quality images from textual prompts. Unlike denoising modules that rely on multiple iterative steps, text…

机器学习 · 计算机科学 2025-02-14 Hoigi Seo , Wongi Jeong , Jae-sun Seo , Se Young Chun

Recent advances in diffusion models have significantly enhanced their ability to generate high-quality images and videos, but they have also increased the risk of producing unsafe content. Existing unlearning/editing-based methods for safe…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Jaehong Yoon , Shoubin Yu , Vaidehi Patil , Huaxiu Yao , Mohit Bansal