中文
相关论文

相关论文: Trade-offs in Image Generation: How Do Different D…

200 篇论文

Text-to-image (T2I) diffusion models have become prominent tools for generating high-fidelity images from text prompts. However, when trained on unfiltered internet data, these models can produce unsafe, incorrect, or stylistically…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Rohit Jena , Ali Taghibakhshi , Sahil Jain , Gerald Shen , Nima Tajbakhsh , Arash Vahdat

Unified multimodal generation architectures that jointly produce text and images have recently emerged as a promising direction for text-to-image (T2I) synthesis. However, many existing systems rely on explicit modality switching,…

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models often struggle with simple or underspecified prompts, leading to suboptimal image-text alignment, aesthetics, and quality. We propose a…

计算与语言 · 计算机科学 2025-10-16 Ruibo Chen , Jiacheng Pan , Heng Huang , Zhenheng Yang

Video generation models are revolutionizing content creation, with image-to-video models drawing increasing attention due to their enhanced controllability, visual consistency, and practical applications. However, despite their popularity,…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Wenhao Wang , Yi Yang

We propose MVGBench, a comprehensive benchmark for multi-view image generation models (MVGs) that evaluates 3D consistency in geometry and texture, image quality, and semantics (using vision language models). Recently, MVGs have been the…

图形学 · 计算机科学 2025-07-02 Xianghui Xie , Chuhang Zou , Meher Gitika Karumuri , Jan Eric Lenssen , Gerard Pons-Moll

In this paper, we present an empirical study introducing a nuanced evaluation framework for text-to-image (T2I) generative models, applied to human image synthesis. Our framework categorizes evaluations into two distinct groups: first,…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Muxi Chen , Yi Liu , Jian Yi , Changran Xu , Qiuxia Lai , Hongliang Wang , Tsung-Yi Ho , Qiang Xu

Text-to-image (T2I) generation has seen significant growth over the past few years. Despite this, there has been little work on generating diagrams with T2I models. A diagram is a symbolic/schematic representation that explains information…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Abhay Zala , Han Lin , Jaemin Cho , Mohit Bansal

Text-to-image (T2I) diffusion models have achieved strong performance in semantic alignment, yet they still struggle with generating the correct number of objects specified in prompts. Existing approaches typically incorporate auxiliary…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Nobline Yoo , Olga Russakovsky , Ye Zhu

Text-to-image (T2I) synthesis has recently achieved significant advancements. However, challenges remain in the model's compositionality, which is the ability to create new combinations from known components. We introduce Winoground-T2I, a…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Xiangru Zhu , Penglei Sun , Chengyu Wang , Jingping Liu , Zhixu Li , Yanghua Xiao , Jun Huang

The progress in the generation of synthetic images has made it crucial to assess their quality. While several metrics have been proposed to assess the rendering of images, it is crucial for Text-to-Image (T2I) models, which generate images…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Paul Grimal , Hervé Le Borgne , Olivier Ferret , Julien Tourille

Deep generative models have shown impressive results in text-to-image synthesis. However, current text-to-image models often generate images that are inadequately aligned with text prompts. We propose a fine-tuning method for aligning such…

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this…

计算机视觉与模式识别 · 计算机科学 2018-08-03 Hsin-Ying Lee , Hung-Yu Tseng , Jia-Bin Huang , Maneesh Kumar Singh , Ming-Hsuan Yang

Large diffusion-based Text-to-Image (T2I) models have shown impressive generative powers for text-to-image generation as well as spatially conditioned image generation. For most applications, we can train the model end-toend with paired…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Nithin Gopalakrishnan Nair , Jeya Maria Jose Valanarasu , Vishal M Patel

Unified multimodal models have recently demonstrated strong generative capabilities, yet whether and when generation improves understanding remains unclear. Existing benchmarks lack a systematic exploration of the specific tasks where…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Zimo Wen , Boxiu Li , Wanbo Zhang , Junxiang Lei , Xiaoyu Chen , Yijia Fan , Qi Zhang , Yujiang Wang , Lili Qiu , Bo Li , Ziwei Liu , Caihua Shan , Yifan Yang , Yifei Shen

General text-to-image models bring revolutionary innovation to the fields of arts, design, and media. However, when applied to garment generation, even the state-of-the-art text-to-image models suffer from fine-grained semantic…

计算机视觉与模式识别 · 计算机科学 2024-08-26 Shiyue Zhang , Zheng Chong , Xujie Zhang , Hanhui Li , Yuhao Cheng , Yiqiang Yan , Xiaodan Liang

Masked image modeling (MIM) has emerged as a promising approach for pre-training Vision Transformers (ViTs). MIMs predict masked tokens token-wise to recover target signals that are tokenized from images or generated by pre-trained models…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Taekyung Kim , Byeongho Heo , Dongyoon Han

The image-to-image translation abilities of generative learning models have recently made significant progress in the estimation of complex (steered) mappings between image distributions. While appearance based tasks like image in-painting…

计算机视觉与模式识别 · 计算机科学 2025-03-10 Martin Spitznagel , Jan Vaillant , Janis Keuper

With the continuous advancement of image generation technology, advanced models such as GPT-Image-1 and Qwen-Image have achieved remarkable text-to-image consistency and world knowledge However, these models still fall short in…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Junyan Ye , Leiqi Zhu , Yuncheng Guo , Dongzhi Jiang , Zilong Huang , Yifan Zhang , Zhiyuan Yan , Haohuan Fu , Conghui He , Weijia Li

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for this task: 1) lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this work, we…

计算机视觉与模式识别 · 计算机科学 2019-12-19 Hsin-Ying Lee , Hung-Yu Tseng , Qi Mao , Jia-Bin Huang , Yu-Ding Lu , Maneesh Singh , Ming-Hsuan Yang

Previous work on augmenting large multimodal models (LMMs) for text-to-image (T2I) generation has focused on enriching the input space of in-context learning (ICL). This includes providing a few demonstrations and optimizing image…

计算与语言 · 计算机科学 2025-01-14 Yongyu Mu , Hengyu Li , Junxin Wang , Xiaoxuan Zhou , Chenglong Wang , Yingfeng Luo , Qiaozhi He , Tong Xiao , Guocheng Chen , Jingbo Zhu