中文
相关论文

相关论文: MaxFusion: Plug&Play Multi-Modal Generation in Tex…

200 篇论文

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

We present DiffCollage, a compositional diffusion model that can generate large content by leveraging diffusion models trained on generating pieces of the large content. Our approach is based on a factor graph representation where each…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Qinsheng Zhang , Jiaming Song , Xun Huang , Yongxin Chen , Ming-Yu Liu

Novel machine learning methods for tabular data generation are often developed on small datasets which do not match the scale required for scientific applications. We investigate a recent proposal to use XGBoost as the function approximator…

机器学习 · 计算机科学 2024-08-30 Jesse C. Cresswell , Taewoo Kim

Recent breakthroughs in text-to-image diffusion models have significantly advanced the generation of high-fidelity, photo-realistic images from textual descriptions. Yet, these models often struggle with interpreting spatial arrangements…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Jiaqi Liu , Tao Huang , Chang Xu

Text-to-image diffusion models have attracted considerable interest due to their wide applicability across diverse fields. However, challenges persist in creating controllable models for personalized object generation. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2023-06-30 Yuheng Li , Haotian Liu , Yangming Wen , Yong Jae Lee

Recent breakthroughs of transformer-based diffusion models, particularly with Multimodal Diffusion Transformers (MMDiT) driven models like FLUX and Qwen Image, have facilitated thrilling experiences in text-to-image generation and editing.…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Binglei Li , Mengping Yang , Zhiyu Tan , Junping Zhang , Hao Li

A significant ``modality gap" exists between the abundance of text-only data and the increasing power of multimodal models. This work systematically investigates whether images generated on-the-fly by Text-to-Image (T2I) models can serve as…

多媒体 · 计算机科学 2026-03-04 Yuesheng Huang , Peng Zhang , Xiaoxin Wu , Riliang Liu , Jiaqi Liang

Generative AI has demonstrated impressive performance in various fields, among which speech synthesis is an interesting direction. With the diffusion model as the most popular generative model, numerous works have attempted two active…

The success of agricultural artificial intelligence depends heavily on large, diverse, and high-quality plant image datasets, yet collecting such data in real field conditions is costly, labor intensive, and seasonally constrained. This…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Da Tan , Michael Beck , Christopher P. Bidinosti , Robert H. Gulden , Christopher J. Henry

With the open-sourcing of text-to-image models (T2I) such as stable diffusion (SD) and stable diffusion XL (SD-XL), there is an influx of models fine-tuned in specific domains based on the open-source SD model, such as in anime, character…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Ruyi Gan , Xiaojun Wu , Junyu Lu , Yuanhe Tian , Dixiang Zhang , Ziwei Wu , Renliang Sun , Chang Liu , Jiaxing Zhang , Pingjian Zhang , Yan Song

Recent spatial control methods for text-to-image (T2I) diffusion models have shown compelling results. However, these methods still fail to precisely follow the control conditions and generate the corresponding images, especially when…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Jiaze Wang , Rui Chen , Haowang Cui

Recent Text-to-Image (T2I) generation models such as Stable Diffusion and Imagen have made significant progress in generating high-resolution images based on text descriptions. However, many generated images still suffer from issues such as…

Textual image generation spans diverse fields like advertising, education, product packaging, social media, information visualization, and branding. Despite recent strides in language-guided image synthesis using diffusion models, current…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Shubham Paliwal , Arushi Jain , Monika Sharma , Vikram Jamwal , Lovekesh Vig

We introduce a novel approach for concept blending in pretrained text-to-image diffusion models, aiming to generate images at the intersection of multiple text prompts. At each time step during diffusion denoising, our algorithm forecasts…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Divya Kothandaraman , Ming Lin , Dinesh Manocha

Text-to-image generation executes a diffusion workflow comprising multiple models centered on a base diffusion model. Existing serving systems treat each workflow as an opaque monolith, provisioning, placing, and scaling all constituent…

分布式、并行与集群计算 · 计算机科学 2026-04-10 Lingyun Yang , Suyi Li , Tianyu Feng , Xiaoxiao Jiang , Zhipeng Di , Weiyi Lu , Kan Liu , Yinghao Yu , Tao Lan , Guodong Yang , Lin Qu , Liping Zhang , Wei Wang

In this work, we empirically study Diffusion Transformers (DiTs) for text-to-image generation, focusing on architectural choices, text-conditioning strategies, and training protocols. We evaluate a range of DiT-based…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Chen Chen , Rui Qian , Wenze Hu , Tsu-Jui Fu , Jialing Tong , Xinze Wang , Lezhi Li , Bowen Zhang , Alex Schwing , Wei Liu , Yinfei Yang

Generative depth estimation methods leverage the rich visual priors stored in pre-trained text-to-image diffusion models, demonstrating astonishing zero-shot capability. However, parameter updates during training lead to catastrophic…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Hongkai Lin , Dingkang Liang , Mingyang Du , Xin Zhou , Xiang Bai

Synthesizing visually impressive images that seamlessly align both text prompts and specific artistic styles remains a significant challenge in Text-to-Image (T2I) diffusion models. This paper introduces StyleBlend, a method designed to…

计算机视觉与模式识别 · 计算机科学 2025-02-14 Zichong Chen , Shijin Wang , Yang Zhou

Image-to-image (I2I) translation methods based on generative adversarial networks (GANs) typically suffer from overfitting when limited training data is available. In this work, we propose a data augmentation method (ReMix) to tackle this…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Jie Cao , Luanxuan Hou , Ming-Hsuan Yang , Ran He , Zhenan Sun

When humans read a specific text, they often visualize the corresponding images, and we hope that computers can do the same. Text-to-image synthesis (T2I), which focuses on generating high-quality images from textual descriptions, has…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Nonghai Zhang , Hao Tang