English
Related papers

Related papers: FreeFlux: Understanding and Exploiting Layer-Speci…

200 papers

Text-to-image diffusion models have made significant progress in image generation, allowing for effortless customized generation. However, existing image editing methods still face certain limitations when dealing with personalized image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yuhong Zhang , Han Wang , Yiwen Wang , Rong Xie , Li Song

Reference-guided image generation has progressed rapidly, yet current diffusion models still struggle to preserve fine-grained visual details when refining a generated image using a reference. This limitation arises because VAE-based latent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yaoli Liu , Ziheng Ouyang , Shengtao Lou , Yiren Song

Despite the rapid adoption of text-to-image (T2I) diffusion models, causal and representation-level analysis remains fragmented and largely limited to isolated probing techniques. To address this gap, we introduce DreamReader: a unified…

Text-to-image synthesis has witnessed remarkable advancements in recent years. Many attempts have been made to adopt text-to-image models to support multiple tasks. However, existing approaches typically require resource-intensive…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ruchika Chavhan , Abhinav Mehrotra , Malcolm Chadwick , Alberto Gil Ramos , Luca Morreale , Mehdi Noroozi , Sourav Bhattacharya

Starting from flow- and diffusion-based transformers, Multi-modal Diffusion Transformers (MM-DiTs) have reshaped text-to-vision generation, gaining acclaim for exceptional visual fidelity. As these models advance, users continually push the…

Artificial Intelligence · Computer Science 2025-10-07 Seil Kang , Woojung Han , Dayun Ju , Seong Jae Hwang

Recently, how to achieve precise image editing has attracted increasing attention, especially given the remarkable success of text-to-image generation models. To unify various spatial-aware image editing abilities into one framework, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yueru Jia , Yuhui Yuan , Aosong Cheng , Chuke Wang , Ji Li , Huizhu Jia , Shanghang Zhang

Despite their generative power, diffusion models struggle to maintain style consistency across images conditioned on the same style prompt, hindering their practical deployment in creative workflows. While several training-free methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Jiexuan Zhang , Yiheng Du , Qian Wang , Weiqi Li , Yu Gu , Jian Zhang

Recent advances in 3D Large Multimodal Models (LMMs) built on Large Language Models (LLMs) have established the alignment of 3D visual features with LLM representations as the dominant paradigm. However, the inherited Rotary Position…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Guanting Ye , Qiyan Zhao , Wenhao Yu , Xiaofeng Zhang , Jianmin Ji , Yanyong Zhang , Ka-Veng Yuen

Controllable image generation is fundamental to the success of modern generative AI, yet it faces a critical trade-off between semantic fidelity and inference speed. The RemEdit diffusion-based framework addresses this trade-off with two…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Eashan Adhikarla , Brian D. Davison

Achieving flexible and high-fidelity identity-preserved image generation remains formidable, particularly with advanced Diffusion Transformers (DiTs) like FLUX. We introduce InfiniteYou (InfU), one of the earliest robust frameworks…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Liming Jiang , Qing Yan , Yumin Jia , Zichuan Liu , Hao Kang , Xin Lu

This paper presents ThinkDiff, a novel alignment paradigm that empowers text-to-image diffusion models with multimodal in-context understanding and reasoning capabilities by integrating the strengths of vision-language models (VLMs).…

Machine Learning · Computer Science 2025-02-18 Zhenxing Mi , Kuan-Chieh Wang , Guocheng Qian , Hanrong Ye , Runtao Liu , Sergey Tulyakov , Kfir Aberman , Dan Xu

Layered image generation and editing is a fundamental capability that enables layer-wise reuse, editing, and composition of generated visual content, analogous to word-level editing in natural language. Despite its importance, this remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zhicong Tang , Zhao Zhang , Jingye Chen , Mohan Zhou , Yifan Pu , Yuchi Liu , Yalong Bai , Ethan Smith , Yuhui Yuan

Real-world design documents (e.g., posters) are inherently multi-layered, combining decoration, text, and images. Editing them from natural-language instructions requires fine-grained, layer-aware reasoning to identify relevant layers and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zihao Lin , Wanrong Zhu , Jiuxiang Gu , Jihyung Kil , Christopher Tensmeyer , Lin Zhang , Shilong Liu , Ruiyi Zhang , Lifu Huang , Vlad I. Morariu , Tong Sun

Diffusion Transformer models have significantly advanced image editing by encoding conditional images and integrating them into transformer layers. However, most edits involve modifying only small regions, while current methods uniformly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Zhibin Qin , Zhenxiong Tan , Zeqing Wang , Songhua Liu , Xinchao Wang

Fine-tuning large language models is essential for task-specific adaptation, yet it remains computationally prohibitive. Parameter-Efficient Fine-Tuning (PEFT) methods have emerged as a solution, but current approaches typically ignore the…

Computation and Language · Computer Science 2025-12-01 Dayan Pan , Jingyuan Wang , Yilong Zhou , Jiawei Cheng , Pengyue Jia , Xiangyu Zhao

Inspired by the software industry's practice of offering different editions or versions of a product tailored to specific user groups or use cases, we propose a novel task, namely, training-free editioning, for text-to-image models.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Jinqi Wang , Yunfei Fu , Zhangcan Ding , Bailin Deng , Yu-Kun Lai , Yipeng Qin

This paper presents a novel approach to improving text-guided image editing using diffusion-based models. Text-guided image editing task poses key challenge of precisly locate and edit the target semantic, and previous methods fall shorts…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yihan Hu , Jianing Peng , Yiheng Lin , Ting Liu , Xiaochao Qu , Luoqi Liu , Yao Zhao , Yunchao Wei

The recent popularity of text-to-image diffusion models (DM) can largely be attributed to the intuitive interface they provide to users. The intended generation can be expressed in natural language, with the model producing faithful…

Recently, several point-based image editing methods (e.g., DragDiffusion, FreeDrag, DragNoise) have emerged, yielding precise and high-quality results based on user instructions. However, these methods often make insufficient use of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 DuoSheng Chen , Binghui Chen , Yifeng Geng , Liefeng Bo

Prompt engineering is still the primary way for users of generative text-to-image models to manipulate generated images in a targeted way. Based on treating the model as a continuous function and by passing gradients between the image space…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Niklas Deckers , Julia Peters , Martin Potthast