English
Related papers

Related papers: FreeFlux: Understanding and Exploiting Layer-Speci…

200 papers

Existing instruction-based image editing models perform well with simple, single-step instructions but degrade in realistic scenarios that involve multiple, lengthy, and interdependent directives. A main cause is the scarcity of training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zhaoyuan Qiu , Ken Chen , Xiangwei Wang , Yu Xia , Sachith Seneviratne , Saman Halgamuge

Image restoration (IR) aims to recover images degraded by unknown mixtures while preserving semanticsconditions under which discriminative restorers and UNet-based diffusion priors often oversmooth, hallucinate, or drift. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Song Fei , Tian Ye , Lujia Wang , Lei Zhu

Positional encoding is essential for large language models (LLMs) to represent sequence order, yet recent studies show that Rotary Position Embedding (RoPE) can induce massive activation. We investigate the source of these instabilities via…

Computation and Language · Computer Science 2026-01-07 Jing Xiong , Liyang Fan , Hui Shen , Zunhai Su , Min Yang , Lingpeng Kong , Ngai Wong

Training-free image editing with large diffusion models has become practical, yet faithfully performing complex non-rigid edits (e.g., pose or shape changes) remains highly challenging. We identify a key underlying cause: attention collapse…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Zhuo Chen , Fanyue Wei , Runze Xu , Jingjing Li , Lixin Duan , Angela Yao , Wen Li

Diffusion models have shown superior performance in image generation and manipulation, but the inherent stochasticity presents challenges in preserving and manipulating image content and identity. While previous approaches like DreamBooth…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Inhwa Han , Serin Yang , Taesung Kwon , Jong Chul Ye

Text-to-image diffusion models often face a severe trilemma in human portrait generation: text-image alignment, photorealism, and human-perceived aesthetics inherently inhibit one another. Supervised Fine-Tuning (SFT) is an effective method…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Yunlong Wang , Jinjin Shi , Wenbin Gao , Xuran Xu , Runyu Shi , Ying Huang

Text-guided image generation enables the creation of visual content from textual descriptions. However, certain visual concepts cannot be effectively conveyed through language alone. This has sparked a renewed interest in utilizing the CLIP…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Elad Richardson , Yuval Alaluf , Ali Mahdavi-Amiri , Daniel Cohen-Or

Discrete diffusion models are a new class of text generators that offer advantages such as bidirectional context use, parallelizable generation, and flexible prompting compared to autoregressive models. However, a critical limitation of…

Machine Learning · Computer Science 2025-10-23 Andrew Zhang , Anushka Sivakumar , Chiawei Tang , Chris Thomas

Multimodal Large Language Models (MLLMs) achieve strong performance through instruction tuning, yet real-world deployment often requires continual capability expansion across sequential tasks. In such scenarios, Multimodal Continual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tao Hu , Da-Wei Zhou

Image editing technologies are tools used to transform, adjust, remove, or otherwise alter images. Recent research has significantly improved the capabilities of image editing tools, enabling the creation of photorealistic and semantically…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Quang Nguyen , Truong Vu , Trong-Tung Nguyen , Yuxin Wen , Preston K Robinette , Taylor T Johnson , Tom Goldstein , Anh Tran , Khoi Nguyen

Recent advancements in text-guided diffusion models have unlocked powerful image manipulation capabilities, yet balancing reconstruction fidelity and editability for real images remains a significant challenge. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Yangyang Xu , Wenqi Shao , Yong Du , Haiming Zhu , Yang Zhou , Ping Luo , Shengfeng He

Natural language offers a highly intuitive interface for image editing. In this paper, we introduce the first solution for performing local (region-based) edits in generic natural images, based on a natural language description along with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Omri Avrahami , Dani Lischinski , Ohad Fried

Text-guided image editing has advanced rapidly with the rise of diffusion models. While flow-based inversion-free methods offer high efficiency by avoiding latent inversion, they often fail to effectively integrate source information,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Kaixiang Yang , Boyang Shen , Xin Li , Yuchen Dai , Yuxuan Luo , Yueran Ma , Wei Fang , Qiang Li , Zhiwei Wang

Deep learning-based image enhancement methods face a fundamental trade-off between computational efficiency and representational capacity. For example, although a conventional three-dimensional Look-Up Table (3D LUT) can process a degraded…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Liubing Hu , Chen Wu , Anrui Wang , Dianjie Lu , Guijuan Zhang , Zhuoran Zheng

Rotary Position Embedding (RoPE) is the de facto positional encoding in large language models due to its ability to encode relative positions and support length extrapolation. When adapted to vision transformers, the standard axial…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Haoyu Liu , Sucheng Ren , Tingyu Zhu , Peng Wang , Cihang Xie , Alan Yuille , Zeyu Zheng , Feng Wang

We introduce Reflectance Diffusion, a new neural text-to-texture model capable of generating high-fidelity SVBRDF maps from textual descriptions. Our method leverages a tandem neural approach, consisting of two modules, to accurately model…

Graphics · Computer Science 2026-01-21 Bowen Xue , Giuseppe Claudio Guarnera , Shuang Zhao , Zahra Montazeri

Text-to-image diffusion models often exhibit degraded performance when generating images beyond their training resolution. Recent training-free methods can mitigate this limitation, but they often require substantial computation or are…

Machine Learning · Computer Science 2025-10-31 Sungho Koh , SeungJu Cha , Hyunwoo Oh , Kwanyoung Lee , Dong-Jin Kim

Image fusion seeks to seamlessly integrate foreground objects with background scenes, producing realistic and harmonious fused images. Unlike existing methods that directly insert objects into the background, adaptive and interactive fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Junjia Huang , Pengxiang Yan , Jiyang Liu , Jie Wu , Zhao Wang , Yitong Wang , Liang Lin , Guanbin Li

We present MMCORE, a unified framework designed for multimodal image generation and editing. MMCORE leverages a pre-trained Vision-Language Model (VLM) to predict semantic visual embeddings via learnable query tokens, which subsequently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Zijie Li , Yichun Shi , Jingxiang Sun , Ye Wang , Yixuan Huang , Zhiyao Guo , Xiaochen Lian , Peihao Zhu , Yu Tian , Zhonghua Zhai , Peng Wang

Diffusion models (DMs) have revolutionized image generation, producing high-quality images with applications spanning various fields. However, their ability to create hyper-realistic images poses significant challenges in distinguishing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Santosh , Li Lin , Irene Amerini , Xin Wang , Shu Hu