English
Related papers

Related papers: Anchor Token Matching: Implicit Structure Locking …

200 papers

Instruction-based image editing (IIE) aims to modify images according to textual instructions while preserving irrelevant content. Despite recent advances in diffusion transformers, existing methods often suffer from over-editing,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Jingxuan He , Xiyu Wang , Mengyu Zheng , Xiangyu Zeng , Yunke Wang , Chang Xu

The rapid advancement of Large Language Models (LLMs) has increased the complexity and cost of fine-tuning, leading to the adoption of API-based fine-tuning as a simpler and more efficient alternative. While this method is popular among…

Computation and Language · Computer Science 2025-03-17 Hongyu Su , Yifeng Gao , Yifan Ding , Xingjun Ma

Diffusion and flow matching models have significantly advanced media generation, yet their design space is well-explored, somewhat limiting further improvements. Concurrently, autoregressive (AR) models, particularly those generating…

Machine Learning · Computer Science 2025-07-01 Neta Shaul , Uriel Singer , Itai Gat , Yaron Lipman

Employing LLMs for visual generation has recently become a research focus. However, the existing methods primarily transfer the LLM architecture to visual generation but rarely investigate the fundamental differences between language and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Teng Hu , Jiangning Zhang , Ran Yi , Jieyu Weng , Yabiao Wang , Xianfang Zeng , Zhucun Xue , Lizhuang Ma

In-context image generation and editing (ICGE) enables users to specify visual concepts through interleaved image-text prompts, demanding precise understanding and faithful execution of user intent. Although recent unified multimodal models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Runze He , Yiji Cheng , Tiankai Hang , Zhimin Li , Yu Xu , Zijin Yin , Shiyi Zhang , Wenxun Dai , Penghui Du , Ao Ma , Chunyu Wang , Qinglin Lu , Jizhong Han , Jiao Dai

In this report, we explore the potential for text diffusion to replace autoregressive (AR) decoding for the training and deployment of large language models (LLMs). We are particularly interested to see whether pretrained AR models can be…

Computation and Language · Computer Science 2024-01-31 Kehang Han , Kathleen Kenealy , Aditya Barua , Noah Fiedel , Noah Constant

Large-scale text-to-image generative models have been a ground-breaking development in generative AI, with diffusion models showing their astounding ability to synthesize convincing images following an input text prompt. The goal of image…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Kai Wang , Fei Yang , Shiqi Yang , Muhammad Atif Butt , Joost van de Weijer

Diffusion language models (DLMs) have recently demonstrated capabilities that complement standard autoregressive (AR) models, particularly in non-sequential generation and bidirectional editing. Although recent work has shown that…

Machine Learning · Computer Science 2026-05-11 Fred Zhangzhi Peng , Alexis Fox , Anru R. Zhang , Alexander Tong

Diffusion-based image editing offers strong semantic controllability, but remains computationally expensive due to iterative high-resolution denoising over all spatial tokens. Dynamic-resolution sampling reduces this cost by performing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zhengan Yan , Shikang Zheng , Haoran Qin , Xiaobing Tu , Yinggui Wang , Jiacheng Liu , Jiaxuan Ren , Yuqi Lin , Peiliang Cai , Jinkui Ren , Xiantao Zhang , Linfeng Zhang

Generative models have been very popular in the recent years for their image generation capabilities. GAN-based models are highly regarded for their disentangled latent space, which is a key feature contributing to their success in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yusuf Dalva , Pinar Yanardag

Recent training-free layout-to-image diffusion models have demonstrated remarkable performance in generating high-quality images with controllable layouts. These models follow a one-stage framework: Encouraging the model to focus the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Linhao Huang , Jing Yu

The rapid evolution of image generation models has revolutionized visual content creation, enabling the synthesis of highly realistic and contextually accurate images for diverse applications. However, the potential for misuse, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Yihan Wu , Xuehao Cui , Ruibo Chen , Georgios Milis , Heng Huang

Low-Rank Adaptation (LoRA) has emerged as a leading technique for efficiently fine-tuning text-to-image diffusion models, and its widespread adoption on open-source platforms has fostered a vibrant culture of model sharing and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Liangwei Lyu , Jiaqi Xu , Jianwei Ding , Qiyao Deng

Recently, AutoRegressive (AR) models for the whole image generation empowered by transformers have achieved comparable or even better performance to Generative Adversarial Networks (GANs). Unfortunately, directly applying such AR models to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Chenjie Cao , Yuxin Hong , Xiang Li , Chengrong Wang , Chengming Xu , XiangYang Xue , Yanwei Fu

Recent advancements in diffusion models have made generative image editing more accessible, enabling creative edits but raising ethical concerns, particularly regarding malicious edits to human portraits that threaten privacy and identity…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Hanhui Wang , Yihua Zhang , Ruizheng Bai , Yue Zhao , Sijia Liu , Zhengzhong Tu

Text-to-image diffusion models often make implicit assumptions about the world when generating images. While some assumptions are useful (e.g., the sky is blue), they can also be outdated, incorrect, or reflective of social biases present…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Hadas Orgad , Bahjat Kawar , Yonatan Belinkov

Generative models have been widely studied in computer vision. Recently, diffusion models have drawn substantial attention due to the high quality of their generated images. A key desired property of image generative models is the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Qiucheng Wu , Yujian Liu , Handong Zhao , Ajinkya Kale , Trung Bui , Tong Yu , Zhe Lin , Yang Zhang , Shiyu Chang

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua

Professional photo editing remains challenging, requiring extensive knowledge of imaging pipelines and significant expertise. While recent deep learning approaches, particularly style transfer methods, have attempted to automate this…

Image and Video Processing · Electrical Eng. & Systems 2025-12-11 Omar Elezabi , Marcos V. Conde , Zongwei Wu , Radu Timofte

The generative AI revolution has recently expanded to videos. Nevertheless, current state-of-the-art video models are still lagging behind image models in terms of visual quality and user control over the generated content. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Michal Geyer , Omer Bar-Tal , Shai Bagon , Tali Dekel