中文
相关论文

相关论文: UltraEdit: Instruction-based Fine-Grained Image Ed…

200 篇论文

Editing images via instruction provides a natural way to generate interactive content, but it is a big challenge due to the higher requirement of scene understanding and generation. Prior work utilizes a chain of large language models,…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Liya Ji , Chenyang Qi , Qifeng Chen

Large-scale text-to-video models have shown remarkable abilities, but their direct application in video editing remains challenging due to limited available datasets. Current video editing methods commonly require per-video fine-tuning of…

计算机视觉与模式识别 · 计算机科学 2024-06-06 Zhenghao Zhang , Zuozhuo Dai , Long Qin , Weizhi Wang

Introducing user-specified visual concepts in image editing is highly practical as these concepts convey the user's intent more precisely than text-based descriptions. We propose FreeEdit, a novel approach for achieving such reference-based…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Runze He , Kai Ma , Linjiang Huang , Shaofei Huang , Jialin Gao , Xiaoming Wei , Jiao Dai , Jizhong Han , Si Liu

With recent advances in Multimodal Large Language Models (MLLMs) showing strong visual understanding and reasoning, interest is growing in using them to improve the editing performance of diffusion models. Despite rapid progress, most…

计算机视觉与模式识别 · 计算机科学 2025-10-10 Chong Mou , Qichao Sun , Yanze Wu , Pengze Zhang , Xinghui Li , Fulong Ye , Songtao Zhao , Qian He

Recent advances in image editing models have demonstrated remarkable capabilities in executing explicit instructions, such as attribute manipulation, style transfer, and pose synthesis. However, these models often face challenges when…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Wang Lin , Feng Wang , Majun Zhang , Wentao Hu , Tao Jin , Zhou Zhao , Fei Wu , Jingyuan Chen , Alan Yuille , Sucheng Ren

High-quality training triplets (instruction, original image, edited image) are essential for instruction-based image editing. Predominant training datasets (e.g., InsPix2Pix) are created using text-to-image generative models (e.g., Stable…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Xin Gu , Ming Li , Libo Zhang , Fan Chen , Longyin Wen , Tiejian Luo , Sijie Zhu

Recent advances in diffusion models have revolutionized text-guided image editing, yet existing editing methods face critical challenges in hyperparameter identification. To get the reasonable editing performance, these methods often…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Chau Pham , Quan Dao , Mahesh Bhosale , Yunjie Tian , Dimitris Metaxas , David Doermann

Instruction-guided 3D editing is a rapidly emerging field with the potential to broaden access to 3D content creation. However, existing methods face critical limitations: optimization-based approaches are prohibitively slow, while…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Weiwei Cai , Shuangkang Fang , Weicai Ye , Xin Dong , Yunhan Yang , Xuanyang Zhang , Wei Cheng , Yanpei Cao , Gang Yu , Tao Chen

Recent advances in text-guided image editing enable users to perform image edits through simple text inputs, leveraging the extensive priors of multi-step diffusion-based text-to-image models. However, these methods often fall short of the…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Trong-Tung Nguyen , Quang Nguyen , Khoi Nguyen , Anh Tran , Cuong Pham

Text-driven image generation methods have shown impressive results recently, allowing casual users to generate high quality images by providing textual descriptions. However, similar capabilities for editing existing images are still out of…

计算机视觉与模式识别 · 计算机科学 2023-07-06 Dani Valevski , Matan Kalman , Eyal Molad , Eyal Segalis , Yossi Matias , Yaniv Leviathan

Diffusion model based language-guided image editing has achieved great success recently. However, existing state-of-the-art diffusion models struggle with rendering correct text and text style during generation. To tackle this problem, we…

计算机视觉与模式识别 · 计算机科学 2023-10-19 Haoxing Chen , Zhuoer Xu , Zhangxuan Gu , Jun Lan , Xing Zheng , Yaohui Li , Changhua Meng , Huijia Zhu , Weiqiang Wang

Image editing aims to edit the given synthetic or real image to meet the specific requirements from users. It is widely studied in recent years as a promising and challenging field of Artificial Intelligence Generative Content (AIGC).…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Xincheng Shuai , Henghui Ding , Xingjun Ma , Rongcheng Tu , Yu-Gang Jiang , Dacheng Tao

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

计算机视觉与模式识别 · 计算机科学 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Image editing technologies are tools used to transform, adjust, remove, or otherwise alter images. Recent research has significantly improved the capabilities of image editing tools, enabling the creation of photorealistic and semantically…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Quang Nguyen , Truong Vu , Trong-Tung Nguyen , Yuxin Wen , Preston K Robinette , Taylor T Johnson , Tom Goldstein , Anh Tran , Khoi Nguyen

Multimodal clothing image editing refers to the precise adjustment and modification of clothing images using data such as textual descriptions and visual images as control conditions, which effectively improves the work efficiency of…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Di Cheng , YingJie Shi , ShiXin Sun , JiaFu Zhang , WeiJing Wang , Yu Liu

Training of large-scale text-to-image and image-to-image models requires a huge amount of annotated data. While text-to-image datasets are abundant, data available for instruction-based image-to-image tasks like object addition and removal…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Aniruddha Bala , Rohan Jaiswal , Siddharth Roheda , Rohit Chowdhury , Loay Rashid

Large Language Models (LLMs) have significantly advanced natural language processing, demonstrating strong capabilities in tasks such as text generation, summarization, and reasoning. Recently, their potential for automating precise text…

计算与语言 · 计算机科学 2026-01-27 Yiming Zeng , Wanhao Yu , Zexin Li , Tao Ren , Yu Ma , Jinghan Cao , Xiyan Chen , Tingting Yu

Instruction-guided image editing consists in taking an image and an instruction and deliverring that image altered according to that instruction. State-of-the-art approaches to this task suffer from the typical scaling up and domain…

计算与语言 · 计算机科学 2025-03-05 Rodrigo Santos , António Branco , João Silva , João Rodrigues

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li

The combination of language processing and image processing keeps attracting increased interest given recent impressive advances that leverage the combined strengths of both domains of research. Among these advances, the task of editing an…

计算与语言 · 计算机科学 2024-12-05 Rodrigo Santos , João Silva , António Branco