English
Related papers

Related papers: Instruction-based Image Editing with Planning, Rea…

200 papers

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

In recent years, instruction-based image editing methods have garnered significant attention in image editing. However, despite encompassing a wide range of editing priors, these methods are helpless when handling editing tasks that are…

Graphics · Computer Science 2024-03-28 Ruoyu Zhao , Qingnan Fan , Fei Kou , Shuai Qin , Hong Gu , Wei Wu , Pengcheng Xu , Mingrui Zhu , Nannan Wang , Xinbo Gao

Recent remarkable improvements in large-scale text-to-image generative models have shown promising results in generating high-fidelity images. To further enhance editability and enable fine-grained generation, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Kangyeol Kim , Sunghyun Park , Junsoo Lee , Jaegul Choo

Instruction-based image editing aims to modify specific content within existing images according to user-provided instructions while preserving non-target regions. Beyond traditional object- and style-centric manipulation, text-centric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Hui Zhang , Juntao Liu , Zongkai Liu , Liqiang Niu , Fandong Meng , Zuxuan Wu , Yu-Gang Jiang

Image generation abilities of text-to-image diffusion models have significantly advanced, yielding highly photo-realistic images from descriptive text and increasing the viability of leveraging synthetic images to train computer vision…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Jiahui Chen , Amy Zhang , Adriana Romero-Soriano

Enabling artificial intelligence systems, particularly large language models, to integrate new knowledge and flexibly apply it during reasoning remains a central challenge. Existing knowledge editing approaches emphasize atomic facts,…

Artificial Intelligence · Computer Science 2026-02-03 Ya Gao , Kalle Kujanpää , Pekka Marttinen , Harri Valpola , Alexander Ilin

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Recent deep learning based approaches have shown promising results for the challenging task of inpainting large missing regions in an image. These methods can generate visually plausible image structures and textures, but often create…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Jiahui Yu , Zhe Lin , Jimei Yang , Xiaohui Shen , Xin Lu , Thomas S. Huang

Image generation in the fashion domain has predominantly focused on preserving body characteristics or following input prompts, but little attention has been paid to improving the inherent fashionability of the output images. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Qice Qin , Yuki Hirakawa , Ryotaro Shimizu , Takuya Furusawa , Edgar Simo-Serra

Data augmentation is crucial for pixel-wise annotation tasks like semantic segmentation, where labeling requires significant effort and intensive labor. Traditional methods, involving simple transformations such as rotations and flips,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Quang-Huy Che , Duc-Tri Le , Bich-Nga Pham , Duc-Khai Lam , Vinh-Tiep Nguyen

We explore how generating a chain of thought -- a series of intermediate reasoning steps -- significantly improves the ability of large language models to perform complex reasoning. In particular, we show how such reasoning abilities emerge…

Computation and Language · Computer Science 2023-01-12 Jason Wei , Xuezhi Wang , Dale Schuurmans , Maarten Bosma , Brian Ichter , Fei Xia , Ed Chi , Quoc Le , Denny Zhou

In recent years, integrating multimodal understanding and generation into a single unified model has emerged as a promising paradigm. While this approach achieves strong results in text-to-image (T2I) generation, it still struggles with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Ziyun Zeng , David Junhao Zhang , Wei Li , Mike Zheng Shou

Current text-to-image editing models often encounter challenges with smoothly manipulating multiple attributes using a single instruction. Taking inspiration from the Chain-of-Thought prompting technique utilized in language models, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Zhenduo Zhang , Bo-Wen Zhang , Guang Liu

Visually-guided image editing, where edits are conditioned on both visual cues and textual prompts, has emerged as a powerful paradigm for fine-grained, controllable content generation. Although recent generative models have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Sara Ghazanfari , Wei-An Lin , Haitong Tian , Ersin Yumer

Generating instructional images of human daily actions from an egocentric viewpoint serves as a key step towards efficient skill transfer. In this paper, we introduce a novel problem -- egocentric action frame generation. The goal is to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Bolin Lai , Xiaoliang Dai , Lawrence Chen , Guan Pang , James M. Rehg , Miao Liu

Although current prompt learning methods have successfully been designed to effectively reuse the large pre-trained models without fine-tuning their large number of parameters, they still have limitations to be addressed, i.e., without…

Machine Learning · Computer Science 2023-12-05 Zongqian Wu , Yujing Liu , Mengmeng Zhan , Jialie Shen , Ping Hu , Xiaofeng Zhu

Unified multimodal models often struggle with complex synthesis tasks that demand deep reasoning, and typically treat text-to-image generation and image editing as isolated capabilities rather than interconnected reasoning steps. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Dianyi Wang , Chaofan Ma , Feng Han , Size Wu , Wei Song , Yibin Wang , Zhixiong Zhang , Tianhang Wang , Siyuan Wang , Zhongyu Wei , Jiaqi Wang

Multimodal large language models (MLLMs) equip pre-trained large-language models (LLMs) with visual capabilities. While textual prompting in LLMs has been widely studied, visual prompting has emerged for more fine-grained and free-form…

Progress in image generation raises significant public security concerns. We argue that fake image detection should not operate as a "black box". Instead, an ideal approach must ensure both strong generalization and transparency. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Yikun Ji , Yan Hong , Jiahui Zhan , Haoxing Chen , jun lan , Huijia Zhu , Weiqiang Wang , Liqing Zhang , Jianfu Zhang

In recent years, diffusion models have gained popularity for their ability to generate higher-quality images in comparison to GAN models. However, like any other large generative models, these models require a huge amount of data,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Rajesh Shrestha , Bowen Xie