English
Related papers

Related papers: CAMEO: A Conditional and Quality-Aware Multi-Agent…

200 papers

Image captioning has attracted ever-increasing research attention in the multimedia community. To this end, most cutting-edge works rely on an encoder-decoder framework with attention mechanisms, which have achieved remarkable progress.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Chen Shen , Rongrong Ji , Fuhai Chen , Xiaoshuai Sun , Xiangming Li

We consider the targeted image editing problem: blending a region in a source image with a driver image that specifies the desired change. Differently from prior works, we solve this problem by learning a conditional probability…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Andrew Brown , Cheng-Yang Fu , Omkar Parkhi , Tamara L. Berg , Andrea Vedaldi

Computer Use Agents (CUAs) fundamentally rely on graphical user interface (GUI) grounding to translate language instructions into executable screen actions, but editing-level grounding in dense coding interfaces (such as VS Code and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Himangi Mittal , Gaurav Mittal , Nelson Daniel Troncoso , Yu Hu

Scribble-guided image editing allows users to combine simple scribble annotations with text prompts to specify both where and how an image should be edited, enabling flexible interaction with precise spatial control. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Mingyi Xu , Jinpeng Lin , Min Zhou , Tiezheng Ge , Ming Zeng

Recent advances in image editing, driven by image diffusion models, have shown remarkable progress. However, significant challenges remain, as these models often struggle to follow complex edit instructions accurately and frequently…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Noam Rotstein , Gal Yona , Daniel Silver , Roy Velich , David Bensaïd , Ron Kimmel

Recent advances in image editing models have demonstrated remarkable capabilities in executing explicit instructions, such as attribute manipulation, style transfer, and pose synthesis. However, these models often face challenges when…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Wang Lin , Feng Wang , Majun Zhang , Wentao Hu , Tao Jin , Zhou Zhao , Fei Wu , Jingyuan Chen , Alan Yuille , Sucheng Ren

Structure-guided image completion aims to inpaint a local region of an image according to an input guidance map from users. While such a task enables many practical applications for interactive editing, existing methods often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Haitian Zheng , Zhe Lin , Jingwan Lu , Scott Cohen , Eli Shechtman , Connelly Barnes , Jianming Zhang , Qing Liu , Yuqian Zhou , Sohrab Amirghodsi , Jiebo Luo

Given an original image, image editing aims to generate an image that align with the provided instruction. The challenges are to accept multimodal inputs as instructions and a scarcity of high-quality training data, including crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhen Han , Chaojie Mao , Zeyinzi Jiang , Yulin Pan , Jingfeng Zhang

Complex image restoration aims to recover high-quality images from inputs affected by multiple degradations such as blur, noise, rain, and compression artifacts. Recent restoration agents, powered by vision-language models and large…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jianglin Lu , Yuanwei Wu , Ziyi Zhao , Hongcheng Wang , Felix Jimenez , Abrar Majeedi , Yun Fu

Semantic image editing provides users with a flexible tool to modify a given image guided by a corresponding segmentation map. In this task, the features of the foreground objects and the backgrounds are quite different. However, all…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Wuyang Luo , Su Yang , Xinjian Zhang , Weishan Zhang

Many tasks in computer vision and graphics fall within the framework of conditional image synthesis. In recent years, generative adversarial nets (GANs) have delivered impressive advances in quality of synthesized images. However, it…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Ke Li , Shichong Peng , Tianhao Zhang , Jitendra Malik

Recent advances in instruction-based image editing have shown remarkable progress. However, existing methods remain limited to relatively simple editing operations, hindering real-world applications that require complex and compositional…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Xuehai Bai , Xiaoling Gu , Akide Liu , Hangjie Yuan , YiFan Zhang , Jack Ma

Text-driven motion editing and intra-structural retargeting, where source and target share topology but may differ in bone lengths, are traditionally handled by fragmented pipelines with incompatible inputs and representations: editing…

Graphics · Computer Science 2026-04-16 Junlin Li , Xinhao Song , Siqi Wang , Haibin Huang , Yili Zhao

Natural language instructions are a powerful interface for editing the outputs of text-to-image diffusion models. However, several challenges need to be addressed: 1) underspecification (the need to model the implicit meaning of…

Computation and Language · Computer Science 2023-10-31 Tuhin Chakrabarty , Kanishk Singh , Arkadiy Saakyan , Smaranda Muresan

Diffusion-based Image Editing has achieved significant success in recent years. However, it remains challenging to achieve high-quality image editing while maintaining the background similarity without sacrificing speed or memory…

Graphics · Computer Science 2025-09-03 Siyi Liu , Weiming Chen , Yushun Tang , Zhihai He

Makeup plays a vital role in self-expression, identity, and confidence - yet remains an underexplored domain for assistive technology, especially for people with vision impairments. While existing tools support isolated tasks such as color…

Human-Computer Interaction · Computer Science 2025-07-08 Franklin Mingzhe Li , Akihiko Oharazawa , Chloe Qingyu Zhu , Misty Fan , Daisuke Sato , Chieko Asakawa , Patrick Carrington

We introduce MoCA, a Motion-Conditioned Image Animation approach for video editing. It leverages a simple decomposition of the video editing problem into image editing followed by motion-conditioned image animation. Furthermore, given the…

Graphics · Computer Science 2023-12-01 Wilson Yan , Andrew Brown , Pieter Abbeel , Rohit Girdhar , Samaneh Azadi

We present a novel algorithm to reduce tensor compute required by a conditional image generation autoencoder without sacrificing quality of photo-realistic image generation. Our method is device agnostic, and can optimize an autoencoder for…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Nisarg A. Shah , Gaurav Bharaj

Fashion-image editing represents a challenging computer vision task, where the goal is to incorporate selected apparel into a given input image. Most existing techniques, known as Virtual Try-On methods, deal with this task by first…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Martin Pernuš , Clinton Fookes , Vitomir Štruc , Simon Dobrišek

Real-world image degradation is often unknown, spatially non-uniform, and compositional, requiring all-in-one restoration models to adapt a single set of weights to diverse local corruption patterns without test-time degradation labels.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Haisen He , Xiangyu Zou , SongLin Dong , Heng Li , Yihong Gong , Zhiheng Ma