English
Related papers

Related papers: SMART-Editor: A Multi-Agent Framework for Human-Li…

200 papers

Despite many attempts to leverage pre-trained text-to-image models (T2I) like Stable Diffusion (SD) for controllable image editing, producing good predictable results remains a challenge. Previous approaches have focused on either…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Sherry X. Chen , Yaron Vaxman , Elad Ben Baruch , David Asulin , Aviad Moreshet , Kuo-Chin Lien , Misha Sra , Pradeep Sen

We propose a novel feed-forward 3D editing framework called Shap-Editor. Prior research on editing 3D objects primarily concentrated on editing individual objects by leveraging off-the-shelf 2D image editing networks. This is achieved via a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Minghao Chen , Junyu Xie , Iro Laina , Andrea Vedaldi

We present NeRFEditor, an efficient learning framework for 3D scene editing, which takes a video captured over 360{\deg} as input and outputs a high-quality, identity-preserving stylized 3D scene. Our method supports diverse types of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Chunyi Sun , Yanbin Liu , Junlin Han , Stephen Gould

Image editing affords increased control over the aesthetics and content of generated images. Pre-existing works focus predominantly on text-based instructions to achieve desired image modifications, which limit edit precision and accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Bowen Li , Yongxin Yang , Steven McDonagh , Shifeng Zhang , Petru-Daniel Tudosiu , Sarah Parisot

Model editing, the process of efficiently modifying factual knowledge in pre-trained language models, is critical for maintaining their accuracy and relevance. However, existing editing methods often introduce unintended side effects,…

Computation and Language · Computer Science 2025-09-23 Tsung-Hsuan Pan , Chung-Chi Chen , Hen-Hsen Huang , Hsin-Hsi Chen

Reinforcement learning (RL) has emerged as a promising paradigm for enhancing image editing and text-to-image (T2I) generation. However, current reward models, which act as critics during RL, often suffer from hallucinations and assign…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Xiangyu Zhao , Peiyuan Zhang , Junming Lin , Tianhao Liang , Yuchen Duan , Shengyuan Ding , Changyao Tian , Yuhang Zang , Junchi Yan , Xue Yang

As a cornerstone of the modern digital economy, 3D modeling and rendering demand substantial resources and manual effort when scene editing is performed in the traditional manner. Despite recent progress in VLM-based agents for 3D editing,…

Human-Computer Interaction · Computer Science 2026-01-13 Hao Wang , Wenhui Zhu , Shao Tang , Zhipeng Wang , Xuanzhao Dong , Xin Li , Xiwen Chen , Ashish Bastola , Xinhao Huang , Yalin Wang , Abolfazl Razi

Diffusion models have revolutionized image generation and editing, producing state-of-the-art results in conditioned and unconditioned image synthesis. While current techniques enable user control over the degree of change in an image edit,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Eran Levin , Ohad Fried

With recent advancements in visual synthesis, there is a growing risk of encountering images with detrimental effects, such as hate, discrimination, or privacy violations. The research on transforming harmful images into responsible ones…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Minheng Ni , Yeli Shen , Lei Zhang , Wangmeng Zuo

Existing image editing methods can handle simple editing instructions very well. To deal with complex editing instructions, they often need to jointly fine-tune the large language models (LLMs) and diffusion models (DMs), which involves…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Yijia Wang , Yiqing Shen , Weiming Chen , Zhihai He

Language models are capable of iteratively improving their outputs based on natural language feedback, thus enabling in-context optimization of user preference. In place of human users, a second language model can be used as an evaluator,…

Computation and Language · Computer Science 2024-07-08 Jane Pan , He He , Samuel R. Bowman , Shi Feng

Instruction-based image editing has achieved remarkable progress; however, models solely trained via supervised fine-tuning often overfit to annotated patterns, hindering their ability to explore and generalize beyond training…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Zongjian Li , Zheyuan Liu , Qihui Zhang , Bin Lin , Feize Wu , Shenghai Yuan , Zhiyuan Yan , Yang Ye , Wangbo Yu , Yuwei Niu , Shaodong Wang , Xinhua Cheng , Li Yuan

Large vision-language models have achieved remarkable progress in visual reasoning, yet most existing systems rely on single-step or text-only reasoning, limiting their ability to iteratively refine understanding across multiple visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Wenfang Sun , Hao Chen , Yingjun Du , Yefeng Zheng , Cees G. M. Snoek

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li

Creativity in AI imagery remains a fundamental challenge, requiring not only the generation of visually compelling content but also the capacity to add novel, expressive, and artistically rich transformations to images. Unlike conventional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Kavana Venkatesh , Connor Dunlop , Pinar Yanardag

Controllable image generation is fundamental to the success of modern generative AI, yet it faces a critical trade-off between semantic fidelity and inference speed. The RemEdit diffusion-based framework addresses this trade-off with two…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Eashan Adhikarla , Brian D. Davison

We present a framework for document-centric background generation with multi-page editing and thematic continuity. To ensure text regions remain readable, we employ a \emph{latent masking} formulation that softly attenuates updates in the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Taewon Kang , Joseph K J , Chris Tensmeyer , Jihyung Kil , Wanrong Zhu , Ming C. Lin , Vlad I. Morariu

We present HumanEdit, a high-quality, human-rewarded dataset specifically designed for instruction-guided image editing, enabling precise and diverse image manipulations through open-form language instructions. Previous large-scale editing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Jinbin Bai , Wei Chow , Ling Yang , Xiangtai Li , Juncheng Li , Hanwang Zhang , Shuicheng Yan

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the…

Machine Learning · Computer Science 2021-03-31 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran