English
Related papers

Related papers: SMART-Editor: A Multi-Agent Framework for Human-Li…

200 papers

Recent advances in AI-generated content (AIGC) have significantly accelerated image editing techniques, driving increasing demand for diverse and fine-grained edits. Despite these advances, existing image editing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Shuyu Wang , Weiqi Li , Qian Wang , Shijie Zhao , Jian Zhang

Current instruction-based editing methods, such as InstructPix2Pix, often fail to produce satisfactory results in complex scenarios due to their dependence on the simple CLIP text encoder in diffusion models. To rectify this, this paper…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Yuzhou Huang , Liangbin Xie , Xintao Wang , Ziyang Yuan , Xiaodong Cun , Yixiao Ge , Jiantao Zhou , Chao Dong , Rui Huang , Ruimao Zhang , Ying Shan

Replacing the background and simultaneously adjusting foreground objects is a challenging task in image editing. Current techniques for generating such images relies heavily on user interactions with image editing softwares, which is a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Yunxuan Xiao , Yikai Li , Yuwei Wu , Lizhen Zhu

This paper presents UltraEdit, a large-scale (approximately 4 million editing samples), automatically generated dataset for instruction-based image editing. Our key idea is to address the drawbacks in existing image editing datasets like…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Haozhe Zhao , Xiaojian Ma , Liang Chen , Shuzheng Si , Rujie Wu , Kaikai An , Peiyu Yu , Minjia Zhang , Qing Li , Baobao Chang

Multimodal retrieval relies heavily on single-vector retrievers, which compress rich, sequential token sequences into one single global representation. While efficient, they discard fine-grained, local evidence critical for dense retrieval…

Information Retrieval · Computer Science 2026-05-26 Jianrui Zhang , Hyun Jung Lee , Sukanta Ganguly , Tae-Eui Kam , Donghyun Kim , Yong Jae Lee

Large Language Models (LLMs) and Vision Language Models (VLMs) have shown impressive reasoning abilities, yet they struggle with spatial understanding and layout consistency when performing fine-grained visual editing. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Haoyu Zhen , Xiaolong Li , Yilin Zhao , Han Zhang , Sifei Liu , Kaichun Mo , Chuang Gan , Subhashree Radhakrishnan

While modern visual generation models excel at creating aesthetically pleasing natural images, they struggle with producing or editing structured visuals like charts, diagrams, and mathematical figures, which demand composition planning,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Le Zhuo , Songhao Han , Yuandong Pu , Boxiang Qiu , Sayak Paul , Yue Liao , Yihao Liu , Jie Shao , Xi Chen , Si Liu , Hongsheng Li

Text-guided image editing aims to modify specific regions according to the target prompt while preserving the identity of the source image. Recent methods exploit explicit binary masks to constrain editing, but hard mask boundaries…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yongwen Lai , Chaoqun Wang , Shaobo Min

Recent works have explored text-guided image editing using diffusion models and generated edited images based on text prompts. However, the models struggle to accurately locate the regions to be edited and faithfully perform precise edits.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Qian Wang , Biao Zhang , Michael Birsak , Peter Wonka

In programming, better tools often yield better results. For that, modern programming environments offer mechanisms to allow for their extensibility. The closer those tools are to the code, the easier it is for programmers to map the…

Programming Languages · Computer Science 2026-03-09 Tom Beckmann , Christoph Thiede , Jens Lincke , Robert Hirschfeld

Layout design, such as user interface or graphical layout in general, is fundamentally an iterative revision process. Through revising a design repeatedly, the designer converges on an ideal layout. In this paper, we investigate how…

Human-Computer Interaction · Computer Science 2024-06-28 Tao Li , Chin-Yi Cheng , Amber Xie , Gang Li , Yang Li

Common image editing tasks typically adopt powerful generative diffusion models as the leading paradigm for real-world content editing. Meanwhile, although reinforcement learning (RL) methods such as Diffusion-DPO and Flow-GRPO have further…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Fan Li , Chonghuinan Wang , Lina Lei , Yuping Qiu , Jiaqi Xu , Jiaxiu Jiang , Xinran Qin , Zhikai Chen , Fenglong Song , Zhixin Wang , Renjing Pei , Wangmeng Zuo

A fundamental challenge in image editing lies in preserving spatial locality: edits should improve targeted content without inadvertently altering surrounding regions. However, most optimization-based editing approaches treat images as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Shaodong Xu , Zexian Li , Zhendong Wang , Litong Gong , Tiezheng Ge , Wengang Zhou , Bo Zheng , Houqiang Li

Instruction-based image editing has emerged as a prominent research area, which, benefiting from image generation foundation models, have achieved high aesthetic quality, making instruction-following capability the primary challenge.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Hongyu Li , Manyuan Zhang , Dian Zheng , Ziyu Guo , Yimeng Jia , Kaituo Feng , Hao Yu , Yexin Liu , Yan Feng , Peng Pei , Xunliang Cai , Linjiang Huang , Hongsheng Li , Si Liu

The widespread adoption of the "Games as a Service" model necessitates frequent content updates, placing immense pressure on quality assurance. In response, automated game testing has been viewed as a promising solution to cope with this…

Artificial Intelligence · Computer Science 2025-12-16 Enhong Mu , Minami Yoda , Yan Zhang , Mingyue Zhang , Yutaka Matsuno , Jialong Li

Large language model (LLM)-based search agents have proven promising for addressing knowledge-intensive problems by incorporating information retrieval capabilities. Existing works largely focus on optimizing the reasoning paradigms of…

Artificial Intelligence · Computer Science 2026-01-09 Tongyu Wen , Guanting Dong , Zhicheng Dou

We introduce RewardFlow, an inversion-free framework that steers pretrained diffusion and flow-matching models at inference time through multi-reward Langevin dynamics. RewardFlow unifies complementary differentiable rewards for semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Onkar Susladkar , Dong-Hwan Jang , Tushar Prakash , Adheesh Juvekar , Vedant Shah , Ayush Barik , Nabeel Bashir , Muntasir Wahed , Ritish Shrirao , Ismini Lourentzou

Face attribute editing plays a pivotal role in various applications. However, existing methods encounter challenges in achieving high-quality results while preserving identity, editing faithfulness, and temporal consistency. These…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Guangzhi Wang , Tianyi Chen , Kamran Ghasedi , HsiangTao Wu , Tianyu Ding , Chris Nuesmeyer , Ilya Zharkov , Mohan Kankanhalli , Luming Liang

WARNING: This paper contains examples of offensive materials. To address the proliferation of toxic content on social media, we introduce SMARTER, we introduce SMARTER, a data-efficient two-stage framework for explainable content moderation…

Computation and Language · Computer Science 2026-04-23 Huy Nghiem , Advik Sachdeva , Hal Daumé

Instruction-guided image editing has achieved remarkable progress, yet current models still face challenges with complex instructions and often require multiple samples to produce a desired result. Reinforcement Learning (RL) offers a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xin Luo , Jiahao Wang , Chenyuan Wu , Shitao Xiao , Xiyan Jiang , Defu Lian , Jiajun Zhang , Dong Liu , Zheng liu