English
Related papers

Related papers: GIE-Bench: Towards Grounded Evaluation for Text-Gu…

200 papers

Recent advances in image editing have been driven by the development of denoising diffusion models, marking a significant leap forward in this field. Despite these advances, the generalization capabilities of recent image editing approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zichong Meng , Changdi Yang , Jun Liu , Hao Tang , Pu Zhao , Yanzhi Wang

Researchers have recently begun exploring the use of StyleGAN-based models for real image editing. One particularly interesting application is using natural language descriptions to guide the editing process. Existing approaches for editing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Ahmet Canberk Baykal , Abdul Basit Anees , Duygu Ceylan , Erkut Erdem , Aykut Erdem , Deniz Yuret

We introduce VisIT-Bench (Visual InsTruction Benchmark), a benchmark for evaluation of instruction-following vision-language models for real-world use. Our starting point is curating 70 'instruction families' that we envision instruction…

Computation and Language · Computer Science 2023-12-27 Yonatan Bitton , Hritik Bansal , Jack Hessel , Rulin Shao , Wanrong Zhu , Anas Awadalla , Josh Gardner , Rohan Taori , Ludwig Schmidt

Text-to-image diffusion models have emerged as powerful tools for high-quality image generation and editing. Many existing approaches rely on text prompts as editing guidance. However, these methods are constrained by the need for manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yuanyuan Chang , Yinghua Yao , Tao Qin , Mengmeng Wang , Ivor Tsang , Guang Dai

Deep generative models have shown impressive results in text-to-image synthesis. However, current text-to-image models often generate images that are inadequately aligned with text prompts. We propose a fine-tuning method for aligning such…

The use of denoising diffusion models is becoming increasingly popular in the field of image editing. However, current approaches often rely on either image-guided methods, which provide a visual reference but lack control over semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Zhanbo Feng , Zenan Ling , Xinyu Lu , Ci Gong , Feng Zhou , Wugedele Bao , Jie Li , Fan Yang , Robert C. Qiu

Personalizing text-to-image diffusion models is crucial for adapting the pre-trained models to specific target concepts, enabling diverse image generation. However, fine-tuning with few images introduces an inherent trade-off between…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sunghyun Park , Seokeon Choi , Hyoungwoo Park , Sungrack Yun

Instructed code editing, where LLMs directly modify a developer's existing code based on a user instruction, is becoming a widely used interaction mode in AI coding assistants. However, few benchmarks directly evaluate this capability and…

We introduce GraphicDesignBench (GDB), the first comprehensive benchmark suite designed specifically to evaluate AI models on the full breadth of professional graphic design tasks. Unlike existing benchmarks that focus on natural-image…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Adrienne Deganutti , Elad Hirsch , Haonan Zhu , Jaejung Seol , Purvanshi Mehta

Affective Image Manipulation (AIM) aims to evoke specific emotions through targeted editing. Current image editing benchmarks primarily focus on object-level modifications in general scenarios, lacking the fine-grained granularity to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Shi Chen , Xuecheng Wu , Heli Sun , Yunyun Shi , Xinyi Yin , Fengjian Xue , Jinheng Xie , Dingkang Yang , Hao Wang , Junxiao Xue , Liang He

Diffusion-based image editing models have achieved significant progress in real world applications. However, conventional models typically rely on natural language prompts, which often lack the precision required to localize target objects.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Haohang Xu , Lin Liu , Zhibo Zhang , Rong Cong , Xiaopeng Zhang , Qi Tian

Image editing has achieved remarkable progress recently. Modern editing models could already follow complex instructions to manipulate the original content. However, beyond completing the editing instructions, the accompanying physical…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yuandong Pu , Le Zhuo , Songhao Han , Jinbo Xing , Kaiwen Zhu , Shuo Cao , Bin Fu , Si Liu , Hongsheng Li , Yu Qiao , Wenlong Zhang , Xi Chen , Yihao Liu

AI-assisted coding has rapidly reshaped software practice and research workflows, yet today's models still struggle to produce correct code for complex 3D geometric vision. If models could reliably write such code, the research of our…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Wenyi Li , Renkai Luo , Yue Yu , Huan-ang Gao , Mingju Gao , Li Yuan , Chaoyou Fu , Hao Zhao

Text-based image editing is typically approached as a static task that involves operations such as inserting, deleting, or modifying elements of an input image based on human instructions. Given the static nature of this task, in this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Maria Mihaela Trusca , Mingxiao Li , Marie-Francine Moens

Text-to-Image (T2I) generative models have revolutionized content creation, yet they inherently risk amplifying societal biases. While sociological research provides systematic classifications of bias, existing T2I benchmarks largely…

Computers and Society · Computer Science 2026-04-15 Hanjun Luo , Zhimu Huang , Haoyu Huang , Ziye Deng , Ruizhe Chen , Xinfeng Li , Zuozhu Liu , Hanan Salam

Rapid progress in text-to-image generative models coupled with their deployment for visual content creation has magnified the importance of thoroughly evaluating their performance and identifying potential biases. In pursuit of models that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Melissa Hall , Samuel J. Bell , Candace Ross , Adina Williams , Michal Drozdzal , Adriana Romero Soriano

Image matching is a fundamental computer vision problem. While learning-based methods achieve state-of-the-art performance on existing benchmarks, they generalize poorly to in-the-wild images. Such methods typically need to train separate…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Xuelun Shen , Zhipeng Cai , Wei Yin , Matthias Müller , Zijun Li , Kaixuan Wang , Xiaozhi Chen , Cheng Wang

The increasing availability of image-text pairs has largely fueled the rapid advancement in vision-language foundation models. However, the vast scale of these datasets inevitably introduces significant variability in data quality, which…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Lei Zhang , Fangxun Shu , Tianyang Liu , Sucheng Ren , Hao Jiang , Cihang Xie

Artificial intelligence generative content (AIGC) has significantly impacted image generation in the field of remote sensing. However, the equally important area of remote sensing image (RSI) editing has not received sufficient attention.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Fangzhou Han , Lingyu Si , Zhizhuo Jiang , Hongwei Dong , Lamei Zhang , Yu Liu , Hao Chen , Bo Du

The rapid proliferation of multimodal generative models has sparked critical discussions on their reliability, fairness and potential for misuse. While text-to-image models excel at producing high-fidelity, user-guided content, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jordan Vice , Naveed Akhtar , Leonid Sigal , Richard Hartley , Ajmal Mian