English
Related papers

Related papers: WiseEdit: Benchmarking Cognition- and Creativity-I…

200 papers

Text-to-Image generation has evolved from basic image synthesis into a frequently used core capability in professional creative workflows, where simple text-image alignment can no longer satisfy users' pressing demands for faithful…

We propose T2I-ReasonBench, a benchmark evaluating reasoning capabilities of text-to-image (T2I) models. It consists of four dimensions: Idiom Interpretation, Textual Image Design, Entity-Reasoning and Scientific-Reasoning. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Kaiyue Sun , Rongyao Fang , Chengqi Duan , Xian Liu , Xihui Liu

Current multimodal models aim to transcend the limitations of single-modality representations by unifying understanding and generation, often using text-to-image (T2I) tasks to calibrate semantic consistency. However, their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Juanxi Tian , Siyuan Li , Conghui He , Lijun Wu , Cheng Tan

Robust model-editing techniques are essential for deploying large language models (LLMs) in practical applications, as they enable cost-effective ways to deal with challenges such as privacy breaches, bias mitigation and misinformation…

Machine Learning · Computer Science 2026-01-19 Manit Baser , Dinil Mon Divakaran , Mohan Gurusamy

Recent advancements in image editing have enabled highly controllable and semantically-aware alteration of visual content, posing unprecedented challenges to manipulation localization. However, existing AI-generated forgery localization…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Shiyu Wu , Shuyan Li , Jing Li , Jing Liu , Yequan Wang

Evaluation metrics for image captioning face two challenges. Firstly, commonly used metrics such as CIDEr, METEOR, ROUGE and BLEU often do not correlate well with human judgments. Secondly, each metric has well known blind spots to…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Yin Cui , Guandao Yang , Andreas Veit , Xun Huang , Serge Belongie

Image editing is an iterative process that requires precise visual evaluation and manipulation for the output to match the editing intent. However, current image editing tools do not provide accessible interaction nor sufficient feedback…

Human-Computer Interaction · Computer Science 2024-08-14 Ruei-Che Chang , Yuxuan Liu , Lotus Zhang , Anhong Guo

Recent advances in text-to-image (T2I) models have enabled training-free regional image editing by leveraging the generative priors of foundation models. However, existing methods struggle to balance text adherence in edited regions,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Weiyan Xie , Han Gao , Didan Deng , Kaican Li , April Hua Liu , Yongxiang Huang , Nevin L. Zhang

Scientific images fundamentally differ from natural and AI-generated images in that they encode structured domain knowledge rather than merely depict visual scenes. Assessing their quality therefore requires evaluating not only perceptual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Wenzhe Li , Liang Chen , Junying Wang , Yijing Guo , Ye Shen , Farong Wen , Chunyi Li , Zicheng Zhang , Guangtao Zhai

The evaluation of visual editing models remains fragmented across methods and modalities. Existing benchmarks are often tailored to specific paradigms, making fair cross-paradigm comparisons difficult, while video editing lacks reliable…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Lifan Jiang , Tianrun Wu , Yuhang Pei , Chenyang Wang , Boxi Wu , Deng Cai

In this paper, we introduce knowledge image generation as a new task, alongside the Massive Multi-Discipline Multi-Tier Knowledge-Image Generation Benchmark (MMMG) to probe the reasoning capability of image generation models. Knowledge…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Yuxuan Luo , Yuhui Yuan , Junwen Chen , Haonan Cai , Ziyi Yue , Yuwei Yang , Fatima Zohra Daha , Ji Li , Zhouhui Lian

Existing image editing models struggle to meet real-world demands. Despite excelling in academic benchmarks, they have yet to be widely adopted for real user needs. Datasets that power these models use artificial edits, lacking the scale…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Peter Sushko , Ayana Bharadwaj , Zhi Yang Lim , Vasily Ilin , Ben Caffee , Dongping Chen , Mohammadreza Salehi , Cheng-Yu Hsieh , Ranjay Krishna

Real-world design documents (e.g., posters) are inherently multi-layered, combining decoration, text, and images. Editing them from natural-language instructions requires fine-grained, layer-aware reasoning to identify relevant layers and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zihao Lin , Wanrong Zhu , Jiuxiang Gu , Jihyung Kil , Christopher Tensmeyer , Lin Zhang , Shilong Liu , Ruiyi Zhang , Lifu Huang , Vlad I. Morariu , Tong Sun

Recently, we have witnessed great progress in image editing with natural language instructions. Several closed-source models like GPT-Image-1, Seedream, and Google-Nano-Banana have shown highly promising progress. However, the open-source…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Keming Wu , Sicong Jiang , Max Ku , Ping Nie , Minghao Liu , Wenhu Chen

Unified multimodal models integrate the reasoning capacity of large language models with both image understanding and generation, showing great promise for advanced multimodal intelligence. However, the community still lacks a rigorous…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Hongxiang Li , Yaowei Li , Bin Lin , Yuwei Niu , Yuhang Yang , Xiaoshuang Huang , Jiayin Cai , Xiaolong Jiang , Yao Hu , Long Chen

Recent progress in generative models has significantly advanced image editing capabilities, yet precise and intuitive user control remains difficult. Specifically, users often struggle to communicate both exact spatial layouts and specific…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Anya Ji , George Ma , Téa Wright , Yiming Zhang , David M. Chan , Alane Suhr , Somayeh Sojoudi

Despite the longstanding adage "an image is worth a thousand words," generating accurate hyper-detailed image descriptions remains unsolved. Trained on short web-scraped image text, vision-language models often generate incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Roopal Garg , Andrea Burns , Burcu Karagol Ayan , Yonatan Bitton , Ceslee Montgomery , Yasumasa Onoe , Andrew Bunner , Ranjay Krishna , Jason Baldridge , Radu Soricut

Recent advances in text-driven image editing have been significant, yet the task of accurately evaluating these edited images continues to pose a considerable challenge. Different from the assessment of text-driven image generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Bowen Qu , Shangkun Sun , Xiaoyu Liang , Wei Gao

High-quality benchmarks are crucial for driving progress in machine learning research. However, despite the growing interest in video generation, there is no comprehensive dataset to evaluate human generation. Humans can perform a wide…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Emanuele Bugliarello , Anurag Arnab , Roni Paiss , Pieter-Jan Kindermans , Cordelia Schmid

Large language models (LLMs) can effectively handle outdated information through knowledge editing. However, current approaches face two key limitations: (I) Poor generalization: Most approaches rigidly inject new knowledge without ensuring…

Computation and Language · Computer Science 2026-04-08 Jinhu Fu , Yan Bai , Longzhu He , Yihang Lou , Yanxiao Zhao , Li Sun , Sen Su