English
Related papers

Related papers: What Changed? Detecting and Evaluating Instruction…

200 papers

Evaluating the quality and variability of text generated by Large Language Models (LLMs) poses a significant, yet unresolved research challenge. Traditional evaluation methods, such as ROUGE and BERTScore, which measure token similarity,…

Computation and Language · Computer Science 2024-01-05 Wendi Cui , Jiaxin Zhang , Zhuohang Li , Lopez Damien , Kamalika Das , Bradley Malin , Sricharan Kumar

Diffusion models have significantly improved text-to-image generation, producing high-quality, realistic images from textual descriptions. Beyond generation, object-level image editing remains a challenging problem, requiring precise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Marco Schouten , Mehmet Onurcan Kaya , Serge Belongie , Dim P. Papadopoulos

Digital advertising increasingly relies on visual content, yet marketers lack rigorous methods for understanding how specific visual attributes causally affect consumer engagement. This paper addresses a fundamental methodological…

Artificial Intelligence · Computer Science 2026-03-04 Yizhi Liu , Balaji Padmanabhan , Siva Viswanathan

In scenarios where language models must incorporate new information efficiently without extensive retraining, traditional fine-tuning methods are prone to overfitting, degraded generalization, and unnatural language generation. To address…

Computation and Language · Computer Science 2025-04-01 Siyuan Qi , Bangcheng Yang , Kailin Jiang , Xiaobo Wang , Jiaqi Li , Yifan Zhong , Yaodong Yang , Zilong Zheng

With recent advances in Multimodal Large Language Models (MLLMs) showing strong visual understanding and reasoning, interest is growing in using them to improve the editing performance of diffusion models. Despite rapid progress, most…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Chong Mou , Qichao Sun , Yanze Wu , Pengze Zhang , Xinghui Li , Fulong Ye , Songtao Zhao , Qian He

In recent years, Multimodal Large Language Models (MLLMs) have achieved remarkable progress on a wide range of multimodal benchmarks. Despite these advances, most existing benchmarks mainly focus on single-image or multi-image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Bingli Wang , Huanze Tang , Haijun Lv , Zhishan Lin , Lixin Gu , Lei Feng , Qipeng Guo , Kai Chen

Recent advances in large language models (LLMs) have demonstrated the effectiveness of Iterative Self-Improvement (ISI) techniques. However, continuous training on self-generated data leads to reduced output diversity, a limitation…

Computation and Language · Computer Science 2025-01-03 Yiwei Qin , Yixiu Liu , Pengfei Liu

As the field of image generation rapidly advances, traditional diffusion models and those integrated with multimodal large language models (LLMs) still encounter limitations in interpreting complex prompts and preserving image consistency…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xinyu Zhang , Mengxue Kang , Fei Wei , Shuang Xu , Yuhe Liu , Lin Ma

Despite significant progress in diffusion-based image generation, subject-driven generation and instruction-based editing remain challenging. Existing methods typically treat them separately, struggling with limited high-quality data and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Xueyun Tian , Wei Li , Bingbing Xu , Yige Yuan , Yuanzhuo Wang , Huawei Shen

Prompt-based models have demonstrated impressive prompt-following capability at image editing tasks. However, the models still struggle with following detailed editing prompts or performing local edits. Specifically, global image quality…

Graphics · Computer Science 2025-10-20 Kenan Tang , Yanhong Li , Yao Qin

Remote Sensing Image Change Captioning (RSICC) aims to generate natural language descriptions of surface changes between multi-temporal remote sensing images, detailing the categories, locations, and dynamics of changed objects (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Zhiming Wang , Mingze Wang , Sheng Xu , Yanjing Li , Baochang Zhang

Deep ensembles perform better than a single network thanks to the diversity among their members. Recent approaches regularize predictions to increase diversity; however, they also drastically decrease individual members' performances. In…

Machine Learning · Computer Science 2021-01-15 Alexandre Rame , Matthieu Cord

Research in Image Generation has recently made significant progress, particularly boosted by the introduction of Vision-Language models which are able to produce high-quality visual content based on textual inputs. Despite ongoing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Federico Betti , Jacopo Staiano , Lorenzo Baraldi , Lorenzo Baraldi , Rita Cucchiara , Nicu Sebe

Unified multimodal models target joint understanding, reasoning, and generation, but current image editing benchmarks are largely confined to natural images and shallow commonsense reasoning, offering limited assessment of this capability…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Mingxin Liu , Ziqian Fan , Zhaokai Wang , Leyao Gu , Zirun Zhu , Yiguo He , Yuchen Yang , Changyao Tian , Xiangyu Zhao , Ning Liao , Shaofeng Zhang , Qibing Ren , Zhihang Zhong , Xuanhe Zhou , Junchi Yan , Xue Yang

Large language model-based agents, empowered by in-context learning (ICL), have demonstrated strong capabilities in complex reasoning and tool-use tasks. However, existing works have shown that the effectiveness of ICL is highly sensitive…

Artificial Intelligence · Computer Science 2025-08-01 Ruoyu Wang , Junda Wu , Yu Xia , Tong Yu , Ryan A. Rossi , Julian McAuley , Lina Yao

Evaluation metrics for image captioning face two challenges. Firstly, commonly used metrics such as CIDEr, METEOR, ROUGE and BLEU often do not correlate well with human judgments. Secondly, each metric has well known blind spots to…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Yin Cui , Guandao Yang , Andreas Veit , Xun Huang , Serge Belongie

Instruction-guided image editing has seen remarkable progress with models like FLUX.2 and Qwen-Image-Edit, yet they still struggle with complex scenarios with multiple similar instances each requiring individual edits. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Ziqian Liu , Stephan Alaniz

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Multi-modal stance detection (MSD) aims to determine an author's stance toward a given target using both textual and visual content. While recent methods leverage multi-modal fusion and prompt-based learning, most fail to distinguish…

Multimedia · Computer Science 2026-01-30 Zhiyu Xie , Fuqiang Niu , Genan Dai , Qianlong Wang , Li Dong , Bowen Zhang , Hu Huang

Evaluating image editing models remains challenging due to the coarse granularity and limited interpretability of traditional metrics, which often fail to capture aspects important to human perception and intent. Such metrics frequently…