English
Related papers

Related papers: Towards Scalable Human-aligned Benchmark for Text-…

200 papers

We review human evaluation practices in automatic, speech-driven 3D gesture generation and find a lack of standardisation and frequent use of flawed experimental setups. This leads to a situation where it is impossible to know how different…

Recent advancements in text-to-image (T2I) models enable high-quality image synthesis, yet generating anatomically accurate human figures remains challenging. AI-generated images frequently exhibit distortions such as proliferated limbs,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Lu Ma , Kaibo Cao , Hao Liang , Jiaxin Lin , Zhuang Li , Yuhong Liu , Jihong Zhang , Wentao Zhang , Bin Cui

Affective Image Manipulation (AIM) aims to evoke specific emotions through targeted editing. Current image editing benchmarks primarily focus on object-level modifications in general scenarios, lacking the fine-grained granularity to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Shi Chen , Xuecheng Wu , Heli Sun , Yunyun Shi , Xinyi Yin , Fengjian Xue , Jinheng Xie , Dingkang Yang , Hao Wang , Junxiao Xue , Liang He

We introduce CoEdIT, a state-of-the-art text editing system for writing assistance. CoEdIT takes instructions from the user specifying the attributes of the desired text, such as "Make the sentence simpler" or "Write it in a more neutral…

Computation and Language · Computer Science 2023-10-25 Vipul Raheja , Dhruv Kumar , Ryan Koo , Dongyeop Kang

We consider the problem of customizing text-to-image diffusion models with user-supplied reference images. Given new prompts, the existing methods can capture the key concept from the reference images but fail to align the generated image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Aishwarya Agarwal , Srikrishna Karanam , Balaji Vasan Srinivasan

Text-to-image (T2I) systems increasingly rely on upstream prompters, either humans or multimodal large language models (MLLMs), to translate user intent into detailed prompts. Yet current benchmarks fix the prompt and only evaluate T2I…

Artificial Intelligence · Computer Science 2026-05-22 Hanjun Luo , Zhimu Huang , Sylvia Chung , Yiran Wang , Yingbin Jin , Jialin Li , Jiang Li , Xinfeng Li , Hanan Salam

With the rapid advancements in Artificial Intelligence Generated Image (AGI) technology, the accurate assessment of their quality has become an increasingly vital requirement. Prevailing methods typically rely on cross-modal models like…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Qiang Li , Qingsen Yan , Haojian Huang , Peng Wu , Haokui Zhang , Yanning Zhang

Generative models, such as diffusion and autoregressive approaches, have demonstrated impressive capabilities in editing natural images. However, applying these tools to scientific charts rests on a flawed assumption: a chart is not merely…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Shawn Li , Ryan Rossi , Sungchul Kim , Sunav Choudhary , Franck Dernoncourt , Puneet Mathur , Zhengzhong Tu , Yue Zhao

This paper presents InteractEdit, a novel framework for zero-shot Human-Object Interaction (HOI) editing, addressing the challenging task of transforming an existing interaction in an image into a new, desired interaction while preserving…

Graphics · Computer Science 2025-03-13 Jiun Tian Hoe , Weipeng Hu , Wei Zhou , Chao Xie , Ziwei Wang , Chee Seng Chan , Xudong Jiang , Yap-Peng Tan

Facial expression image editing requires fine-grained control to strictly preserve human identity and background while precisely manipulating expression. However, existing editing benchmarks primarily focus on general scenarios, lacking…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Fengjian Xue , Xuecheng Wu , Heli Sun , Yunyun Shi , Shi Chen , Liangyu Fu , Jinheng Xie , Dingkang Yang , Hao Wang , Junxiao Xue , Liang He

Text-to-image (T2I) models have garnered significant attention for generating high-quality images aligned with text prompts. However, rapid T2I model advancements reveal limitations in early benchmarks, lacking comprehensive evaluations,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Jingjing Chang , Yixiao Fang , Peng Xing , Shuhan Wu , Wei Cheng , Rui Wang , Xianfang Zeng , Gang Yu , Hai-Bao Chen

Styled Handwritten Text Generation (Styled HTG) is an important task in document analysis, aiming to generate text images with the handwriting of given reference images. In recent years, there has been significant progress in the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Vittorio Pippi , Fabio Quattrini , Silvia Cascianelli , Rita Cucchiara

The rapid advancements of Text-to-Image (T2I) models have ushered in a new phase of AI-generated content, marked by their growing ability to interpret and follow user instructions. However, existing T2I model evaluation benchmarks fall…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Xinyu Wei , Jinrui Zhang , Zeqing Wang , Hongyang Wei , Zhen Guo , Lei Zhang

Text Style Transfer (TST) evaluation is, in practice, inconsistent. Therefore, we conduct a meta-analysis on human and automated TST evaluation and experimentation that thoroughly examines existing literature in the field. The meta-analysis…

Machine Learning · Computer Science 2023-06-02 Phil Ostheimer , Mayank Nagda , Marius Kloft , Sophie Fellenz

With the rapid advancement of text-to-image (T2I) generation models, assessing the semantic alignment between generated images and text descriptions has become a significant research challenge. Current methods, including those based on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Xinli Yue , JianHui Sun , Junda Lu , Liangchao Yao , Fan Xia , Tianyi Wang , Fengyun Rao , Jing Lyu , Yuetang Deng

Text rendering has recently emerged as one of the most challenging frontiers in visual generation, drawing significant attention from large-scale diffusion and multimodal models. However, text editing within images remains largely…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Rui Gui , Yang Wan , Haochen Han , Dongxing Mao , Fangming Liu , Min Li , Alex Jinpeng Wang

Text-to-image (T2I) models have advanced creative content generation, yet their reliance on large uncurated datasets often reproduces societal biases. We present FairT2I, a training-free and interactive framework grounded in a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Jinya Sakurai , Yuki Koyama , Issei Sato

With the rapid advancements of the text-to-image generative model, AI-generated images (AGIs) have been widely applied to entertainment, education, social media, etc. However, considering the large quality variance among different AGIs,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Chunyi Li , Zicheng Zhang , Haoning Wu , Wei Sun , Xiongkuo Min , Xiaohong Liu , Guangtao Zhai , Weisi Lin

Vision-language models (VLMs) have shown impressive abilities across a range of multi-modal tasks. However, existing metrics for evaluating the quality of text generated by VLMs typically focus on an overall evaluation for a specific task,…

Computation and Language · Computer Science 2026-03-10 Masanari Ohi , Masahiro Kaneko , Naoaki Okazaki , Nakamasa Inoue

With the recent fast development of generative models, instruction-based image editing has shown great potential in generating high-quality images. However, the quality of editing highly depends on carefully designed instructions, placing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Mingde Yao , Zhiyuan You , King-Man Tam , Menglu Wang , Tianfan Xue