English
Related papers

Related papers: FAGER: Factually Grounded Evaluation and Refinemen…

200 papers

With advances in generative artificial intelligence (AI), it is now possible to produce realistic-looking automated reports for preliminary reads of radiology images. This can expedite clinical workflows, improve accuracy and reduce overall…

Artificial Intelligence · Computer Science 2025-06-03 Razi Mahmood , Diego Machado Reyes , Ge Wang , Mannudeep Kalra , Pingkun Yan

Current text-to-image (T2I) benchmarks evaluate models on rigid prompts, potentially underestimating true generative capabilities due to prompt sensitivity and creating biases that favor certain models while disadvantaging others. We…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Haosheng Gan , Berk Tinaz , Mohammad Shahab Sepehri , Zalan Fabian , Mahdi Soltanolkotabi

We present a light-weight approach for detecting nonfactual outputs from retrieval-augmented generation (RAG). Given a context and putative output, we compute a factuality score that can be thresholded to yield a binary decision to check…

Computation and Language · Computer Science 2024-11-25 Hithesh Sankararaman , Mohammed Nasheed Yasin , Tanner Sorensen , Alessandro Di Bari , Andreas Stolcke

The rapid proliferation of multimodal generative models has sparked critical discussions on their reliability, fairness and potential for misuse. While text-to-image models excel at producing high-fidelity, user-guided content, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jordan Vice , Naveed Akhtar , Leonid Sigal , Richard Hartley , Ajmal Mian

The rapid progress in diffusion-based text-to-image (T2I) generation has created an urgent need for interpretable automatic evaluation methods that can assess the quality of generated images, therefore reducing the human annotation burden.…

Artificial Intelligence · Computer Science 2025-05-26 Zi-Ao Ma , Tian Lan , Rong-Cheng Tu , Shu-Hang Liu , Heyan Huang , Zhijing Wu , Chen Xu , Xian-Ling Mao

Multilingual text-to-image (T2I) models have advanced rapidly in terms of visual realism and semantic alignment, and are now widely utilized. Yet outputs vary across cultural contexts: because language carries cultural connotations, images…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Chuancheng Shi , Shangze Li , Shiming Guo , Simiao Xie , Wenhua Wu , Jingtong Dou , Chao Wu , Canran Xiao , Cong Wang , Zifeng Cheng , Fei Shen , Tat-Seng Chua

Despite the remarkable capabilities of text-to-image (T2I) generation models, real-world applications often demand fine-grained, iterative image editing that existing methods struggle to provide. Key challenges include granular instruction…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Zihan Liang , Jiahao Sun , Haoran Ma

Large language models (LLMs) outperform information retrieval techniques for downstream knowledge-intensive tasks when being prompted to generate world knowledge. However, community concerns abound regarding the factuality and potential…

Computation and Language · Computer Science 2023-10-12 Liang Chen , Yang Deng , Yatao Bian , Zeyu Qin , Bingzhe Wu , Tat-Seng Chua , Kam-Fai Wong

Text-to-image (T2I) models have achieved remarkable progress in high-quality image synthesis, yet most benchmarks rely on simple, self-contained prompts, failing to capture the complexity of real-world captions. Human-written captions often…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Aashish Anantha Ramakrishnan , Sharon X. Huang , Dongwon Lee

Text-based explainable recommendation aims to generate natural-language explanations that justify item recommendations, to improve user trust and system transparency. Although recent advances leverage LLMs to produce fluent outputs, a…

Information Retrieval · Computer Science 2026-05-18 Ben Kabongo , Vincent Guigue

Despite recent progress in text-to-image (T2I) generation, existing models often struggle to faithfully capture user intentions from short and under-specified prompts. While prior work has attempted to enhance prompts using large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Mingrui Wu , Lu Wang , Pu Zhao , Fangkai Yang , Jianjin Zhang , Jianfeng Liu , Yuefeng Zhan , Weihao Han , Hao Sun , Jiayi Ji , Xiaoshuai Sun , Qingwei Lin , Weiwei Deng , Dongmei Zhang , Feng Sun , Qi Zhang , Rongrong Ji

Text-to-image generation and text-guided image manipulation have received considerable attention in the field of image generation tasks. However, the mainstream evaluation methods for these tasks have difficulty in evaluating whether all…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Mizuki Miyamoto , Ryugo Morita , Jinjia Zhou

The steady improvements of text-to-image (T2I) generative models lead to slow deprecation of automatic evaluation benchmarks that rely on static datasets, motivating researchers to seek alternative ways to evaluate the T2I progress. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Jiahui Chen , Candace Ross , Reyhane Askari-Hemmat , Koustuv Sinha , Melissa Hall , Michal Drozdzal , Adriana Romero-Soriano

Current Video-LLM approaches for Video Temporal Grounding (VTG) typically rely on direct timestamp generation from an unstructured visual-token stream, often leading to brittle numerics and inconsistent boundaries. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Zelin Zheng , Xinyan Liu , Ruixin Li , Antoni B. Chan , Guorong Li , Qingming Huang , Laiyun Qing

Despite the impressive success of text-to-image (TTI) generation models, existing studies overlook the issue of whether these models accurately convey factual information. In this paper, we focus on the problem of image hallucination, where…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Youngsun Lim , Hojun Choi , Hyunjung Shim

Safety filters in commercial text-to-image (T2I) models systematically block legitimate artistic content involving the human figure, treating classical nude photography with the same restrictiveness as explicit material. While prior…

Multimedia · Computer Science 2026-03-24 Luca Cazzaniga

Text-to-image (T2I) generative diffusion models have demonstrated outstanding performance in synthesizing diverse, high-quality visuals from text captions. Several layout-to-image models have been developed to control the generation process…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Ahmad Süleyman , Göksel Biricik

Text-to-Image (T2I) models have recently gained significant attention due to their ability to generate high-quality images and are consequently used in a wide range of applications. However, there are concerns about the gender bias of these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yunbo Lyu , Zhou Yang , Yuqing Niu , Jing Jiang , David Lo

Text-to-image generative models have recently garnered significant attention due to their ability to generate images based on prompt descriptions. While these models have shown promising performance, concerns have been raised regarding the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Meiling Li , Zhenxing Qian , Xinpeng Zhang

AI-generated content is becoming increasingly prevalent in the real world, leading to serious ethical and societal concerns. For instance, adversaries might exploit large multimodal models (LMMs) to create images that violate ethical or…

Computation and Language · Computer Science 2025-04-14 Hongchao Fang , Yixin Liu , Jiangshu Du , Can Qin , Ran Xu , Feng Liu , Lichao Sun , Dongwon Lee , Lifu Huang , Wenpeng Yin