English
Related papers

Related papers: Position: Evaluation of Visual Processing Should B…

200 papers

Evaluation metrics for image captioning face two challenges. Firstly, commonly used metrics such as CIDEr, METEOR, ROUGE and BLEU often do not correlate well with human judgments. Secondly, each metric has well known blind spots to…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Yin Cui , Guandao Yang , Andreas Veit , Xun Huang , Serge Belongie

Learning-based image quality assessment (IQA) has made remarkable progress in the past decade, but nearly all consider the two key components -- model and data -- in isolation. Specifically, model-centric IQA focuses on developing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Peibei Cao , Dingquan Li , Kede Ma

Text-to-image generation and text-guided image manipulation have received considerable attention in the field of image generation tasks. However, the mainstream evaluation methods for these tasks have difficulty in evaluating whether all…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Mizuki Miyamoto , Ryugo Morita , Jinjia Zhou

The ongoing discussion whether modern vision systems have to be viewed as visually-enabled cognitive systems or cognitively-enabled vision systems is groundless, because perceptual and cognitive faculties of vision are separate components…

Artificial Intelligence · Computer Science 2008-09-25 Emanuel Diamant

A multitude of explainability methods and associated fidelity performance metrics have been proposed to help better understand how modern AI systems make decisions. However, much of the current work has remained theoretical -- without much…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Julien Colin , Thomas Fel , Remi Cadene , Thomas Serre

Personalized AI agents are becoming central to modern information retrieval, yet most evaluation methodologies remain static, relying on fixed benchmarks and one-off metrics that fail to reflect how users' needs evolve over time. These…

Information Retrieval · Computer Science 2025-10-07 Kirandeep Kaur , Preetam Prabhu Srikar Dammu , Hideo Joho , Chirag Shah

Super-resolution results are usually measured by full-reference image quality metrics or human rating scores. However, these evaluation methods are general image quality measurement, and do not account for the nature of the super-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Sheng Cheng

Research in Image Generation has recently made significant progress, particularly boosted by the introduction of Vision-Language models which are able to produce high-quality visual content based on textual inputs. Despite ongoing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Federico Betti , Jacopo Staiano , Lorenzo Baraldi , Lorenzo Baraldi , Rita Cucchiara , Nicu Sebe

The ability of to explain neural network decisions goes hand in hand with their safe deployment. Several methods have been proposed to highlight features important for a given network decision. However, there is no consensus on how to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Agnieszka Grabska-Barwińska

Automated metrics for Machine Translation have made significant progress, with the goal of replacing expensive and time-consuming human evaluations. These metrics are typically assessed by their correlation with human judgments, which…

Computation and Language · Computer Science 2024-12-31 Pius von Däniken , Jan Deriu , Mark Cieliebak

Image quality assessment (IQA) models aim to establish a quantitative relationship between visual images and their perceptual quality by human observers. IQA modeling plays a special bridging role between vision science and engineering…

Image and Video Processing · Electrical Eng. & Systems 2021-02-23 Zhengfang Duanmu , Wentao Liu , Zhongling Wang , Zhou Wang

The intersection of visualization and the humanities (VIS*H) is marked by a tension between chasing analytical "insight" and interpretive "meaning." The effectiveness of visualization techniques hinges on established evaluation frameworks…

Human-Computer Interaction · Computer Science 2026-01-29 Alejandro Benito-Santos , Florian Windhager , Aida Horaniet Ibañez , Rabea Kleymann , Alfie Abdul-Rahman , Eva Mayr

The rapid advancements in AI technologies have revolutionized the production of graphical content across various sectors, including entertainment, advertising, and e-commerce. These developments have spurred the need for robust evaluation…

Human-Computer Interaction · Computer Science 2024-09-04 Memoona Aziz , Umair Rehman , Syed Ali Safi , Amir Zaib Abbasi

Recent advances in AI enable the automatic generation of visualizations directly from textual prompts using agentic workflows. However, visualizations produced via one-shot generative methods often suffer from insufficient quality,…

Human-Computer Interaction · Computer Science 2026-03-19 Roxana Bujack , Li-Ta Lo , Ethan Stam , Ayan Biswas , David Rogers

This position paper argues that Mean Opinion Score (MOS), while historically foundational, is no longer sufficient as the sole supervisory signal for multimedia quality assessment models. MOS reduces rich, context-sensitive human judgments…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Mohamed Amine Kerkouri , Marouane Tliba , Aladine Chetouani , Nour Aburaed , Alessandro Bruno

Infrared and visible image fusion (IVIF) integrates complementary modalities to enhance scene perception. Current methods predominantly focus on optimizing handcrafted losses and objective metrics, often resulting in fusion outcomes that do…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Jinyuan Liu , Xingyuan Li , Qingyun Mei , Haoyuan Xu , Zhiying Jiang , Long Ma , Risheng Liu , Xin Fan

Image retargeting effectively resizes images by preserving the recognizability of important image regions. Most of retargeting methods rely on good importance maps as a cue to retain or remove certain regions in the input image. In…

Computer Vision and Pattern Recognition · Computer Science 2017-09-25 Tam V. Nguyen , Guangyu Gao

Evaluating large language models (LLMs) is fundamental, particularly in the context of practical applications. Conventional evaluation methods, typically designed primarily for LLM development, yield numerical scores that ignore the user…

Computation and Language · Computer Science 2024-04-12 Yongqiang Ma , Lizhi Qing , Jiawei Liu , Yangyang Kang , Yue Zhang , Wei Lu , Xiaozhong Liu , Qikai Cheng

Recent advances in GenAI have enabled automation in data visualization, allowing users to generate visual representations using natural language. However, existing systems primarily focus on automation, overlooking users' varying expertise…

Human-Computer Interaction · Computer Science 2025-04-10 Kathrin Schnizer , Sven Mayer

The field of text-conditioned image generation has made unparalleled progress with the recent advent of latent diffusion models. While remarkable, as the complexity of given text input increases, the state-of-the-art diffusion models may…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Jaskirat Singh , Liang Zheng