English
Related papers

Related papers: Position: Evaluation of Visual Processing Should B…

200 papers

As AI systems continue to evolve, their rigorous evaluation becomes crucial for their development and deployment. Researchers have constructed various large-scale benchmarks to determine their capabilities, typically against a gold-standard…

Computation and Language · Computer Science 2025-05-09 Yan Zhuang , Qi Liu , Zachary A. Pardos , Patrick C. Kyllonen , Jiyun Zu , Zhenya Huang , Shijin Wang , Enhong Chen

The use of algorithms for decision-making in higher education is steadily growing, promising cost-savings to institutions and personalized service for students but also raising ethical challenges around surveillance, fairness, and…

Human-Computer Interaction · Computer Science 2023-02-14 Kelly McConvey , Shion Guha , Anastasia Kuzminykh

Recent advances in text-driven image editing have been significant, yet the task of accurately evaluating these edited images continues to pose a considerable challenge. Different from the assessment of text-driven image generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Shangkun Sun , Bowen Qu , Xiaoyu Liang , Songlin Fan , Wei Gao

Text-to-image models often struggle to generate images that precisely match textual prompts. Prior research has extensively studied the evaluation of image-text alignment in text-to-image generation. However, existing evaluations primarily…

Computation and Language · Computer Science 2025-06-11 Huixuan Zhang , Xiaojun Wan

There is significant interest in developing evaluation metrics which accurately estimate the quality of generated text without the aid of a human-written reference text, which can be time consuming and expensive to collect or entirely…

Computation and Language · Computer Science 2022-10-25 Daniel Deutsch , Rotem Dror , Dan Roth

In this paper, we argue that the prevailing approach to training and evaluating machine learning models often fails to consider their real-world application within organizational or societal contexts, where they are intended to create…

Machine Learning · Computer Science 2025-04-24 Burcu Sayin , Jie Yang , Xinyue Chen , Andrea Passerini , Fabio Casati

Data can be visually represented using visual channels like position, length or luminance. An existing ranking of these visual channels is based on how accurately participants could report the ratio between two depicted values. There is an…

Human-Computer Interaction · Computer Science 2021-07-26 Caitlyn M. McColeman , Fumeng Yang , Steven Franconeri , Timothy F. Brady

As multimedia services such as video streaming, video conferencing, virtual reality (VR), and online gaming continue to expand, ensuring high perceptual visual quality becomes a priority to maintain user satisfaction and competitiveness.…

Multimedia · Computer Science 2025-03-04 Wei Zhou , Hadi Amirpour , Christian Timmerer , Guangtao Zhai , Patrick Le Callet , Alan C. Bovik

Visually impaired persons have significant problems in their everyday movement. Therefore, some of our previous work involves computer vision in developing assistance systems for guiding the visually impaired in critical situations. Some of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Krešimir Romić , Irena Galić , Marija Habijan , Hrvoje Leventić

Semantic relevance metrics can capture both the inherent semantics of individual objects and their relationships to other elements within a visual scene. Numerous previous research has demonstrated that these metrics can influence human…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Kun Sun , Rong Wang

Rerunning a metric-based evaluation should be more straightforward, and results should be closer, than in a human-based evaluation, especially where code and model checkpoints are made available by the original authors. As this report of…

Computation and Language · Computer Science 2024-05-14 Michela Lorandi , Anya Belz

Human evaluation is critical for validating the performance of text-to-image generative models, as this highly cognitive process requires deep comprehension of text and images. However, our survey of 37 recent papers reveals that many works…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Mayu Otani , Riku Togashi , Yu Sawai , Ryosuke Ishigami , Yuta Nakashima , Esa Rahtu , Janne Heikkilä , Shin'ichi Satoh

Machine translation evaluation is a very important activity in machine translation development. Automatic evaluation metrics proposed in literature are inadequate as they require one or more human reference translations to compare them with…

Computation and Language · Computer Science 2013-11-18 Nisheeth Joshi , Iti Mathur , Hemant Darbari , Ajai Kumar

Personalized image generation via text prompts has great potential to improve daily life and professional work by facilitating the creation of customized visual content. The aim of image personalization is to create images based on a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mingxiao Li , Tingyu Qu , Tinne Tuytelaars , Marie-Francine Moens

We present a computational model for the semantic interpretation of symmetry in naturalistic scenes. Key features include a human-centred representation, and a declarative, explainable interpretation model supporting deep semantic…

Computer Vision and Pattern Recognition · Computer Science 2018-09-17 Jakob Suchan , Mehul Bhatt , Srikrishna Vardarajan , Seyed Ali Amirshahi , Stella Yu

The evaluation of text-generative vision-language models is a challenging yet crucial endeavor. By addressing the limitations of existing Visual Question Answering (VQA) benchmarks and proposing innovative evaluation methodologies, our…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Simon Ging , María A. Bravo , Thomas Brox

Psychophysical experiments remain the most reliable approach for perceptual image quality assessment (IQA), yet their cost and limited scalability encourage automated approaches. We investigate whether Vision Language Models (VLMs) can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Imran Mehmood , Imad Ali Shah , Ming Ronnier Luo , Brian Deegan

Humans judge perceptual similarity according to diverse visual attributes, including scene layout, subject location, and camera pose. Existing vision models understand a wide range of semantic abstractions but improperly weigh these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Shobhita Sundaram , Stephanie Fu , Lukas Muttenthaler , Netanel Y. Tamir , Lucy Chai , Simon Kornblith , Trevor Darrell , Phillip Isola

Deployed artificial intelligence (AI) often impacts humans, and there is no one-size-fits-all metric to evaluate these tools. Human-centered evaluation of AI-based systems combines quantitative and qualitative analysis and human input. It…

Human-Computer Interaction · Computer Science 2023-03-14 Teresa Datta , John P. Dickerson

Recent advances in text-driven image editing have been significant, yet the task of accurately evaluating these edited images continues to pose a considerable challenge. Different from the assessment of text-driven image generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Bowen Qu , Shangkun Sun , Xiaoyu Liang , Wei Gao