English
Related papers

Related papers: On the use of human reference data for evaluating …

200 papers

Generative models have made immense progress in recent years, particularly in their ability to generate high quality images. However, that quality has been difficult to evaluate rigorously, with evaluation dominated by heuristic approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Y. Alex Kolchinski , Sharon Zhou , Shengjia Zhao , Mitchell Gordon , Stefano Ermon

Choosing a suitable visualization for data is a difficult task. Current data visualization recommender systems exist to aid in choosing a visualization, yet suffer from issues such as low accessibility and indecisiveness. In this study, we…

Human-Computer Interaction · Computer Science 2019-11-12 Petra Kubernátová , Magda Friedjungová , Max van Duijn

Image and video synthesis has become a blooming topic in computer vision and machine learning communities along with the developments of deep generative models, due to its great academic and application value. Many researchers have been…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Zhen Jia , Zhang Zhang , Liang Wang , Tieniu Tan

Image Quality Assessment (IQA) based on human subjective preferences has undergone extensive research in the past decades. However, with the development of communication protocols, the visual data consumption volume of machines has…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Chunyi Li , Yuan Tian , Xiaoyue Ling , Zicheng Zhang , Haodong Duan , Haoning Wu , Ziheng Jia , Xiaohong Liu , Xiongkuo Min , Guo Lu , Weisi Lin , Guangtao Zhai

By harnessing pre-trained language models, summarization models had rapid progress recently. However, the models are mainly assessed by automatic evaluation metrics such as ROUGE. Although ROUGE is known for having a positive correlation…

Computation and Language · Computer Science 2021-06-03 Wonjin Yoon , Yoon Sun Yeo , Minbyul Jeong , Bong-Jun Yi , Jaewoo Kang

The explosion of open-sourced models and Question-Answering (QA) datasets emphasizes the importance of automated QA evaluation. We studied the statistics of the existing evaluation metrics for a better understanding of their limitations. By…

Computation and Language · Computer Science 2024-10-15 Yun Joon Soh , Jishen Zhao

Explaining artificial intelligence (AI) predictions is increasingly important and even imperative in many high-stakes applications where humans are the ultimate decision-makers. In this work, we propose two novel architectures of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Giang Nguyen , Mohammad Reza Taesiri , Anh Nguyen

Automatically generating a human-like description for a given image is a potential research in artificial intelligence, which has attracted a great of attention recently. Most of the existing attention methods explore the mapping…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Feicheng Huang , Zhixin Li , Haiyang Wei , Canlong Zhang , Huifang Ma

While textual reviews have become prominent in many recommendation-based systems, automated frameworks to provide relevant visual cues against text reviews where pictures are not available is a new form of task confronted by data mining and…

Computer Vision and Pattern Recognition · Computer Science 2016-06-27 Roberto Camacho Barranco , Laura M. Rodriguez , Rebecca Urbina , M. Shahriar Hossain

The existing methods for image search reranking suffer from the unfaithfulness of the assumptions under which the text-based images search result. The resulting images contain more irrelevant images. Hence the re ranking concept arises to…

Information Retrieval · Computer Science 2014-02-11 V Rajakumar , Vipeen V Bopche

Due to the existence of quality degradations introduced in various stages of visual signal acquisition, compression, transmission and display, image quality assessment (IQA) plays a vital role in image-based applications. According to…

Image and Video Processing · Electrical Eng. & Systems 2022-04-14 Dongxu Wang

Automated image captioning has the potential to be a useful tool for people with vision impairments. Images taken by this user group are often noisy, which leads to incorrect and even unsafe model predictions. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Lu Yu , Malvina Nikandrou , Jiali Jin , Verena Rieser

Progress in lighting estimation is tracked by computing existing image quality assessment (IQA) metrics on images from standard datasets. While this may appear to be a reasonable approach, we demonstrate that doing so does not correlate to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Justine Giroux , Mohammad Reza Karimi Dastjerdi , Yannick Hold-Geoffroy , Javier Vazquez-Corral , Jean-François Lalonde

A growing number of approaches exist to generate explanations for image classification. However, few of these approaches are subjected to human-subject evaluations, partly because it is challenging to design controlled experiments with…

Artificial Intelligence · Computer Science 2021-05-07 Martin Schuessler , Philipp Weiß , Leon Sixt

Image captioning has become an essential Vision & Language research task. It is about predicting the most accurate caption given a specific image or video. The research community has achieved impressive results by continuously proposing new…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Guillermo Ruiz , Tania Ramírez , Daniela Moctezuma

The use of computational methods to evaluate aesthetics in photography has gained interest in recent years due to the popularization of convolutional neural networks and the availability of new annotated datasets. Most studies in this area…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Carlos Rodríguez-Pardo , Hakan Bilen

Over the last few decades, psychologists have developed sophisticated formal models of human categorization using simple artificial stimuli. In this paper, we use modern machine learning methods to extend this work into the realm of…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Ruairidh M. Battleday , Joshua C. Peterson , Thomas L. Griffiths

In the fields of Experimental and Computational Aesthetics, numerous image datasets have been created over the last two decades. In the present work, we provide a comparative overview of twelve image datasets that include aesthetic ratings…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Ralf Bartho , Katja Thoemmes , Christoph Redies

This survey aims at reviewing recent computer vision techniques used in the assessment of image aesthetic quality. Image aesthetic assessment aims at computationally distinguishing high-quality photos from low-quality ones based on…

Computer Vision and Pattern Recognition · Computer Science 2017-07-19 Yubin Deng , Chen Change Loy , Xiaoou Tang

Data seems cheap to get, and in many ways it is, but the process of creating a high quality labeled dataset from a mass of data is time-consuming and expensive. With the advent of rich 3D repositories, photo-realistic rendering systems…

Computer Vision and Pattern Recognition · Computer Science 2016-09-09 Yair Movshovitz-Attias , Takeo Kanade , Yaser Sheikh