English
Related papers

Related papers: On the use of human reference data for evaluating …

200 papers

Reference models in form of best practices are an essential element to ensured knowledge as design for reuse. Popular modeling approaches do not offer mechanisms to embed reference models in a supporting way, let alone a repository of it.…

Databases · Computer Science 2024-07-02 Erik Heiland , Peter Hillmann , Andreas Karcher

We study the problem of computer-assisted teaching with explanations. Conventional approaches for machine teaching typically only provide feedback at the instance level e.g., the category or label of the instance. However, it is intuitive…

Computer Vision and Pattern Recognition · Computer Science 2018-02-21 Oisin Mac Aodha , Shihan Su , Yuxin Chen , Pietro Perona , Yisong Yue

In many applications, it is important to characterize the way in which two concepts are semantically related. Knowledge graphs such as ConceptNet provide a rich source of information for such characterizations by encoding relations between…

Computation and Language · Computer Science 2019-02-27 Yilun Zhou , Steven Schockaert , Julie A. Shah

Although we have seen a proliferation of algorithms for recommending visualizations, these algorithms are rarely compared with one another, making it difficult to ascertain which algorithm is best for a given visual analysis scenario.…

Human-Computer Interaction · Computer Science 2021-09-08 Zehua Zeng , Phoebe Moh , Fan Du , Jane Hoffswell , Tak Yeon Lee , Sana Malik , Eunyee Koh , Leilani Battle

Several services for people with visual disabilities have emerged recently due to achievements in Assistive Technologies and Artificial Intelligence areas. Despite the growth in assistive systems availability, there is a lack of services…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Daniel Louzada Fernandes , Marcos Henrique Fonseca Ribeiro , Fabio Ribeiro Cerqueira , Michel Melo Silva

The evaluation of machine learning models using human-labeled validation data can be expensive and time-consuming. AI-labeled synthetic data can be used to decrease the number of human annotations required for this purpose in a process…

Machine Learning · Computer Science 2024-05-29 Pierre Boyeau , Anastasios N. Angelopoulos , Nir Yosef , Jitendra Malik , Michael I. Jordan

Current and future large astronomical surveys will yield multiparameter databases on millions or even billions of objects. The scientific exploitation of these will require powerful, robust, and automated classification tools tailored to…

Astrophysics · Physics 2007-05-23 C. A. L. Bailer-Jones

Training data is an essential resource for creating capable and robust vision systems which are integral to the proper function of many robotic systems. Synthesized training data has been shown in recent years to be a viable alternative to…

Robotics · Computer Science 2024-11-12 Peter Gavriel , Adam Norton , Kenneth Kimble , Megan Zimmerman

Digital images contain a lot of redundancies, therefore, compressions are applied to reduce the image size without the loss of reasonable image quality. The same become more prominent in the case of videos that contains image sequences and…

Image and Video Processing · Electrical Eng. & Systems 2021-12-30 Nisar Ahmed , Hafiz Muhammad Shahzad Asif , Hassan Khalid

This paper proposes a technique to assess the aesthetic quality of photographs. The goal of the study is to predict whether a given photograph is captured by professional photographers, or by common people, based on a measurement of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Ashish Verma , Kranthi Koukuntla , Rohit Varma , Snehasis Mukherjee

We introduce a new large-scale dataset that links the assessment of image quality issues to two practical vision tasks: image captioning and visual question answering. First, we identify for 39,181 images taken by people who are blind…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Tai-Yin Chiu , Yinan Zhao , Danna Gurari

One of the main challenges in recommender systems is data sparsity which leads to high variance. Several attempts have been made to improve the bias-variance trade-off using auxiliary information. In particular, document modeling-based…

Information Retrieval · Computer Science 2021-09-14 Meysam Varasteh , Mehdi Soleiman Nejad , Hadi Moradi , Mohammad Amin Sadeghi , Ahmad Kalhor

Recently, by using deep neural network based algorithms, object classification, detection and semantic segmentation solutions are significantly improved. However, one challenge for 2D image-based systems is that they cannot provide accurate…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Xiaoke Shen

Many automatic attribute discovery methods have been developed to extract a set of visual attributes from images for various tasks. However, despite good performance in some image classification tasks, it is difficult to evaluate whether…

Computer Vision and Pattern Recognition · Computer Science 2016-02-08 Liangchen Liu , Arnold Wiliem , Shaokang Chen , Brian C. Lovell

Automatic evaluation comparing candidate translations to human-generated paraphrases of reference translations has recently been proposed by Freitag et al. When used in place of original references, the paraphrased versions produce metric…

Computation and Language · Computer Science 2020-10-21 Markus Freitag , George Foster , David Grangier , Colin Cherry

As machine learning systems move from computer-science laboratories into the open world, their accountability becomes a high priority problem. Accountability requires deep understanding of system behavior and its failures. Current…

Machine Learning · Computer Science 2018-09-21 Besmira Nushi , Ece Kamar , Eric Horvitz

Human ratings are currently the most accurate way to assess the quality of an image captioning model, yet most often the only used outcome of an expensive human rating evaluation is a few overall statistics over the evaluation dataset. In…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Paul Hongsuck Seo , Piyush Sharma , Tomer Levinboim , Bohyung Han , Radu Soricut

Given the size of modern cities in the urbanising age, it is beyond the perceptual capacity of most people to develop a good knowledge about the beauty and ugliness of the city at every street corner. Correspondingly, for planners, it is…

Computer Vision and Pattern Recognition · Computer Science 2016-08-12 Lun Liu , Hui Wang , Chunyang Wu

Personalized image generation via text prompts has great potential to improve daily life and professional work by facilitating the creation of customized visual content. The aim of image personalization is to create images based on a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mingxiao Li , Tingyu Qu , Tinne Tuytelaars , Marie-Francine Moens

Despite the substantial progress in recent years, the image captioning techniques are still far from being perfect.Sentences produced by existing methods, e.g. those based on RNNs, are often overly rigid and lacking in variability. This…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 Bo Dai , Sanja Fidler , Raquel Urtasun , Dahua Lin