English
Related papers

Related papers: Analysing Word Importance for Image Annotation

200 papers

When human annotators are given a choice about what to label in an image, they apply their own subjective judgments on what to ignore and what to mention. We refer to these noisy "human-centric" annotations as exhibiting human reporting…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Ishan Misra , C. Lawrence Zitnick , Margaret Mitchell , Ross Girshick

Despite advancements in text-to-image models, generating images that precisely align with textual descriptions remains challenging due to misalignment in training data. In this paper, we analyze the critical role of caption precision and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Sheng Cheng , Maitreya Patel , Yezhou Yang

Repositories of images with semantic and emotion content descriptions are valuable tools in many areas such as Affective Computing and Human-Computer Interaction, but they are also important in the development of multimodal searchable…

Information Retrieval · Computer Science 2017-12-06 Marko Horvat , Anton Grbin , Gordan Gledec

Modern research in content-based image retrieval systems (CIBR) has become progressively more focused on the richness of human semantics. Several approaches may be used to reduced the 'semantic gap' between the high-level human experience…

Information Retrieval · Computer Science 2018-12-10 António Filipe Fonseca

High-quality data is necessary for modern machine learning. However, the acquisition of such data is difficult due to noisy and ambiguous annotations of humans. The aggregation of such annotations to determine the label of an image leads to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Lars Schmarje , Vasco Grossmann , Claudius Zelenka , Sabine Dippel , Rainer Kiko , Mariusz Oszust , Matti Pastell , Jenny Stracke , Anna Valros , Nina Volkmann , Reinhard Koch

In essence, embedding algorithms work by optimizing the distance between a word and its usual context in order to generate an embedding space that encodes the distributional representation of words. In addition to single words or word…

Computation and Language · Computer Science 2021-04-14 Andres Garcia-Silva , Ronald Denaux , Jose Manuel Gomez-Perez

Image datasets with high-quality pixel-level annotations are valuable for semantic segmentation: labelling every pixel in an image ensures that rare classes and small objects are annotated. However, full-image annotations are expensive,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Hubert Lin , Paul Upchurch , Kavita Bala

Image retrieval has been a top topic in the field of both computer vision and machine learning for a long time. Content based image retrieval, which tries to retrieve images from a database visually similar to a query image, has attracted…

Computer Vision and Pattern Recognition · Computer Science 2013-04-10 Liu Liang

We use coherence relations inspired by computational models of discourse to study the information needs and goals of image captioning. Using an annotation protocol specifically devised for capturing image--caption coherence relations, we…

Computation and Language · Computer Science 2022-11-30 Malihe Alikhani , Piyush Sharma , Shengjie Li , Radu Soricut , Matthew Stone

Semantic annotation, the process of identifying key-phrases in texts and linking them to concepts in a knowledge base, is an important basis for semantic information retrieval and the Semantic Web uptake. Despite the emergence of semantic…

Computation and Language · Computer Science 2018-11-15 Gagnon Michel , Zouaq Amal , Aranha Francisco , Ensan Faezeh , Jean-Louis Ludovic

Attention mechanisms have attracted considerable interest in image captioning because of its powerful performance. Existing attention-based models use feedback information from the caption generator as guidance to determine which of the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Zhihao Zhu , Zhan Xue , Zejian Yuan

The work discusses the use of machine learning algorithms for anomaly detection in medical image analysis and how the performance of these algorithms depends on the number of annotators and the quality of labels. To address the issue of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Hieu H. Pham , Khiem H. Le , Tuan V. Tran , Ha Q. Nguyen

Data is the engine of modern computer vision, which necessitates collecting large-scale datasets. This is expensive, and guaranteeing the quality of the labels is a major challenge. In this paper, we investigate efficient annotation…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Yuan-Hong Liao , Amlan Kar , Sanja Fidler

Automated object detection has become increasingly valuable across diverse applications, yet efficient, high-quality annotation remains a persistent challenge. In this paper, we present the development and evaluation of a platform designed…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Sönke Tenckhoff , Mario Koddenbrock , Erik Rodner

I present a tool which tells the quality of document or its usefulness based on annotations. Annotation may include comments, notes, observation, highlights, underline, explanation, question or help etc. comments are used for evaluative…

Information Retrieval · Computer Science 2011-11-08 Archana Shukla

For some images, descriptions written by multiple people are consistent with each other. But for other images, descriptions across people vary considerably. In other words, some images are specific $-$ they elicit consistent descriptions…

Computer Vision and Pattern Recognition · Computer Science 2015-04-17 Mainak Jas , Devi Parikh

Interactive search sessions often contain multiple queries, where the user submits a reformulated version of the previous query in response to the original results. We aim to enhance the query recommendation experience for a commercial…

Information Retrieval · Computer Science 2020-03-03 Gaurav Verma , Vishwa Vinay , Sahil Bansal , Shashank Oberoi , Makkunda Sharma , Prakhar Gupta

In this paper, I introduce a simple method of computing relative word frequencies for authorship attribution and similar stylometric tasks. Rather than computing relative frequencies as the number of occurrences of a given word divided by…

Computation and Language · Computer Science 2023-03-30 Maciej Eder

There has been much recent work on image captioning models that describe the factual aspects of an image. Recently, some models have incorporated non-factual aspects into the captions, such as sentiment or style. However, such models…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Omid Mohamad Nezami , Mark Dras , Stephen Wan , Cecile Paris

The aim of image captioning is to generate captions by machine to describe image contents. Despite many efforts, generating discriminative captions for images remains non-trivial. Most traditional approaches imitate the language structure…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Xihui Liu , Hongsheng Li , Jing Shao , Dapeng Chen , Xiaogang Wang