English
Related papers

Related papers: Annotation Methodologies for Vision and Language D…

200 papers

Large-scale datasets are essential to modern day deep learning. Advocates argue that understanding these methods requires dataset transparency (e.g. "dataset curation, motivation, composition, collection process, etc..."). However, almost…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Nadine Chang , Francesco Ferroni , Michael J. Tarr , Martial Hebert , Deva Ramanan

We consider the problem of segmenting image regions given a natural language phrase, and study it on a novel dataset of 77,262 images and 345,486 phrase-region pairs. Our dataset is collected on top of the Visual Genome dataset and uses the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Chenyun Wu , Zhe Lin , Scott Cohen , Trung Bui , Subhransu Maji

Deep learning methods typically require vast amounts of training data to reach their full potential. While some publicly available datasets exists, domain specific data always needs to be collected and manually labeled, an expensive, time…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Stefan Hinterstoisser , Olivier Pauly , Hauke Heibel , Martina Marek , Martin Bokeloh

Annotated data plays a critical role in Natural Language Processing (NLP) in training models and evaluating their performance. Given recent developments in Large Language Models (LLMs), models such as ChatGPT demonstrate zero-shot…

Computation and Language · Computer Science 2024-03-18 Minzhi Li , Taiwei Shi , Caleb Ziems , Min-Yen Kan , Nancy F. Chen , Zhengyuan Liu , Diyi Yang

A common practice in building NLP datasets, especially using crowd-sourced annotations, involves obtaining multiple annotator judgements on the same data instances, which are then flattened to produce a single "ground truth" label or score,…

Computation and Language · Computer Science 2021-10-13 Vinodkumar Prabhakaran , Aida Mostafazadeh Davani , Mark Díaz

Computer vision is widely used in the fields of driverless, face recognition and 3D reconstruction as a technology to help or replace human eye perception images or multidimensional data through computers. Nowadays, with the development and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Ming Li , ChenHao Guo

Emotion is a crucial phenomenon in the functioning of human beings in society. However, it remains a widely open subject, particularly in its textual manifestations. This paper examines an industrial corpus manually annotated following an…

Computation and Language · Computer Science 2025-09-03 Jonas Noblet

The datasets most widely used for abusive language detection contain lists of messages, usually tweets, that have been manually judged as abusive or not by one or more annotators, with the annotation performed at message level. In this…

Computation and Language · Computer Science 2021-03-30 Stefano Menini , Alessio Palmero Aprosio , Sara Tonelli

Many real-world applications require automated data annotation, such as identifying tissue origins based on gene expressions and classifying images into semantic categories. Annotation classes are often numerous and subject to changes over…

Computation and Language · Computer Science 2018-07-03 Maxim Grechkin , Hoifung Poon , Bill Howe

New deep-learning architectures are created every year, achieving state-of-the-art results in image recognition and leading to the belief that, in a few years, complex tasks such as sign language translation will be considerably easier,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Alvaro Leandro Cavalcante Carneiro , Lucas de Brito Silva , Denis Henrique Pinheiro Salvadeo

The past few years have witnessed renewed interest in NLP tasks at the interface between vision and language. One intensively-studied problem is that of automatically generating text from images. In this paper, we extend this problem to the…

In essence, embedding algorithms work by optimizing the distance between a word and its usual context in order to generate an embedding space that encodes the distributional representation of words. In addition to single words or word…

Computation and Language · Computer Science 2021-04-14 Andres Garcia-Silva , Ronald Denaux , Jose Manuel Gomez-Perez

Idioms are figurative expressions whose meanings often cannot be inferred from their individual words, making them difficult to process computationally and posing challenges for human experimental studies. This survey reviews datasets…

Computation and Language · Computer Science 2025-08-19 Michael Flor , Xinyi Liu , Anna Feldman

Data annotation, the practice of assigning descriptive labels to raw data, is pivotal in optimizing the performance of machine learning models. However, it is a resource-intensive process susceptible to biases introduced by annotators. The…

Human intelligence can remarkably adapt quickly to new tasks and environments. Starting from a very young age, humans acquire new skills and learn how to solve new tasks either by imitating the behavior of others or by following provided…

High-level 3D scene understanding is essential in many applications. However, the challenges of generating accurate 3D annotations make development of deep learning models difficult. We turn to recent advancements in automatic retrieval of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Yuchen Rao , Stefan Ainetter , Sinisa Stekovic , Vincent Lepetit , Friedrich Fraundorfer

Recent advances in artificial intelligence, including the development of highly sophisticated large language models (LLM), have proven beneficial in many real-world applications. However, evidence of inherent bias encoded in these LLMs has…

Computation and Language · Computer Science 2023-09-19 Vithya Yogarajan , Gillian Dobbie , Timothy Pistotti , Joshua Bensemann , Kobe Knowles

Image captioning implies automatically generating textual descriptions of images based only on the visual input. Although this has been an extensively addressed research topic in recent years, not many contributions have been made in the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Eva Cetinic

Natural Language Inference (NLI) is foundational for evaluating language understanding in AI. However, progress has plateaued, with models failing on ambiguous examples and exhibiting poor generalization. We argue that this stems from…

Computation and Language · Computer Science 2024-05-21 Claudiu Creanga , Liviu P. Dinu

Pre-trained language models have shown excellent results in few-shot learning scenarios using in-context learning. Although it is impressive, the size of language models can be prohibitive to make them usable in on-device applications, such…

Computation and Language · Computer Science 2022-04-27 Navid Rezaei , Marek Z. Reformat