English
Related papers

Related papers: Estimating Agreement by Chance for Sequence Annota…

200 papers

When constructing models that learn from noisy labels produced by multiple annotators, it is important to accurately estimate the reliability of annotators. Annotators may provide labels of inconsistent quality due to their varying…

Computation and Language · Computer Science 2019-05-14 Maolin Li , Arvid Fahlström Myrman , Tingting Mu , Sophia Ananiadou

Human evaluation of machine translation is in an arms race with translation model quality: as our models get better, our evaluation methods need to be improved to ensure that quality gains are not lost in evaluation noise. To this end, we…

Computation and Language · Computer Science 2025-10-29 Parker Riley , Daniel Deutsch , Mara Finkelstein , Colten DiIanni , Juraj Juraska , Markus Freitag

In this work we introduce a novel approach, based on sampling, for finding assignments that are likely to be solutions to stochastic constraint satisfaction problems and constraint optimisation problems. Our approach reduces the size of the…

Optimization and Control · Mathematics 2015-09-22 Roberto Rossi , Brahim Hnich , S. Armagan Tarim , Steven Prestwich

Machine learning (ML) and artificial intelligence (AI) systems rely heavily on human-annotated data for training and evaluation. A major challenge in this context is the occurrence of annotation errors, as their effects can degrade model…

Machine Learning · Computer Science 2024-09-27 Heinrich Peters , Alireza Hashemi , James Rae

Knowing exactly how many data points need to be labeled to achieve a certain model performance is a hugely beneficial step towards reducing the overall budgets for annotation. It pertains to both active learning and traditional data…

Computation and Language · Computer Science 2023-07-04 Ernie Chang , Muhammad Hassan Rashid , Pin-Jie Lin , Changsheng Zhao , Vera Demberg , Yangyang Shi , Vikas Chandra

Sequence alignments are used to capture patterns composed of elements representing multiple conceptual levels through the alignment of sequences that contain overlapping and variable length annotations. The alignments also determine the…

Computation and Language · Computer Science 2019-09-19 Frank Meng , Craig A. Morioka , Danne C. Elbers

We consider the scene text recognition problem under the attention-based encoder-decoder framework, which is the state of the art. The existing methods usually employ a frame-wise maximal likelihood loss to optimize the models. When we…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Fan Bai , Zhanzhan Cheng , Yi Niu , Shiliang Pu , Shuigeng Zhou

High-quality human annotations are necessary to create effective machine learning systems for social media. Low-quality human annotations indirectly contribute to the creation of inaccurate or biased learning systems. We show that human…

Social and Information Networks · Computer Science 2019-07-18 Rahul Pandey , Carlos Castillo , Hemant Purohit

Supporting model interpretability for complex phenomena where annotators can legitimately disagree, such as emotion recognition, is a challenging machine learning task. In this work, we show that explicitly quantifying the uncertainty in…

Machine Learning · Computer Science 2019-10-08 Asma Ghandeharioun , Brian Eoff , Brendan Jou , Rosalind W. Picard

Automatic spelling and grammatical correction systems are one of the most widely used tools within natural language applications. In this thesis, we assume the task of error correction as a type of monolingual machine translation where the…

Computation and Language · Computer Science 2018-10-02 Sina Ahmadi

This report explores the use of paragraph break probability estimates to help predict the location of sentence breaks in English natural language text. We show that a sentence break predictor based almost solely on paragraph break…

Computation and Language · Computer Science 2021-09-27 Robert C. Moore

Inferring the probability distribution of sentences or word sequences is a key process in natural language processing. While word-level language models (LMs) have been widely adopted for computing the joint probabilities of word sequences,…

Computation and Language · Computer Science 2021-03-16 Heewoong Park , Sukhyun Cho , Jonghun Park

Annotated data plays a critical role in Natural Language Processing (NLP) in training models and evaluating their performance. Given recent developments in Large Language Models (LLMs), models such as ChatGPT demonstrate zero-shot…

Computation and Language · Computer Science 2024-03-18 Minzhi Li , Taiwei Shi , Caleb Ziems , Min-Yen Kan , Nancy F. Chen , Zhengyuan Liu , Diyi Yang

Annually, research teams spend large amounts of money to evaluate the quality of machine translation systems (WMT, inter alia). This is expensive because it requires a lot of expert human labor. In the recently adopted annotation protocol,…

Computation and Language · Computer Science 2025-01-30 Vilém Zouhar , Tom Kocmi , Mrinmaya Sachan

As text generated by large language models proliferates, it becomes vital to understand how humans engage with such text, and whether or not they are able to detect when the text they are reading did not originate with a human writer. Prior…

Computation and Language · Computer Science 2022-12-27 Liam Dugan , Daphne Ippolito , Arun Kirubarajan , Sherry Shi , Chris Callison-Burch

Corpus-based methods for natural language processing often use supervised training, requiring expensive manual annotation of training corpora. This paper investigates methods for reducing annotation cost by {\it sample selection}. In this…

cmp-lg · Computer Science 2008-02-03 Sean P. Engelson , Ido Dagan

Active learning is able to significantly reduce the annotation cost for data-driven techniques. However, previous active learning approaches for natural language processing mainly depend on the entropy-based uncertainty criterion, and…

Computation and Language · Computer Science 2020-10-13 Guirong Bai , Shizhu He , Kang Liu , Jun Zhao , Zaiqing Nie

Modern neural networks have greatly improved performance across speech recognition benchmarks. However, gains are often driven by frequent words with limited semantic weight, which can obscure meaningful differences in word error rate, the…

Computation and Language · Computer Science 2026-04-21 Lasse Borgholt , Jakob Havtorn , Christian Igel , Lars Maaløe , Zheng-Hua Tan

Studies of writing revisions rarely focus on revision quality. To address this issue, we introduce a corpus of between-draft revisions of student argumentative essays, annotated as to whether each revision improves essay quality. We…

Computation and Language · Computer Science 2019-09-13 Tazin Afrin , Diane Litman

We introduce probability estimation, a broadly applicable framework to certify randomness in a finite sequence of measurement results without assuming that these results are independent and identically distributed. Probability estimation…

Quantum Physics · Physics 2018-11-30 Yanbao Zhang , Emanuel Knill , Peter Bierhorst