English
Related papers

Related papers: Crowdsourcing Universal Part-Of-Speech Tags for Co…

200 papers

We propose a meta-learning method for learning from multiple noisy annotators. In many applications such as crowdsourcing services, labels for supervised learning are given by multiple annotators. Since the annotators have different skills…

Machine Learning · Computer Science 2025-06-13 Atsutoshi Kumagai , Tomoharu Iwata , Taishi Nishiyama , Yasutoshi Ida , Yasuhiro Fujiwara

Code-Switching (CS) multilingual Automatic Speech Recognition (ASR) models can transcribe speech containing two or more alternating languages during a conversation. This paper proposes (1) a new method for creating code-switching ASR…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-19 Kunal Dhawan , Dima Rekesh , Boris Ginsburg

Annotation quality and quantity positively affect the learning performance of sequence labeling, a vital task in Natural Language Processing. Hiring domain experts to annotate a corpus is very costly in terms of money and time.…

Human-Computer Interaction · Computer Science 2023-07-04 Nasim Sabetpour , Adithya Kulkarni , Sihong Xie , Qi Li

Recent trends in natural language processing research and annotation tasks affirm a paradigm shift from the traditional reliance on a single ground truth to a focus on individual perspectives, particularly in subjective tasks. In scenarios…

Computation and Language · Computer Science 2024-04-18 Olufunke O. Sarumi , Béla Neuendorf , Joan Plepi , Lucie Flek , Jörg Schlötterer , Charles Welch

Lately, the problem of code-switching has gained a lot of attention and has emerged as an active area of research. In bilingual communities, the speakers commonly embed the words and phrases of a non-native language into the syntax of a…

Computation and Language · Computer Science 2017-11-13 Ganji Sreeram , Rohit Sinha

To date, efforts in the code-switching literature have focused for the most part on language identification, POS, NER, and syntactic parsing. In this paper, we address machine translation for code-switched social media data. We create a…

Computation and Language · Computer Science 2022-02-22 Shuguang Chen , Gustavo Aguilar , Anirudh Srinivasan , Mona Diab , Thamar Solorio

Most languages, especially in Africa, have fewer or no established part-of-speech (POS) tagged corpus. However, POS tagged corpus is essential for natural language processing (NLP) to support advanced researches such as machine translation,…

Computation and Language · Computer Science 2019-03-14 Onyenwe Ikechukwu E , Onyedinma Ebele G , Aniegwu Godwin E , Ezeani Ignatius M

Crowdsourcing is widely used to create data for common natural language understanding tasks. Despite the importance of these datasets for measuring and refining model understanding of language, there has been little focus on the…

Computation and Language · Computer Science 2021-06-03 Nikita Nangia , Saku Sugawara , Harsh Trivedi , Alex Warstadt , Clara Vania , Samuel R. Bowman

A common practice in building NLP datasets, especially using crowd-sourced annotations, involves obtaining multiple annotator judgements on the same data instances, which are then flattened to produce a single "ground truth" label or score,…

Computation and Language · Computer Science 2021-10-13 Vinodkumar Prabhakaran , Aida Mostafazadeh Davani , Mark Díaz

Despite the recent advances in multi-task learning of dense prediction problems, most methods rely on expensive labelled datasets. In this paper, we present a label efficient approach and look at jointly learning of multiple dense…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wei-Hong Li , Xialei Liu , Hakan Bilen

Many multilingual communities, including numerous in Africa, frequently engage in code-switching during conversations. This behaviour stresses the need for natural language processing technologies adept at processing code-switched text.…

Computation and Language · Computer Science 2024-04-29 Michelle Terblanche , Kayode Olaleye , Vukosi Marivate

An important and difficult task in code-switched speech recognition is to recognize the language, as lots of words in two languages can sound similar, especially in some accents. We focus on improving performance of end-to-end Automatic…

Computation and Language · Computer Science 2024-03-14 Yash Sharma , Basil Abraham , Preethi Jyothi

Scaling semantic parsing models for task-oriented dialog systems to new languages is often expensive and time-consuming due to the lack of available datasets. Available datasets suffer from several shortcomings: a) they contain few…

Computation and Language · Computer Science 2021-01-28 Haoran Li , Abhinav Arora , Shuohui Chen , Anchit Gupta , Sonal Gupta , Yashar Mehdad

This paper has two goals. First, we present the turn-taking annotation layers created for 95 minutes of conversational speech of the Graz Corpus of Read and Spontaneous Speech (GRASS), available to the scientific community. Second, we…

Computation and Language · Computer Science 2025-04-15 Anneliese Kelterer , Barbara Schuppler

Public health researchers are increasingly interested in using social media data to study health-related behaviors, but manually labeling this data can be labor-intensive and costly. This study explores whether zero-shot labeling using…

Computation and Language · Computer Science 2025-02-11 Kamyar Kazari , Yong Chen , Zahra Shakeri

Crowdsourcing systems often have crowd workers that perform unreliable work on the task they are assigned. In this paper, we propose the use of error-control codes and decoding algorithms to design crowdsourcing systems for reliable…

Information Theory · Computer Science 2015-06-17 Aditya Vempaty , Lav R. Varshney , Pramod K. Varshney

In this paper, we study the use of soft labels to train a system for sound event detection (SED). Soft labels can result from annotations which account for human uncertainty about categories, or emerge as a natural representation of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-01 Irene Martín-Morató , Manu Harju , Paul Ahokas , Annamaria Mesaros

We propose a unified neural network architecture and learning algorithm that can be applied to various natural language processing tasks including: part-of-speech tagging, chunking, named entity recognition, and semantic role labeling. This…

Machine Learning · Computer Science 2011-03-03 Ronan Collobert , Jason Weston , Leon Bottou , Michael Karlen , Koray Kavukcuoglu , Pavel Kuksa

Code-switching (CS), the alternation between two or more languages within a single conversation, presents significant challenges for automatic speech recognition (ASR) systems. Existing Mandarin-English code-switching datasets often suffer…

Computation and Language · Computer Science 2025-03-13 Jiaming Zhou , Yujie Guo , Shiwan Zhao , Haoqin Sun , Hui Wang , Jiabei He , Aobo Kong , Shiyao Wang , Xi Yang , Yequan Wang , Yonghua Lin , Yong Qin

Language Identification (LID) is a core task in multilingual NLP, yet current systems often overfit to clean, monolingual data. This work introduces DIVERS-BENCH, a comprehensive evaluation of state-of-the-art LID models across diverse…

Computation and Language · Computer Science 2025-09-23 Jessica Ojo , Zina Kamel , David Ifeoluwa Adelani