English
Related papers

Related papers: Weakly Supervised POS Taggers Perform Poorly on Tr…

200 papers

Linguistic Code Switching (CS) is a phenomenon that occurs when multilingual speakers alternate between two or more languages/dialects within a single conversation. Processing CS data is especially challenging in intra-sentential data given…

Computation and Language · Computer Science 2019-10-08 Fahad AlGhamdi , Mona Diab

Part of Speech (POS) tagging is crucial to Natural Language Processing (NLP). It is a well-studied topic in several resource-rich languages. However, the development of computational linguistic resources is still in its infancy despite the…

Computation and Language · Computer Science 2023-01-25 Dhrubajyoti Pathak , Sukumar Nandi , Priyankoo Sarmah

- The field of natural language processing (NLP) has dramatically expanded within the last decade. Many human-being applications are conducted daily via NLP tasks, starting from machine translation, speech recognition, text generation and…

Part-of-speech (POS) tagging is a process of assigning the words in a text corresponding to a particular part of speech. A fundamental version of POS tagging is the identification of words as nouns, verbs, adjectives etc. For processing…

Computation and Language · Computer Science 2013-10-10 Jyoti Singh , Nisheeth Joshi , Iti Mathur

This paper presents Centre for Development of Advanced Computing Mumbai's (CDACM) submission to the NLP Tools Contest on Part-Of-Speech (POS) Tagging For Code-mixed Indian Social Media Text (POSCMISMT) 2015 (collocated with ICON 2015). We…

Computation and Language · Computer Science 2016-11-01 Prakash B. Pimpale , Raj Nath Patel

In this paper, we explore the ways to improve POS-tagging using various types of auxiliary losses and different word representations. As a baseline, we utilized a BiLSTM tagger, which is able to achieve state-of-the-art results on the…

Computation and Language · Computer Science 2018-07-04 Daniil Anastasyev , Ilya Gusev , Eugene Indenbom

Use of social media has grown dramatically during the last few years. Users follow informal languages in communicating through social media. The language of communication is often mixed in nature, where people transcribe their regional…

Computation and Language · Computer Science 2017-02-03 Deepak Gupta , Shubham Tripathi , Asif Ekbal , Pushpak Bhattacharyya

Choosing an appropriate tokenization scheme is often a bottleneck in low-resource cross-lingual transfer. To understand the downstream implications of text representation choices, we perform a comparative analysis on language models having…

Computation and Language · Computer Science 2023-10-13 Md Mushfiqur Rahman , Fardin Ahsan Sakib , Fahim Faisal , Antonios Anastasopoulos

Cross-lingual transfer is an effective way to build syntactic analysis tools in low-resource languages. However, transfer is difficult when transferring to typologically distant languages, especially when neither annotated target data nor…

Computation and Language · Computer Science 2021-04-30 Junxian He , Zhisong Zhang , Taylor Berg-Kirkpatrick , Graham Neubig

We use a Dynamic Bayesian Network to represent compactly a variety of sublexical and contextual features relevant to Part-of-Speech (PoS) tagging. The outcome is a flexible tagger (LegoTag) with state-of-the-art performance (3.6% error on a…

Computation and Language · Computer Science 2009-09-29 Virginia Savova , Leonid Peshkin

Parsers are available for only a handful of the world's languages, since they require lots of training data. How far can we get with just a small amount of training data? We systematically compare a set of simple strategies for improving…

Computation and Language · Computer Science 2019-09-09 Clara Vania , Yova Kementchedjhieva , Anders Søgaard , Adam Lopez

Given a large amount of unannotated speech in a low-resource language, can we classify the speech utterances by topic? We consider this question in the setting where a small amount of speech in the low-resource language is paired with text…

Computation and Language · Computer Science 2020-03-31 Sameer Bansal , Herman Kamper , Adam Lopez , Sharon Goldwater

Singlish, or Colloquial Singapore English, is a language formed from oral and social communication within multicultural Singapore. In this work, we work on a fundamental Natural Language Processing (NLP) task: Parts-Of-Speech (POS) tagging…

Computation and Language · Computer Science 2024-11-11 Luo Qi Chan , Lynnette Hui Xian Ng

Code-mixed texts are widespread nowadays due to the advent of social media. Since these texts combine two languages to formulate a sentence, it gives rise to various research problems related to Natural Language Processing. In this paper,…

Computation and Language · Computer Science 2020-07-30 Tathagata Raha , Sainik Kumar Mahata , Dipankar Das , Sivaji Bandyopadhyay

Punctuation restoration is an important post-processing step in automatic speech recognition. Among other kinds of external information, part-of-speech (POS) taggers provide informative tags, suggesting each input token's syntactic role,…

Computation and Language · Computer Science 2021-09-08 Ning Shi , Wei Wang , Boxin Wang , Jinfeng Li , Xiangyu Liu , Zhouhan Lin

This paper presents a novel approach for multi-lingual sentiment classification in short texts. This is a challenging task as the amount of training data in languages other than English is very limited. Previously proposed multi-lingual…

Computation and Language · Computer Science 2017-03-08 Jan Deriu , Aurelien Lucchi , Valeria De Luca , Aliaksei Severyn , Simon Müller , Mark Cieliebak , Thomas Hofmann , Martin Jaggi

Neural language models often struggle with low-resource languages due to the limited availability of training data, making tokens from these languages rare in the training set. This paper addresses a specific challenge during training: rare…

Computation and Language · Computer Science 2026-02-02 Galim Turumtaev

Previous Part-Of-Speech (POS) induction models usually assume certain independence assumptions (e.g., Markov, unidirectional, local dependency) that do not hold in real languages. For example, the subject-verb agreement can be both…

Computation and Language · Computer Science 2022-07-01 Xiang Zhou , Shiyue Zhang , Mohit Bansal

Part of speech (POS) tagging is a familiar NLP task. State of the art taggers routinely achieve token-level accuracies of over 97% on news body text, evidence that the problem is well understood. However, the register of English news…

Computation and Language · Computer Science 2021-09-17 Adrian Benton , Hanyang Li , Igor Malioutov

In this paper we propose and carefully evaluate a sequence labeling framework which solely utilizes sparse indicator features derived from dense distributed word representations. The proposed model obtains (near) state-of-the art…

Computation and Language · Computer Science 2016-12-22 Gábor Berend