English
Related papers

Related papers: From Word Segmentation to POS Tagging for Vietname…

200 papers

Grammar Detection, also referred to as Parts of Speech Tagging of raw text, is considered an underlying building block of the various Natural Language Processing pipelines like named entity recognition, question answering, and sentiment…

Computation and Language · Computer Science 2022-12-06 Surya Teja Chavali , Charan Tej Kandavalli , Sugash T M

Due to the scarcity of part-of-speech annotated data, existing studies on low-resource languages typically adopt unsupervised approaches for POS tagging. Among these, POS tag projection with word alignment method transfers POS tags from a…

Computation and Language · Computer Science 2026-02-11 Jianyu Zheng

To the best of our knowledge, this paper made the first attempt to answer whether word segmentation is necessary for Vietnamese sentiment classification. To do this, we presented five pre-trained monolingual S4- based language models for…

Computation and Language · Computer Science 2023-01-03 Duc-Vu Nguyen , Ngan Luu-Thuy Nguyen

This study presents the development of a part-of-speech (POS) tagging model to extract the skeletal structure of sentences using transfer learning with the BERT architecture for token classification. The model, fine-tuned on Russian text,…

Computation and Language · Computer Science 2025-05-20 Grigorii Churakov

We address the problem of Part of Speech tagging (POS) in the context of linguistic code switching (CS). CS is the phenomenon where a speaker switches between two languages or variants of the same language within or across utterances, known…

Computation and Language · Computer Science 2019-11-05 Fahad AlGhamdi , Giovanni Molina , Mona Diab , Thamar Solorio , Abdelati Hawwari , Victor Soto , Julia Hirschberg

This paper describes our study on using mutilingual BERT embeddings and some new neural models for improving sequence tagging tasks for the Vietnamese language. We propose new model architectures and evaluate them extensively on two named…

Computation and Language · Computer Science 2020-09-28 Viet Bui The , Oanh Tran Thi , Phuong Le-Hong

Part of speech (POS) tagging is a familiar NLP task. State of the art taggers routinely achieve token-level accuracies of over 97% on news body text, evidence that the problem is well understood. However, the register of English news…

Computation and Language · Computer Science 2021-09-17 Adrian Benton , Hanyang Li , Igor Malioutov

Previous Part-Of-Speech (POS) induction models usually assume certain independence assumptions (e.g., Markov, unidirectional, local dependency) that do not hold in real languages. For example, the subject-verb agreement can be both…

Computation and Language · Computer Science 2022-07-01 Xiang Zhou , Shiyue Zhang , Mohit Bansal

We demonstrate the effectiveness of multilingual learning for unsupervised part-of-speech tagging. The central assumption of our work is that by combining cues from multiple languages, the structure of each becomes more apparent. We…

Computation and Language · Computer Science 2014-01-23 Tahira Naseem , Benjamin Snyder , Jacob Eisenstein , Regina Barzilay

Word segmentation plays a pivotal role in improving any Arabic NLP application. Therefore, a lot of research has been spent in improving its accuracy. Off-the-shelf tools, however, are: i) complicated to use and ii) domain/dialect…

Computation and Language · Computer Science 2017-09-05 Hassan Sajjad , Fahim Dalvi , Nadir Durrani , Ahmed Abdelali , Yonatan Belinkov , Stephan Vogel

Automatic Part-of-speech (POS) tagging is a preprocessing step of many natural language processing (NLP) tasks such as name entity recognition (NER), speech processing, information extraction, word sense disambiguation, and machine…

Computation and Language · Computer Science 2022-07-08 Tusarkanta Dalai , Tapas Kumar Mishra , Pankaj K Sa

The elastic-input neuro tagger and hybrid tagger, combined with a neural network and Brill's error-driven learning, have already been proposed for the purpose of constructing a practical tagger using as little training data as possible.…

Computation and Language · Computer Science 2007-05-23 Masaki Murata , Qing Ma , Hitoshi Isahara

While part-of-speech (POS) tagging and dependency parsing are observed to be closely related, existing work on joint modeling with manually crafted feature templates suffers from the feature sparsity and incompleteness problems. In this…

Computation and Language · Computer Science 2017-04-26 Liner Yang , Meishan Zhang , Yang Liu , Nan Yu , Maosong Sun , Guohong Fu

POS tagging plays a fundamental role in numerous applications. While POS taggers are highly accurate in well-resourced settings, they lag behind in cases of limited or missing training data. This paper focuses on POS tagging for languages…

Computation and Language · Computer Science 2024-10-15 Zeno Vandenbulcke , Lukas Vermeire , Miryam de Lhoneux

The Yunshan Cup 2020 track focused on creating a framework for evaluating different methods of part-of-speech (POS). There were two tasks for this track: (1) POS tagging for the Indonesian language, and (2) POS tagging for the Lao tagging.…

Computation and Language · Computer Science 2022-04-07 Yingwen Fu , Jinyi Chen , Nankai Lin , Xixuan Huang , Xinying Qiu , Shengyi Jiang

Dependency treebank is an important resource in any language. In this paper, we present our work on building BKTreebank, a dependency treebank for Vietnamese. Important points on designing POS tagset, dependency relations, and annotation…

Computation and Language · Computer Science 2018-02-22 Kiem-Hieu Nguyen

The number of word forms in agglutinative languages is theoretically infinite and this variety in word forms introduces sparsity in many natural language processing tasks. Part-of-speech tagging (PoS tagging) is one of these tasks that…

Computation and Language · Computer Science 2017-05-26 Necva Bölücü , Burcu Can

We present the first multi-task learning model -- named PhoNLP -- for joint Vietnamese part-of-speech (POS) tagging, named entity recognition (NER) and dependency parsing. Experiments on Vietnamese benchmark datasets show that PhoNLP…

Computation and Language · Computer Science 2021-04-09 Linh The Nguyen , Dat Quoc Nguyen

Part-of-Speech (POS) tagging is an important component of the NLP pipeline, but many low-resource languages lack labeled data for training. An established method for training a POS tagger in such a scenario is to create a labeled training…

Computation and Language · Computer Science 2022-11-01 Ayyoob Imani , Silvia Severini , Masoud Jalili Sabet , François Yvon , Hinrich Schütze

Probabilistic approaches to part-of-speech tagging rely primarily on whole-word statistics about word/tag combinations as well as contextual information. But experience shows about 4 per cent of tokens encountered in test sets are unknown…

Computation and Language · Computer Science 2013-02-28 Greg Adams , Beth Millar , Eric Neufeld , Tim Philip