English
Related papers

Related papers: Feature-Rich Part-of-speech Tagging for Morphologi…

200 papers

This paper presents a corpus manually annotated with named entities for six Slavic languages - Bulgarian, Czech, Polish, Slovenian, Russian, and Ukrainian. This work is the result of a series of shared tasks, conducted in 2017-2023 as a…

Computation and Language · Computer Science 2024-04-09 Jakub Piskorski , Michał Marcińczuk , Roman Yangarber

This paper presents an ensemble part-of-speech tagging approach for source code identifiers. Ensemble tagging is a technique that uses machine-learning and the output from multiple part-of-speech taggers to annotate natural language text at…

Large language models (LLMs) have recently reached an impressive level of linguistic capability, prompting comparisons with human language skills. However, there have been relatively few systematic inquiries into the linguistic capabilities…

Agglutinative languages such as Turkish, Finnish and Hungarian require morphological disambiguation before further processing due to the complex morphology of words. A morphological disambiguator is used to select the correct morphological…

Computation and Language · Computer Science 2017-02-14 Eray Yildiz , Caglar Tirkaz , H. Bahadir Sahin , Mustafa Tolga Eren , Ozan Sonmez

This paper presents a scalable method for integrating compositional morphological representations into a vector-based probabilistic language model. Our approach is evaluated in the context of log-bilinear language models, rendered suitably…

Computation and Language · Computer Science 2014-05-19 Jan A. Botha , Phil Blunsom

We develop neural morphological tagging and disambiguation models for Estonian. First, we experiment with two neural architectures for morphological tagging - a standard multiclass classifier which treats each morphological tag as a single…

Computation and Language · Computer Science 2018-10-17 Alexander Tkachenko , Kairit Sirts

We introduce COMBO - a fully neural NLP system for accurate part-of-speech tagging, morphological analysis, lemmatisation, and (enhanced) dependency parsing. It predicts categorical morphosyntactic features whilst also exposes their vector…

Computation and Language · Computer Science 2021-09-14 Mateusz Klimaszewski , Alina Wróblewska

Our dictionary-based lemmatizer for the Bulgarian language presented here is distributed as free software, publicly available to download and use under the GPL v3 license. The presented software is written entirely in Java and is…

Computation and Language · Computer Science 2015-06-16 Grigor Iliev , Nadezhda Borisova , Elena Karashtranova , Dafina Kostadinova

Tagged corpora play a crucial role in a wide range of Natural Language Processing. The Part of Speech Tagging (POST) is essential in developing tagged corpora. It is time-and-effort-consuming and costly, and therefore, it could be more…

Computation and Language · Computer Science 2022-02-01 Hossein Hassani

This paper studies the effects of word-level linguistic annotations in under-resourced neural machine translation, for which there is incomplete evidence in the literature. The study covers eight language pairs, different training corpus…

Computation and Language · Computer Science 2024-01-31 Víctor M. Sánchez-Cartagena , Juan Antonio Pérez-Ortiz , Felipe Sánchez-Martínez

This paper outlines the results of sentence level linguistics based rules for improving part-of-speech tagging. It is well known that the performance of complex NLP systems is negatively affected if one of the preliminary stages is less…

Computation and Language · Computer Science 2017-08-02 Vishaal Jatav , Ravi Teja , Srini Bharadwaj , Venkat Srinivasan

A major hurdle in data-driven research on typology is having sufficient data in many languages to draw meaningful conclusions. We present VoxClamantis v1.0, the first large-scale corpus for phonetic typology, with aligned segments and…

Computation and Language · Computer Science 2020-05-29 Elizabeth Salesky , Eleanor Chodroff , Tiago Pimentel , Matthew Wiesner , Ryan Cotterell , Alan W Black , Jason Eisner

We propose to cast the task of morphological inflection - mapping a lemma to an indicated inflected form - for resource-poor languages as a meta-learning problem. Treating each language as a separate task, we use data from high-resource…

Computation and Language · Computer Science 2020-04-29 Katharina Kann , Samuel R. Bowman , Kyunghyun Cho

Part-of-Speech (POS) tagging is an old and fundamental task in natural language processing. While supervised POS taggers have shown promising accuracy, it is not always feasible to use supervised methods due to lack of labeled data. In this…

Computation and Language · Computer Science 2018-01-12 Omid Kashefi

The rise of neural networks, and particularly recurrent neural networks, has produced significant advances in part-of-speech tagging accuracy. One characteristic common among these models is the presence of rich initial word encodings.…

Computation and Language · Computer Science 2018-05-23 Bernd Bohnet , Ryan McDonald , Goncalo Simoes , Daniel Andor , Emily Pitler , Joshua Maynez

We present BgGPT-Gemma-2-27B-Instruct and BgGPT-Gemma-2-9B-Instruct: continually pretrained and fine-tuned versions of Google's Gemma-2 models, specifically optimized for Bulgarian language understanding and generation. Leveraging Gemma-2's…

Computation and Language · Computer Science 2024-12-17 Anton Alexandrov , Veselin Raychev , Dimitar I. Dimitrov , Ce Zhang , Martin Vechev , Kristina Toutanova

We present bgGLUE(Bulgarian General Language Understanding Evaluation), a benchmark for evaluating language models on Natural Language Understanding (NLU) tasks in Bulgarian. Our benchmark includes NLU tasks targeting a variety of NLP…

In this paper we present a Marathi part of speech tagger. It is a morphologically rich language. It is spoken by the native people of Maharashtra. The general approach used for development of tagger is statistical using trigram Method. The…

Computation and Language · Computer Science 2013-07-17 Jyoti Singh , Nisheeth Joshi , Iti Mathur

Thanks to the Eslo1 ("Enqu\^ete sociolinguistique d'Orl\'eans", i.e. "Sociolinguistic Inquiery of Orl\'eans") campain, a large oral corpus has been gathered and transcribed in a textual format. The purpose of the work presented here is to…

Machine Learning · Computer Science 2010-03-31 Iris Eshkol , Isabelle Tellier , Taalab Samer , Sylvie Billot

Part-of-speech (POS) tagging is a fundamental component for performing natural language tasks such as parsing, information extraction, and question answering. When POS taggers are trained in one domain and applied in significantly different…

Computation and Language · Computer Science 2014-11-04 John E. Miller , Michael Bloodgood , Manabu Torii , K. Vijay-Shanker