English
Related papers

Related papers: A CRF Based POS Tagger for Code-mixed Indian Socia…

200 papers

In this paper we present a Marathi part of speech tagger. It is a morphologically rich language. It is spoken by the native people of Maharashtra. The general approach used for development of tagger is statistical using trigram Method. The…

Computation and Language · Computer Science 2013-07-17 Jyoti Singh , Nisheeth Joshi , Iti Mathur

Developing an automatic part-of-speech (POS) tagging for any new language is considered a necessary step for further computational linguistics methodology beyond tagging, like chunking and parsing, to be fully applied to the language. Many…

Computation and Language · Computer Science 2021-10-12 Onyenwe Ikechukwu , Onyedikachukwu Ikechukwu-Onyenwe , Onyedinma Ebele

Natural language processing (NLP) has experienced rapid advancements with the rise of deep learning, significantly outperforming traditional rule-based methods. By capturing hidden patterns and underlying structures within data, deep…

Computation and Language · Computer Science 2024-10-18 Dipendra Yadav , Tobias Strauß , Kristina Yordanova

We present a character-based model for joint segmentation and POS tagging for Chinese. The bidirectional RNN-CRF architecture for general sequence tagging is adapted and applied with novel vector representations of Chinese characters that…

Computation and Language · Computer Science 2017-09-13 Yan Shao , Christian Hardmeier , Jörg Tiedemann , Joakim Nivre

Building a multilingual Automated Speech Recognition (ASR) system in a linguistically diverse country like India can be a challenging task due to the differences in scripts and the limited availability of speech data. This problem can be…

Computation and Language · Computer Science 2023-06-01 Kaousheik Jayakumar , Vrunda N. Sukhadia , A Arunkumar , S. Umesh

The Yunshan Cup 2020 track focused on creating a framework for evaluating different methods of part-of-speech (POS). There were two tasks for this track: (1) POS tagging for the Indonesian language, and (2) POS tagging for the Lao tagging.…

Computation and Language · Computer Science 2022-04-07 Yingwen Fu , Jinyi Chen , Nankai Lin , Xixuan Huang , Xinying Qiu , Shengyi Jiang

Khmer text is written from left to right with optional space. Space is not served as a word boundary but instead, it is used for readability or other functional purposes. Word segmentation is a prior step for downstream tasks such as…

Computation and Language · Computer Science 2021-04-01 Rina Buoy , Nguonly Taing , Sokchea Kor

POS Tagging serves as a preliminary task for many NLP applications. Kannada is a relatively poor Indian language with very limited number of quality NLP tools available for use. An accurate and reliable POS Tagger is essential for many NLP…

Computation and Language · Computer Science 2018-08-10 Ketan Kumar Todi , Pruthwik Mishra , Dipti Misra Sharma

Syntactic annotation of corpora in the form of part-of-speech (POS) tags is a key requirement for both linguistic research and subsequent automated natural language processing (NLP) tasks. This problem is commonly tackled using machine…

Computation and Language · Computer Science 2024-10-30 Stefan Heid , Marcel Wever , Eyke Hüllermeier

Part-of-speech (POS) taggers for low-resource languages which are exclusively based on various forms of weak supervision - e.g., cross-lingual transfer, type-level supervision, or a combination thereof - have been reported to perform almost…

Computation and Language · Computer Science 2020-04-29 Katharina Kann , Ophélie Lacroix , Anders Søgaard

Linguistic Code Switching (CS) is a phenomenon that occurs when multilingual speakers alternate between two or more languages/dialects within a single conversation. Processing CS data is especially challenging in intra-sentential data given…

Computation and Language · Computer Science 2019-10-08 Fahad AlGhamdi , Mona Diab

Researches on Indonesian named entity (NE) tagger have been conducted since years ago. However, most did not use deep learning and instead employed traditional machine learning algorithms such as association rule, support vector machine,…

Computation and Language · Computer Science 2020-09-15 Devin Hoesen , Ayu Purwarianti

This paper reports about our work in the NLP Tool Contest @ICON-2017, shared task on Sentiment Analysis for Indian Languages (SAIL) (code mixed). To implement our system, we have used a machine learning algo-rithm called Multinomial Na\"ive…

Computation and Language · Computer Science 2018-02-19 Kamal Sarkar

This paper proposes hybrid semi-Markov conditional random fields (SCRFs) for neural sequence labeling in natural language processing. Based on conventional conditional random fields (CRFs), SCRFs have been designed for the tasks of…

Computation and Language · Computer Science 2018-05-11 Zhi-Xiu Ye , Zhen-Hua Ling

In the recent past, social media platforms have helped people in connecting and communicating to a wider audience. But this has also led to a drastic increase in cyberbullying. It is essential to detect and curb hate speech to keep the…

Computation and Language · Computer Science 2021-11-02 Ravindra Nayak , Raviraj Joshi

In recent years, large-scale pre-trained language models (PLMs) have made extraordinary progress in most NLP tasks. But, in the unsupervised POS tagging task, works utilizing PLMs are few and fail to achieve state-of-the-art (SOTA)…

Computation and Language · Computer Science 2022-03-22 Houquan Zhou , Yang Li , Zhenghua Li , Min Zhang

Sentiment analysis has been an active area of research in the past two decades and recently, with the advent of social media, there has been an increasing demand for sentiment analysis on social media texts. Since the social media texts are…

Computation and Language · Computer Science 2020-10-21 Sainik Kumar Mahata , Dipankar Das , Sivaji Bandyopadhyay

Hindi being a highly inflectional language, FST (Finite State Transducer) based approach is most efficient for developing a morphological analyzer for this language. The work presented in this paper uses the SFST (Stuttgart Finite State…

Computation and Language · Computer Science 2012-07-24 Deepak Kumar , Manjeet Singh , Seema Shukla

Most work on part-of-speech (POS) tagging is focused on high resource languages, or examines low-resource and active learning settings through simulated studies. We evaluate POS tagging techniques on an actual endangered language, Griko. We…

Computation and Language · Computer Science 2018-06-12 Antonis Anastasopoulos , Marika Lekakou , Josep Quer , Eleni Zimianiti , Justin DeBenedetto , David Chiang

Introduction: Part-of-Speech (POS) Tagging, the process of classifying words into their respective parts of speech (e.g., verb or noun), is essential in various natural language processing applications. POS tagging is a crucial…

Computation and Language · Computer Science 2023-10-03 Leyla Rabiei , Farzaneh Rahmani , Mohammad Khansari , Zeinab Rajabi , Moein Salimi