English
Related papers

Related papers: A CRF Based POS Tagger for Code-mixed Indian Socia…

200 papers

Conditional random fields (CRFs) are usually specified by graphical models but in this paper we propose to use probabilistic logic programs and specify them generatively. Our intension is first to provide a unified approach to CRFs for…

Machine Learning · Computer Science 2014-10-16 Taisuke Sato , Keiichi Kubota , Yoshitaka Kameya

This paper presents the system descriptions submitted at the FIRE Shared Task 2021 on Urdu's Abusive and Threatening Language Detection Task. This challenge aims at automatically identifying abusive and threatening tweets written in Urdu.…

Computation and Language · Computer Science 2022-04-08 Muhammad Humayoun

The configurational information in sentences of a free word order language such as Sanskrit is of limited use. Thus, the context of the entire sentence will be desirable even for basic processing tasks such as word segmentation. We propose…

Computation and Language · Computer Science 2018-10-26 Amrith Krishna , Bishal Santra , Sasi Prasanth Bandaru , Gaurav Sahu , Vishnu Dutt Sharma , Pavankumar Satuluri , Pawan Goyal

In this paper, we give an overview for the shared task at the 4th CCF Conference on Natural Language Processing \& Chinese Computing (NLPCC 2015): Chinese word segmentation and part-of-speech (POS) tagging for micro-blog texts. Different…

Computation and Language · Computer Science 2015-07-01 Xipeng Qiu , Peng Qian , Liusong Yin , Shiyu Wu , Xuanjing Huang

Morphosyntactic lexicons and word vector representations have both proven useful for improving the accuracy of statistical part-of-speech taggers. Here we compare the performances of four systems on datasets covering 16 languages, two of…

Computation and Language · Computer Science 2016-08-10 Benoît Sagot

Code-mixing is the phenomenon of using multiple languages in the same utterance of a text or speech. It is a frequently used pattern of communication on various platforms such as social media sites, online gaming, product reviews, etc.…

Computation and Language · Computer Science 2020-07-24 Vivek Srivastava , Mayank Singh

Conditional Random Field (CRF) based neural models are among the most performant methods for solving sequence labeling problems. Despite its great success, CRF has the shortcoming of occasionally generating illegal sequences of tags, e.g.…

Machine Learning · Computer Science 2021-03-22 Tianwen Wei , Jianwei Qi , Shenghuan He , Songtao Sun

In this paper, we propose a variety of Long Short-Term Memory (LSTM) based models for sequence tagging. These models include LSTM networks, bidirectional LSTM (BI-LSTM) networks, LSTM with a Conditional Random Field (CRF) layer (LSTM-CRF)…

Computation and Language · Computer Science 2015-08-11 Zhiheng Huang , Wei Xu , Kai Yu

We present the results of the Dravidian-CodeMix shared task held at FIRE 2021, a track on sentiment analysis for Dravidian Languages in Code-Mixed Text. We describe the task, its organization, and the submitted systems. This shared task is…

In this paper we present a fundamental lexical semantics of Sinhala language and a Hidden Markov Model (HMM) based Part of Speech (POS) Tagger for Sinhala language. In any Natural Language processing task, Part of Speech is a very vital…

Computation and Language · Computer Science 2014-07-14 A. J. P. M. P. Jayaweera , N. G. J. Dias

Urdu toxic span detection remains limited because most existing systems rely on sentence-level classification and fail to identify the specific toxic spans within those text. It is further exacerbated by the multiple factors i.e. lack of…

Computation and Language · Computer Science 2026-03-06 Inayat Arshad , Fajar Saleem , Ijaz Hussain

Word segmentation plays a pivotal role in improving any Arabic NLP application. Therefore, a lot of research has been spent in improving its accuracy. Off-the-shelf tools, however, are: i) complicated to use and ii) domain/dialect…

Computation and Language · Computer Science 2017-09-05 Hassan Sajjad , Fahim Dalvi , Nadir Durrani , Ahmed Abdelali , Yonatan Belinkov , Stephan Vogel

Recognition of handwritten words continues to be an important problem in document analysis and recognition. Existing approaches extract hand-engineered features from word images--which can perform poorly with new data sets. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Gang Chen , Yawei Li , Sargur N. Srihari

Tagged corpora play a crucial role in a wide range of Natural Language Processing. The Part of Speech Tagging (POST) is essential in developing tagged corpora. It is time-and-effort-consuming and costly, and therefore, it could be more…

Computation and Language · Computer Science 2022-02-01 Hossein Hassani

Text corpora which are tagged with part-of-speech information are useful in many areas of linguistic research. In this paper, a new part-of-speech tagging method based on neural networks (Net- Tagger) is presented and its performance is…

cmp-lg · Computer Science 2008-02-03 Helmut Schmid

This study presents the development of a part-of-speech (POS) tagging model to extract the skeletal structure of sentences using transfer learning with the BERT architecture for token classification. The model, fine-tuned on Russian text,…

Computation and Language · Computer Science 2025-05-20 Grigorii Churakov

Sentiment Analysis is the process of deciphering what a sentence emotes and classifying them as either positive, negative, or neutral. In recent times, India has seen a huge influx in the number of active social media users and this has led…

Computation and Language · Computer Science 2020-09-07 Subhra Jyoti Baroi , Nivedita Singh , Ringki Das , Thoudam Doren Singh

Bidirectional Long Short-Term Memory Recurrent Neural Network (BLSTM-RNN) has been shown to be very effective for tagging sequential data, e.g. speech utterances or handwritten documents. While word embedding has been demoed as a powerful…

Computation and Language · Computer Science 2015-10-22 Peilu Wang , Yao Qian , Frank K. Soong , Lei He , Hai Zhao

Analysis of informative contents and sentiments of social users has been attempted quite intensively in the recent past. Most of the systems are usable only for monolingual data and fails or gives poor results when used on data with…

Computation and Language · Computer Science 2018-03-13 Soumil Mandal , Sainik Kumar Mahata , Dipankar Das

Social media platforms such as Twitter and Facebook are becoming popular in multilingual societies. This trend induces portmanteau of South Asian languages with English. The blend of multiple languages as code-mixed data has recently become…

Computation and Language · Computer Science 2024-03-08 Rajat Singh , Nurendra Choudhary , Manish Shrivastava