English
Related papers

Related papers: Development of POS tagger for English-Bengali Code…

200 papers

This paper reports about our work in the NLP Tool Contest @ICON-2017, shared task on Sentiment Analysis for Indian Languages (SAIL) (code mixed). To implement our system, we have used a machine learning algo-rithm called Multinomial Na\"ive…

Computation and Language · Computer Science 2018-02-19 Kamal Sarkar

Part-of-speech (POS) tagging for Medieval Romance languages remains challenging due to orthographic variation, morphological complexity, and limited annotated resources. This paper presents a systematic empirical evaluation of large…

Computation and Language · Computer Science 2026-05-12 Matthias Schöffel , Esteban Garces Arias

One of the most popular downstream tasks in the field of Natural Language Processing is text classification. Text classification tasks have become more daunting when the texts are code-mixed. Though they are not exposed to such text during…

Computation and Language · Computer Science 2024-03-15 Md Nishat Raihan , Dhiman Goswami , Antara Mahmud

Neural Networks and Deep Learning have seen an upsurge of research in the past decade due to the improved results. Generates text from the given image is a crucial task that requires the combination of both sectors which are computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Abrar Hasin Kamal , Md. Asifuzzaman Jishan , Nafees Mansoor

Code-switching is a phenomenon of mixing grammatical structures of two or more languages under varied social constraints. The code-switching data differ so radically from the benchmark corpora used in NLP community that the application of…

Computation and Language · Computer Science 2018-04-25 Irshad Ahmad Bhat , Riyaz Ahmad Bhat , Manish Shrivastava , Dipti Misra Sharma

Punctuation restoration is an important post-processing step in automatic speech recognition. Among other kinds of external information, part-of-speech (POS) taggers provide informative tags, suggesting each input token's syntactic role,…

Computation and Language · Computer Science 2021-09-08 Ning Shi , Wei Wang , Boxin Wang , Jinfeng Li , Xiangyu Liu , Zhouhan Lin

Code-mixed machine translation has become an important task in multilingual communities and extending the task of machine translation to code mixed data has become a common task for these languages. In the shared tasks of WMT 2022, we try…

Computation and Language · Computer Science 2022-10-25 Akshat Gahoi , Jayant Duneja , Anshul Padhi , Shivam Mangale , Saransh Rajput , Tanvi Kamble , Dipti Misra Sharma , Vasudeva Varma

As the interaction over the web has increased, incidents of aggression and related events like trolling, cyberbullying, flaming, hate speech, etc. too have increased manifold across the globe. While most of these behaviour like bullying or…

Computation and Language · Computer Science 2018-03-28 Ritesh Kumar , Aishwarya N. Reganti , Akshit Bhatia , Tushar Maheshwari

Chinese word segmentation and part-of-speech tagging are necessary tasks in terms of computational linguistics and application of natural language processing. Many re-searchers still debate the demand for Chinese word segmentation and…

Computation and Language · Computer Science 2021-12-20 Duc-Vu Nguyen , Linh-Bao Vo , Ngoc-Linh Tran , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

A recent study reported development of Muscorian, a generic text processing tool for extracting protein-protein interactions from text that achieved comparable performance to biomedical-specific text processing tools. This result was…

Computation and Language · Computer Science 2008-04-03 Maurice HT Ling , Christophe Lefevre , Kevin R. Nicholas

Sentiment analysis (SA) is a process of identifying the emotional tone or polarity within a given text and aims to uncover the user's complex emotions and inner feelings. While sentiment analysis has been extensively studied for languages…

Machine Learning · Computer Science 2025-04-24 Hemal Mahmud , Hasan Mahmud , Mohammad Rifat Ahmmad Rashid

There is an increasing demand for goal-oriented conversation systems which can assist users in various day-to-day activities such as booking tickets, restaurant reservations, shopping, etc. Most of the existing datasets for building such…

Computation and Language · Computer Science 2018-06-18 Suman Banerjee , Nikita Moghe , Siddhartha Arora , Mitesh M. Khapra

Tokenization is an important first step in Natural Language Processing (NLP) pipelines because it decides how models learn and represent linguistic information. However, current subword tokenizers like SentencePiece or HuggingFace BPE are…

Computation and Language · Computer Science 2025-11-10 Firoj Ahmmed Patwary , Abdullah Al Noman

Probabilistic approaches to part-of-speech tagging rely primarily on whole-word statistics about word/tag combinations as well as contextual information. But experience shows about 4 per cent of tokens encountered in test sets are unknown…

Computation and Language · Computer Science 2013-02-28 Greg Adams , Beth Millar , Eric Neufeld , Tim Philip

In hope of expanding training data, researchers often want to merge two or more datasets that are created using different labeling schemes. This paper considers two datasets that label part-of-speech (POS) tags under different tagging…

Computation and Language · Computer Science 2022-09-27 Alex Li , Ilyas Bankole-Hameed , Ranadeep Singh , Gabriel Shen Han Ng , Akshat Gupta

Sentiment Analysis and other semantic tasks are commonly used for social media textual analysis to gauge public opinion and make sense from the noise on social media. The language used on social media not only commonly diverges from the…

Computation and Language · Computer Science 2019-06-19 Anirudh Dahiya , Neeraj Battan , Manish Shrivastava , Dipti Mishra Sharma

In this paper, we propose a new approach to construct a system of transformation rules for the Part-of-Speech (POS) tagging task. Our approach is based on an incremental knowledge acquisition method where rules are stored in an exception…

Computation and Language · Computer Science 2016-07-22 Dat Quoc Nguyen , Dai Quoc Nguyen , Dang Duc Pham , Son Bao Pham

With the intention of bringing uniformity to Bengali text entry research, here we present a new approach for calculating the most popular English text entry evaluation metrics for Bengali. To demonstrate our approach, we conducted a user…

Human-Computer Interaction · Computer Science 2017-06-27 Sayan Sarcar , Ahmed Sabbir Arif , Ali Mazalek

The use of multilingualism in the new generation is widespread in the form of code-mixed data on social media, and therefore a robust translation system is required for catering to the monolingual users, as well as for easier comprehension…

Computation and Language · Computer Science 2019-11-25 Sainik Kumar Mahata , Soumil Mandal , Dipankar Das , Sivaji Bandyopadhyay

Social media has become one of the main channels for peo- ple to communicate and share their views with the society. We can often detect from these views whether the person is in favor, against or neu- tral towards a given topic. These…

Computation and Language · Computer Science 2018-05-31 Sahil Swami , Ankush Khandelwal , Vinay Singh , Syed Sarfaraz Akhtar , Manish Shrivastava