English
Related papers

Related papers: Evaluating Input Representation for Language Ident…

200 papers

The conventional natural language processing approaches are not accustomed to the social media text due to colloquial discourse and non-homogeneous characteristics. Significantly, the language identification in a multilingual document is…

Computation and Language · Computer Science 2021-06-30 M Zeeshan Ansari , Tanvir Ahmad , M M Sufyan Beg , Asma Ikram

An accurate language identification tool is an absolute necessity for building complex NLP systems to be used on code-mixed data. Lot of work has been recently done on the same, but there's still room for improvement. Inspired from the…

Computation and Language · Computer Science 2018-08-23 Soumil Mandal , Anil Kumar Singh

Natural Language Processing (NLP) and especially natural language text analysis have seen great advances in recent times. Usage of deep learning in text processing has revolutionized the techniques for text processing and achieved…

Information Retrieval · Computer Science 2020-07-07 Ramchandra Joshi , Purvi Goel , Raviraj Joshi

The task of automatically identifying a language used in a given text is called Language Identification (LI). India is a multilingual country and many Indians especially youths are comfortable with Hindi and English, in addition to their…

Computation and Language · Computer Science 2022-11-21 H. L. Shashirekha , F. Balouchzahi , M. D. Anusha , G. Sidorov

Using code-mixed data in natural language processing (NLP) research currently gets a lot of attention. Language identification of social media code-mixed text has been an interesting problem of study in recent years due to the advancement…

Computation and Language · Computer Science 2022-11-29 Atnafu Lambebo Tonja , Mesay Gemeda Yigezu , Olga Kolesnikova , Moein Shahiki Tash , Grigori Sidorov , Alexander Gelbuk

With the growing presence of multilingual users on social media, detecting abusive language in code-mixed text has become increasingly challenging. Code-mixed communication, where users seamlessly switch between English and their native…

Computation and Language · Computer Science 2025-05-01 Manish Pandey , Nageshwar Prasad Yadav , Mokshada Adduru , Sawan Rai

Language identification of social media text still remains a challenging task due to properties like code-mixing and inconsistent phonetic transliterations. In this paper, we present a supervised learning approach for language…

Computation and Language · Computer Science 2018-06-28 Soumil Mandal , Sourya Dipta Das , Dipankar Das

Language Identification in textual documents is the process of automatically detecting the language contained in a document based on its content. The present Language Identification techniques presume that a document contains text in one of…

Computation and Language · Computer Science 2021-06-30 Mohd Zeeshan Ansari , Tanvir Ahmad , Noaima Bari

Language identification of social media text has been an interesting problem of study in recent years. Social media messages are predominantly in code mixed in non-English speaking states. Prior knowledge by pre-training contextual…

Computation and Language · Computer Science 2021-07-05 Mohd Zeeshan Ansari , M M Sufyan Beg , Tanvir Ahmad , Mohd Jazib Khan , Ghazali Wasim

Code-mixing is the phenomenon of using multiple languages in the same utterance of a text or speech. It is a frequently used pattern of communication on various platforms such as social media sites, online gaming, product reviews, etc.…

Computation and Language · Computer Science 2020-07-24 Vivek Srivastava , Mayank Singh

With the increased use of social media platforms by people across the world, many new interesting NLP problems have come into existence. One such being the detection of sarcasm in the social media texts. We present a corpus of tweets for…

Computation and Language · Computer Science 2020-12-17 Akshita Aggarwal , Anshul Wadhawan , Anshima Chaudhary , Kavita Maurya

Sentiment analysis (SA) using code-mixed data from social media has several applications in opinion mining ranging from customer satisfaction to social campaign analysis in multilingual societies. Advances in this area are impeded by the…

Computation and Language · Computer Science 2016-11-03 Ameya Prabhu , Aditya Joshi , Manish Shrivastava , Vasudeva Varma

Text embedding has become a foundational technology in natural language processing (NLP) during the deep learning era, driving advancements across a wide array of downstream tasks. While many natural language understanding challenges can…

Computation and Language · Computer Science 2025-10-22 Zhijie Nie , Zhangchi Feng , Mingxin Li , Cunwang Zhang , Yanzhao Zhang , Dingkun Long , Richong Zhang

Natural Language Processing (NLP) is an important branch of artificial intelligence that studies how to enable computers to understand, process, and generate human language. Text classification is a fundamental task in NLP, which aims to…

Computation and Language · Computer Science 2024-03-18 Xiaonan Xu , Zheng Xu , Zhipeng Ling , Zhengyu Jin , ShuQian Du

Transformer has demonstrated its great power to learn contextual word representations for multiple languages in a single model. To process multilingual sentences in the model, a learnable vector is usually assigned to each language, which…

Computation and Language · Computer Science 2021-02-17 Shengjie Luo , Kaiyuan Gao , Shuxin Zheng , Guolin Ke , Di He , Liwei Wang , Tie-Yan Liu

The usage of more than one language in the same text is referred to as Code Mixed. It is evident that there is a growing degree of adaption of the use of code-mixed data, especially English with a regional language, on social media…

Computation and Language · Computer Science 2023-06-09 Gauri Takawane , Abhishek Phaltankar , Varad Patwardhan , Aryan Patil , Raviraj Joshi , Mukta S. Takalikar

While supervised learning models have shown remarkable performance in various natural language processing (NLP) tasks, their success heavily relies on the availability of large-scale labeled datasets, which can be costly and time-consuming…

Computation and Language · Computer Science 2024-06-04 Wrick Talukdar , Anjanava Biswas

Sentiment Analysis and other semantic tasks are commonly used for social media textual analysis to gauge public opinion and make sense from the noise on social media. The language used on social media not only commonly diverges from the…

Computation and Language · Computer Science 2019-06-19 Anirudh Dahiya , Neeraj Battan , Manish Shrivastava , Dipti Mishra Sharma

In a multilingual or sociolingual configuration Intra-sentential Code Switching (ICS) or Code Mixing (CM) is frequently observed nowadays. In the world, most of the people know more than one language. CM usage is especially apparent in…

Computation and Language · Computer Science 2020-10-12 Sunil Gundapu , Radhika Mamidi

Text classification stands as a cornerstone within the realm of Natural Language Processing (NLP), particularly when viewed through computer science and engineering. The past decade has seen deep learning revolutionize text classification,…

Computation and Language · Computer Science 2025-04-23 Marco Siino , Ilenia Tinnirello , Marco La Cascia
‹ Prev 1 2 3 10 Next ›