English
Related papers

Related papers: Transformer-based Model for Word Level Language Id…

200 papers

This paper describes our multiclass classification system developed as part of the LTEDI@RANLP-2023 shared task. We used a BERT-based language model to detect homophobic and transphobic content in social media comments across five language…

Computation and Language · Computer Science 2023-08-28 Sidney G. -J. Wong , Matthew Durward , Benjamin Adams , Jonathan Dunn

Cross-model retrieval has emerged as one of the most important upgrades for text-only search engines (SE). Recently, with powerful representation for pairwise text-image inputs via early interaction, the accuracy of vision-language (VL)…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Lisai Zhang , Hongfa Wu , Qingcai Chen , Yimeng Deng , Zhonghua Li , Dejiang Kong , Zhao Cao , Joanna Siebert , Yunpeng Han

Code-switching, also called code-mixing, is the linguistics phenomenon where in casual settings, multilingual speakers mix words from different languages in one utterance. Due to its spontaneous nature, code-switching is extremely…

Computation and Language · Computer Science 2023-06-01 Shuyue Stella Li , Cihan Xiao , Tianjian Li , Bismarck Odoom

Code switching (CS) is a very common phenomenon in written and spoken communication but one that is handled poorly by many natural language processing applications. Looking to the application of building CS corpora, we explore CS language…

Computation and Language · Computer Science 2024-02-05 Laurie Burchell , Alexandra Birch , Robert P. Thompson , Kenneth Heafield

Code-mixed discourse combines multiple languages in a single text. It is commonly used in informal discourse in countries with several official languages, but also in many other countries in combination with English or neighboring…

Computation and Language · Computer Science 2025-04-16 Anjali Yadav , Tanya Garg , Matej Klemen , Matej Ulcar , Basant Agarwal , Marko Robnik Sikonja

Some Transformer-based models can perform cross-lingual transfer learning: those models can be trained on a specific task in one language and give relatively good results on the same task in another language, despite having been pre-trained…

Computation and Language · Computer Science 2022-07-20 Félix Gaschi , François Plesse , Parisa Rastin , Yannick Toussaint

Being a popular mode of text-based communication in multilingual communities, code-mixing in online social media has became an important subject to study. Learning the semantics and morphology of code-mixed language remains a key challenge,…

Computation and Language · Computer Science 2022-04-28 Ayan Sengupta , Tharun Suresh , Md Shad Akhtar , Tanmoy Chakraborty

Code-mixing is a well-studied linguistic phenomenon when two or more languages are mixed in text or speech. Several works have been conducted on building datasets and performing downstream NLP tasks on code-mixed data. Although it is not…

Computation and Language · Computer Science 2023-11-28 Dhiman Goswami , Md Nishat Raihan , Antara Mahmud , Antonios Anastasopoulos , Marcos Zampieri

Sentiment analysis is essential in many real-world applications such as stance detection, review analysis, recommendation system, and so on. Sentiment analysis becomes more difficult when the data is noisy and collected from social media.…

Computation and Language · Computer Science 2018-03-20 Braja Gopal Patra , Dipankar Das , Amitava Das

We describe models focused at the understudied problem of translating between monolingual and code-mixed language pairs. More specifically, we offer a wide range of models that convert monolingual English text into Hinglish (code-mixed…

Computation and Language · Computer Science 2021-05-20 Ganesh Jawahar , El Moatez Billah Nagoudi , Muhammad Abdul-Mageed , Laks V. S. Lakshmanan

Social media platforms such as Twitter and Facebook are becoming popular in multilingual societies. This trend induces portmanteau of South Asian languages with English. The blend of multiple languages as code-mixed data has recently become…

Computation and Language · Computer Science 2024-03-08 Rajat Singh , Nurendra Choudhary , Manish Shrivastava

Code-Mixed text data consists of sentences having words or phrases from more than one language. Most multi-lingual communities worldwide communicate using multiple languages, with English usually one of them. Hinglish is a Code-Mixed text…

Computation and Language · Computer Science 2022-06-20 Shaz Furniturewala , Vijay Kumari , Amulya Ratna Dash , Hriday Kedia , Yashvardhan Sharma

State-of-the-art natural language processing systems rely on supervision in the form of annotated data to learn competent models. These models are generally trained on data in a single language (usually English), and cannot be directly used…

Computation and Language · Computer Science 2018-09-14 Alexis Conneau , Guillaume Lample , Ruty Rinott , Adina Williams , Samuel R. Bowman , Holger Schwenk , Veselin Stoyanov

The mixing of two or more languages is called Code-Mixing (CM). CM is a social norm in multilingual societies. Neural Language Models (NLMs) like transformers have been effective on many NLP tasks. However, NLM for CM is an under-explored…

Computation and Language · Computer Science 2023-10-20 Mohsin Ali , Kandukuri Sai Teja , Neeharika Gupta , Parth Patwa , Anubhab Chatterjee , Vinija Jain , Aman Chadha , Amitava Das

Building real-world complex Named Entity Recognition (NER) systems is a challenging task. This is due to the complexity and ambiguity of named entities that appear in various contexts such as short input sentences, emerging entities, and…

Computation and Language · Computer Science 2022-04-29 Abdellah El Mekki , Abdelkader El Mahdaouy , Mohammed Akallouch , Ismail Berrada , Ahmed Khoumsi

Over the past decade, we have seen exponential growth in online content fueled by social media platforms. Data generation of this scale comes with the caveat of insurmountable offensive content in it. The complexity of identifying offensive…

Computation and Language · Computer Science 2022-05-09 Debapriya Tula , Shreyas MS , Viswanatha Reddy , Pranjal Sahu , Sumanth Doddapaneni , Prathyush Potluri , Rohan Sukumaran , Parth Patwa

Offensive Language detection in social media platforms has been an active field of research over the past years. In non-native English spoken countries, social media users mostly use a code-mixed form of text in their posts/comments. This…

Computation and Language · Computer Science 2022-12-13 Charangan Vasantharajan , Uthayasanker Thayasivam

Nowadays, an abundance of short text is being generated that uses nonstandard writing styles influenced by regional languages. Such informal and code-switched content are under-resourced in terms of labeled datasets and language models even…

Computation and Language · Computer Science 2020-04-07 Muhammad Haroon Shakeel , Asim Karim

Lately, the problem of code-switching has gained a lot of attention and has emerged as an active area of research. In bilingual communities, the speakers commonly embed the words and phrases of a non-native language into the syntax of a…

Computation and Language · Computer Science 2017-11-13 Ganji Sreeram , Rohit Sinha

Computer vision has benefited from initializing multiple deep layers with weights pretrained on large supervised training sets like ImageNet. Natural language processing (NLP) typically sees initialization of only the lowest layer of deep…

Computation and Language · Computer Science 2018-06-21 Bryan McCann , James Bradbury , Caiming Xiong , Richard Socher