中文
相关论文

相关论文: Transformer-based Model for Word Level Language Id…

200 篇论文

Sentiment analysis (SA) using code-mixed data from social media has several applications in opinion mining ranging from customer satisfaction to social campaign analysis in multilingual societies. Advances in this area are impeded by the…

计算与语言 · 计算机科学 2016-11-03 Ameya Prabhu , Aditya Joshi , Manish Shrivastava , Vasudeva Varma

Language Identification (LI) is crucial for various natural language processing tasks, serving as a foundational step in applications such as sentiment analysis, machine translation, and information retrieval. In multilingual societies like…

计算与语言 · 计算机科学 2025-03-13 Aniket Deroy , Subhankar Maity

The usage of more than one language in the same text is referred to as Code Mixed. It is evident that there is a growing degree of adaption of the use of code-mixed data, especially English with a regional language, on social media…

计算与语言 · 计算机科学 2023-06-09 Gauri Takawane , Abhishek Phaltankar , Varad Patwardhan , Aryan Patil , Raviraj Joshi , Mukta S. Takalikar

With the pandemic of COVID-19, relevant fake news is spreading all over the sky throughout the social media. Believing in them without discrimination can cause great trouble to people's life. However, universal language models may perform…

计算与语言 · 计算机科学 2023-02-13 Ben Chen , Bin Chen , Dehong Gao , Qijin Chen , Chengfu Huo , Xiaonan Meng , Weijun Ren , Yang Zhou

Sentiment analysis has been an active area of research in the past two decades and recently, with the advent of social media, there has been an increasing demand for sentiment analysis on social media texts. Since the social media texts are…

计算与语言 · 计算机科学 2020-10-21 Sainik Kumar Mahata , Dipankar Das , Sivaji Bandyopadhyay

The rapid expansion in the usage of social media networking sites leads to a huge amount of unprocessed user generated data which can be used for text mining. Author profiling is the problem of automatically determining profiling aspects…

计算与语言 · 计算机科学 2018-06-15 Ankush Khandelwal , Sahil Swami , Syed Sarfaraz Akhtar , Manish Shrivastava

The term "Code Mixed" refers to the use of more than one language in the same text. This phenomenon is predominantly observed on social media platforms, with an increasing amount of adaptation as time goes on. It is critical to detect…

计算与语言 · 计算机科学 2023-05-29 Aryan Patil , Varad Patwardhan , Abhishek Phaltankar , Gauri Takawane , Raviraj Joshi

In today's interconnected and multilingual world, code-mixing of languages on social media is a common occurrence. While many Natural Language Processing (NLP) tasks like sentiment analysis are mature and well designed for monolingual text,…

计算与语言 · 计算机科学 2020-09-01 Laksh Advani , Clement Lu , Suraj Maharjan

This paper describes the system submitted to Dravidian-Codemix-HASOC2021: Hate Speech and Offensive Language Identification in Dravidian Languages (Tamil-English and Malayalam-English). This task aims to identify offensive content in…

计算与语言 · 计算机科学 2021-12-08 Sean Benhur , Kanchana Sivanraju

Informal transliteration from other languages to English is prevalent in social media threads, instant messaging, and discussion forums. Without identifying the language of such transliterated text, users who do not speak that language…

音频与语音处理 · 电气工程与系统科学 2020-04-29 Sourav Sen

The paper presents the submission of the team indicnlp@kgp to the EACL 2021 shared task "Offensive Language Identification in Dravidian Languages." The task aimed to classify different offensive content types in 3 code-mixed Dravidian…

计算与语言 · 计算机科学 2021-02-16 Kushal Kedia , Abhilash Nandy

Large Language Models (LLMs) excel in English, but their performance degrades significantly on low-resource languages (LRLs) due to English-centric training. While methods like LangBridge align LLMs with multilingual encoders such as the…

Sentiment Analysis and other semantic tasks are commonly used for social media textual analysis to gauge public opinion and make sense from the noise on social media. The language used on social media not only commonly diverges from the…

计算与语言 · 计算机科学 2019-06-19 Anirudh Dahiya , Neeraj Battan , Manish Shrivastava , Dipti Mishra Sharma

Identifying offensive content in social media is vital for creating safe online communities. Several recent studies have addressed this problem by creating datasets for various languages. In this paper, we explore offensive language…

Language identification for code-switching (CS), the phenomenon of alternating between two or more languages in conversations, has traditionally been approached under the assumption of a single language per token. However, if at least one…

计算与语言 · 计算机科学 2019-04-04 Manuel Mager , Özlem Çetinoğlu , Katharina Kann

Code-mixing is the phenomenon of using multiple languages in the same utterance of a text or speech. It is a frequently used pattern of communication on various platforms such as social media sites, online gaming, product reviews, etc.…

计算与语言 · 计算机科学 2020-07-24 Vivek Srivastava , Mayank Singh

Linguistic Code-switching (CS) is still an understudied phenomenon in natural language processing. The NLP community has mostly focused on monolingual and multi-lingual scenarios, but little attention has been given to CS in particular.…

计算与语言 · 计算机科学 2020-05-05 Gustavo Aguilar , Thamar Solorio

Code-mixed languages, characterized by frequent within-sentence language transitions, present structural challenges that standard language models fail to address. In this work, we propose CMLFormer, an enhanced multi-layer dual-decoder…

计算与语言 · 计算机科学 2025-05-20 Aditeya Baral , Allen George Ajith , Roshan Nayak , Mrityunjay Abhijeet Bhanja

Large language models (LLMs) are increasingly applied in multilingual contexts, yet their capacity for consistent, logically grounded alignment across languages remains underexplored. We present a controlled evaluation framework for…

计算与语言 · 计算机科学 2025-08-21 Samir Abdaljalil , Erchin Serpedin , Khalid Qaraqe , Hasan Kurban

In multilingual societies like India, code-mixed social media texts comprise the majority of the Internet. Detecting the sentiment of the code-mixed user opinions plays a crucial role in understanding social, economic and political trends.…

计算与语言 · 计算机科学 2018-06-13 Madan Gopal Jhanwar , Arpita Das