中文
相关论文

相关论文: BanglaNirTox: A Large-scale Parallel Corpus for Ex…

200 篇论文

With the increasing need for text summarization techniques that are both efficient and accurate, it becomes crucial to explore avenues that enhance the quality and precision of pre-trained models specifically tailored for summarizing…

计算与语言 · 计算机科学 2023-07-17 G. M. Shahariar , Tonmoy Talukder , Rafin Alam Khan Sotez , Md. Tanvir Rouf Shawon

The linguistic diversity of India poses significant machine translation challenges, especially for underrepresented tribal languages like Bhili, which lack high-quality linguistic resources. This paper addresses the gap by introducing…

计算与语言 · 计算机科学 2025-11-04 Pooja Singh , Shashwat Bhardwaj , Vaibhav Sharma , Sandeep Kumar

In the context of pretraining of Large Language Models (LLMs), synthetic data has emerged as an alternative for generating high-quality pretraining data at scale. This is particularly beneficial in low-resource language settings where the…

Natural Language Inference (NLI) is a cornerstone of Natural Language Processing (NLP), providing insights into the entailment relationships between text pairings. It is a critical component of Natural Language Understanding (NLU),…

Identifying offensive content in social media is vital for creating safe online communities. Several recent studies have addressed this problem by creating datasets for various languages. In this paper, we explore offensive language…

Despite being the 5th most spoken language, Bangla remains underrepresented in Large Language Models (LLMs), particularly for code generation. This primarily stems from the scarcity of high-quality data to pre-train and/or finetune such…

计算与语言 · 计算机科学 2025-09-12 Nishat Raihan , Antonios Anastasopoulos , Marcos Zampieri

Although research on emotion classification has significantly progressed in high-resource languages, it is still infancy for resource-constrained languages like Bengali. However, unavailability of necessary language processing tools and…

计算与语言 · 计算机科学 2021-04-20 Avishek Das , Omar Sharif , Mohammed Moshiul Hoque , Iqbal H. Sarker

Large language models (LLMs) have achieved impressive results across a range of natural language processing tasks, but their potential to generate harmful content has raised serious safety concerns. Current toxicity detectors primarily rely…

Large Language Models (LLMs) are powerful text generators, yet they can produce toxic or harmful content even when given seemingly harmless prompts. This presents a serious safety challenge and can cause real-world harm. Toxicity is often…

计算与语言 · 计算机科学 2026-02-09 Himanshu Singh , Ziwei Xu , A. V. Subramanyam , Mohan Kankanhalli

Language models are at the core of natural language processing. The ability to represent natural language gives rise to its applications in numerous NLP tasks including text classification, summarization, and translation. Research in this…

计算与语言 · 计算机科学 2019-11-19 Aisha Khatun , Anisur Rahman , Hemayet Ahmed Chowdhury , Md. Saiful Islam , Ayesha Tasnim

The widespread availability of code-mixed data can provide valuable insights into low-resource languages like Bengali, which have limited datasets. Sentiment analysis has been a fundamental text classification task across several languages…

Text detoxification is the task of transferring the style of text from toxic to neutral. While here are approaches yielding promising results in monolingual setup, e.g., (Dale et al., 2021; Hallinan et al., 2022), cross-lingual transfer for…

计算与语言 · 计算机科学 2023-11-27 Daryna Dementieva , Daniil Moskovskiy , David Dale , Alexander Panchenko

Automatic Speech Recognition (ASR) transcripts often contain disfluencies, such as fillers, repetitions, and false starts, which reduce readability and hinder downstream applications like chatbots and voice assistants. If left unaddressed,…

计算与语言 · 计算机科学 2026-05-13 Deepak Kumar , Baban Gain , Asif Ekbal

Data curation is a critical yet under-researched step in the machine translation training paradigm. To train translation systems, data acquisition relies primarily on human translations and digital parallel sources or, to a limited degree,…

计算与语言 · 计算机科学 2026-03-12 Saumitra Yadav , Manish Shrivastava

Detoxification is a task of generating text in polite style while preserving meaning and fluency of the original toxic text. Existing detoxification methods are designed to work in one exact language. This work investigates multilingual and…

计算与语言 · 计算机科学 2022-06-07 Daniil Moskovskiy , Daryna Dementieva , Alexander Panchenko

Large language models can produce toxic or inappropriate text even for benign inputs, creating risks when deployed at scale. Detoxification is therefore important for safety and user trust, particularly when we want to reduce harmful…

计算与语言 · 计算机科学 2026-02-04 Baturay Saglam , Dionysis Kalogerias

Large Language Models (LLMs) demonstrate remarkable fluency across high-resource languages yet consistently fail to generate coherent text in Kashmiri, a language spoken by approximately seven million people. This performance disparity…

计算与语言 · 计算机科学 2026-01-06 Haq Nawaz Malik

Each new generation of English-oriented Large Language Models (LLMs) exhibits enhanced cross-lingual transfer capabilities and significantly outperforms older LLMs on low-resource languages. This prompts the question: Is there a need for…

计算与语言 · 计算机科学 2024-12-16 Tamzeed Mahfuz , Satak Kumar Dey , Ruwad Naswan , Hasnaen Adil , Khondker Salman Sayeed , Haz Sameen Shahgir

This paper focuses on text detoxification, i.e., automatically converting toxic text into non-toxic text. This task contributes to safer and more respectful online communication and can be considered a Text Style Transfer (TST) task, where…

计算与语言 · 计算机科学 2024-06-11 Sourabrata Mukherjee , Akanksha Bansal , Atul Kr. Ojha , John P. McCrae , Ondřej Dušek

The spectacular expansion of the Internet has led to the development of a new research problem in the field of natural language processing: automatic toxic comment detection, since many countries prohibit hate speech in public media. There…

机器学习 · 计算机科学 2020-09-18 Ashwin Geet D'Sa , Irina Illina , Dominique Fohr