English
Related papers

Related papers: Bangla Grammatical Error Detection Using T5 Transf…

200 papers

Despite being the seventh most widely spoken language in the world, Bengali has received much less attention in machine translation literature due to being low in resources. Most publicly available parallel corpora for Bengali are not large…

Computation and Language · Computer Science 2020-10-08 Tahmid Hasan , Abhik Bhattacharjee , Kazi Samin , Masum Hasan , Madhusudan Basak , M. Sohel Rahman , Rifat Shahriyar

In scene text detection, Transformer-based methods have addressed the global feature extraction limitations inherent in traditional convolution neural network-based methods. However, most directly rely on native Transformer attention layers…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Qiyan Zhao , Yue Yan , Da-Han Wang

In this paper, a tool for detecting LLM AI text generation is developed based on the Transformer model, aiming to improve the accuracy of AI text generation detection and provide reference for subsequent research. Firstly the text is…

Computation and Language · Computer Science 2024-05-14 Yuhong Mo , Hao Qin , Yushan Dong , Ziyi Zhu , Zhenglin Li

Bangla, the seventh most widely spoken language worldwide with 300 million native speakers, faces digital under-representation due to limited resources and lack of annotated datasets. Stemming, a critical preprocessing step in language…

Computation and Language · Computer Science 2025-08-22 Abhijit Paul , Mashiat Amin Farin , Sharif Md. Abdullah , Ahmedul Kabir , Zarif Masud , Shebuti Rayana

Bengali is an underrepresented language in NLP research. However, it remains a challenge due to its unique linguistic structure and computational constraints. In this work, we systematically investigate the challenges that hinder Bengali…

Computation and Language · Computer Science 2025-08-01 Shimanto Bhowmik , Tawsif Tashwar Dipto , Md Sazzad Islam , Sheryl Hsu , Tahsin Reasat

A latent-variable model is introduced for text matching, inferring sentence representations by jointly optimizing generative and discriminative objectives. To alleviate typical optimization challenges in latent-variable models for text, we…

Computation and Language · Computer Science 2017-11-23 Dinghan Shen , Yizhe Zhang , Ricardo Henao , Qinliang Su , Lawrence Carin

We introduce T5Gemma 2, the next generation of the T5Gemma family of lightweight open encoder-decoder models, featuring strong multilingual, multimodal and long-context capabilities. T5Gemma 2 follows the adaptation recipe (via UL2) in…

Large Language Models (LLMs) excel at evaluating machine translation (MT), but their scale and cost hinder deployment on edge devices and in privacy-sensitive workflows. We ask: how small can you get while still detecting meaning-altering…

Computation and Language · Computer Science 2025-11-14 Muskaan Chopra , Lorenz Sparrenberg , Sarthak Khanna , Rafet Sifa

Automatic Speech Recognition (ASR) and speaker diarization in Bangla remain challenging due to long form recordings, diverse acoustic conditions, and significant speaker variability. This work addresses these two core tasks in Bangla spoken…

Fine-grained information on translation errors is helpful for the translation evaluation community. Existing approaches can not synchronously consider error position and type, failing to integrate the error information of both. In this…

Computation and Language · Computer Science 2023-02-20 Keqin Bao , Yu Wan , Dayiheng Liu , Baosong Yang , Wenqiang Lei , Xiangnan He , Derek F. Wong , Jun Xie

In this study, we investigate extrinsic gender bias in Bangla pretrained language models, a largely underexplored area in low-resource languages. To assess this bias, we construct four manually annotated, task-specific benchmark datasets…

Computation and Language · Computer Science 2026-05-19 Sajib Kumar Saha Joy , Arman Hassan Mahy , Meherin Sultana , Azizah Mamun Abha , MD Piyal Ahmmed , Yue Dong , G M Shahariar

In this paper, we present a new approach dedicated to correcting the spelling errors of the Arabic language. This approach corrects typographical errors like inserting, deleting, and permutation. Our method is inspired from the Levenshtein…

Computation and Language · Computer Science 2012-08-23 Gueddah Hicham

Recent advances in Deep Learning and Computer Vision have been successfully leveraged to serve marginalized communities in various contexts. One such area is Sign Language - a primary means of communication for the deaf community. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Haz Sameen Shahgir , Khondker Salman Sayeed , Md Toki Tahmid , Tanjeem Azwad Zaman , Md. Zarif Ul Alam

This paper addresses the problem of Bangla hate speech identification, a socially impactful yet linguistically challenging task. As part of the "Bangla Multi-task Hate Speech Identification" shared task at the BLP Workshop, IJCNLP-AACL…

Computation and Language · Computer Science 2025-11-11 Sourav Saha , K M Nafi Asib , Mohammed Moshiul Hoque

Language modeling has witnessed remarkable advancements in recent years, with Large Language Models (LLMs) like ChatGPT setting unparalleled benchmarks in human-like text generation. However, a prevailing limitation is the…

Computation and Language · Computer Science 2023-11-13 Abhinand Balachandran

The objective of the paper is to recognize handwritten samples of basic Bangla characters using Tesseract open source Optical Character Recognition (OCR) engine under Apache License 2.0. Handwritten data samples containing isolated Bangla…

Computer Vision and Pattern Recognition · Computer Science 2010-03-31 Sandip Rakshit , Debkumar Ghosal , Tanmoy Das , Subhrajit Dutta , Subhadip Basu

Pretrained character-level and byte-level language models have been shown to be competitive with popular subword models across a range of Natural Language Processing (NLP) tasks. However, there has been little research on their…

Computation and Language · Computer Science 2024-05-24 Lukas Edman , Gabriele Sarti , Antonio Toral , Gertjan van Noord , Arianna Bisazza

We present our work on developing a multilingual, efficient text-to-text transformer that is suitable for handling long inputs. This model, called mLongT5, builds upon the architecture of LongT5, while leveraging the multilingual datasets…

Computation and Language · Computer Science 2023-10-30 David Uthus , Santiago Ontañón , Joshua Ainslie , Mandy Guo

This study focuses on recognizing Bangladeshi dialects and converting diverse Bengali accents into standardized formal Bengali speech. Dialects, often referred to as regional languages, are distinctive variations of a language spoken in a…

Computation and Language · Computer Science 2024-11-19 Md. Nazmus Sadat Samin , Jawad Ibn Ahad , Tanjila Ahmed Medha , Fuad Rahman , Mohammad Ruhul Amin , Nabeel Mohammed , Shafin Rahman

This paper introduces the approach of "Gradient Masters" for BLP-2025 Task 1: "Bangla Multitask Hate Speech Identification Shared Task". We present an ensemble-based fine-tuning strategy for addressing subtasks 1A (hate-type classification)…

Computation and Language · Computer Science 2025-11-25 Syed Mohaiminul Hoque , Naimur Rahman , Md Sakhawat Hossain