English
Related papers

Related papers: Synthetic Error Dataset Generation Mimicking Benga…

200 papers

Based on the sense definition of words available in the Bengali WordNet, an attempt is made to classify the Bengali sentences automatically into different groups in accordance with their underlying senses. The input sentences are collected…

Computation and Language · Computer Science 2015-08-07 Alok Ranjan Pal , Diganta Saha , Niladri Sekhar Dash

Modern large language models demonstrate impressive capabilities in text generation and generalization. However, they often struggle with solving text editing tasks, particularly when it comes to correcting spelling errors and mistypings.…

Computation and Language · Computer Science 2023-09-14 Nikita Martynov , Mark Baushenko , Anastasia Kozlova , Katerina Kolomeytseva , Aleksandr Abramov , Alena Fenogenova

In this paper we present an optimal Bangla Keyboard Layout, which distributes the load equally on both hands so that maximizing the ease and minimizing the effort. Bangla alphabet has a large number of letters, for this it is difficult to…

Artificial Intelligence · Computer Science 2010-09-27 Md. Hijbul Alam , Abdul Kadar Muhammad Masum , Mohammad Mahadi Hassan , S. M. Kamruzzaman

Code-mixed texts are widespread nowadays due to the advent of social media. Since these texts combine two languages to formulate a sentence, it gives rise to various research problems related to Natural Language Processing. In this paper,…

Computation and Language · Computer Science 2020-07-30 Tathagata Raha , Sainik Kumar Mahata , Dipankar Das , Sivaji Bandyopadhyay

Word error rate of an ocr is often higher than its character error rate. This is especially true when ocrs are designed by recognizing characters. High word accuracies are critical to tasks like the creation of content in digital libraries…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Deepayan Das , Jerin Philip , Minesh Mathew , C. V. Jawahar

Traditional Optical Character Recognition (OCR) systems that generate text of highly inflectional Indic languages like Hindi tend to suffer from poor accuracy due to a wide alphabet set, compound characters and difficulty in segmenting…

Computation and Language · Computer Science 2020-12-15 Aditya Pal , Abhijit Mustafi

Observing the damages that can be done by the rapid propagation of fake news in various sectors like politics and finance, automatic identification of fake news using linguistic analysis has drawn the attention of the research community.…

Computation and Language · Computer Science 2020-04-21 Md Zobaer Hossain , Md Ashraful Rahman , Md Saiful Islam , Sudipta Kar

In this paper, we explore the artificial generation of typographical errors based on real-world statistics. We first draw on a small set of annotated data to compute spelling error statistics. These are then invoked to introduce errors into…

Computation and Language · Computer Science 2020-05-05 Kshitij Shah , Gerard de Melo

There is very little notable research on generating descriptions of the Bengali language. About 243 million people speak in Bengali, and it is the 7th most spoken language on the planet. The purpose of this research is to propose a CNN and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Al Momin Faruk , Hasan Al Faraby , Md. Muzahidul Azad , Md. Riduyan Fedous , Md. Kishor Morol

In the context of pretraining of Large Language Models (LLMs), synthetic data has emerged as an alternative for generating high-quality pretraining data at scale. This is particularly beneficial in low-resource language settings where the…

The widespread online communication in a modern multilingual world has provided opportunities to blend more than one language (aka code-mixed language) in a single utterance. This has resulted a formidable challenge for the computational…

Computation and Language · Computer Science 2024-05-01 Kartik Kartik , Sanjana Soni , Anoop Kunchukuttan , Tanmoy Chakraborty , Md Shad Akhtar

Spelling errors are introduced in text either during typing, or when the user does not know the correct phoneme or grapheme. If a language contains complex words like sandhi where two or more morphemes join based on some rules, spell…

Computation and Language · Computer Science 2016-11-28 A N Akshatha , Chandana G Upadhyaya , Rajashekara S Murthy

Synthetic data is a standard component in training large language models, yet systematic comparisons across design dimensions, including rephrasing strategy, generator model, and source data, remain absent. We conduct extensive controlled…

Bangla Sign Language (BdSL) translation represents a low-resource NLP task due to the lack of large-scale datasets that address sentence-level translation. Correspondingly, existing research in this field has been limited to word and…

Computation and Language · Computer Science 2025-11-12 Neelavro Saha , Rafi Shahriyar , Nafis Ashraf Roudra , Saadman Sakib , Annajiat Alim Rasel

The rapid development of digital stages has greatly compounded the dispersal of untrue data, dissolving certainty and judgment in society, especially among the Bengali-speaking community. Our ponder addresses this critical issue by…

Computation and Language · Computer Science 2025-02-03 Pronoy Kumar Mondal , Sadman Sadik Khan , Md. Masud Rana , Shahriar Sultan Ramit , Abdus Sattar , Md. Sadekur Rahman

BNLP is an open source language processing toolkit for Bengali language consisting with tokenization, word embedding, POS tagging, NER tagging facilities. BNLP provides pre-trained model with high accuracy to do model based tokenization,…

Computation and Language · Computer Science 2021-12-02 Sagor Sarker

This research paper presents a unique Bengali OCR system with some capabilities. The system excels in reconstructing document layouts while preserving structure, alignment, and images. It incorporates advanced image and signature detection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 AKM Shahariar Azad Rabby , Hasmot Ali , Md. Majedul Islam , Sheikh Abujar , Fuad Rahman

Plagiarism means taking another person's work and not giving any credit to them for it. Plagiarism is one of the most serious problems in academia and among researchers. Even though there are multiple tools available to detect plagiarism in…

Computation and Language · Computer Science 2022-08-23 Satyajit Ghosh , Aniruddha Ghosh , Bittaswer Ghosh , Abhishek Roy

Grammar Error Correction(GEC) mainly relies on the availability of high quality of large amount of synthetic parallel data of grammatically correct and erroneous sentence pairs. The quality of the synthetic data is evaluated on how well the…

Computation and Language · Computer Science 2022-11-01 Vanya Bannihatti Kumar

Optical Character Recognition (OCR) for low-resource languages remains a significant challenge due to the scarcity of large-scale annotated training datasets. Languages such as Kashmiri, with approximately 7 million speakers and a complex…

Computation and Language · Computer Science 2026-01-23 Haq Nawaz Malik , Kh Mohmad Shafi , Tanveer Ahmad Reshi