中文
相关论文

相关论文: Unicode Normalization and Grapheme Parsing of Indi…

200 篇论文

Grapheme-to-phoneme conversion (g2p) is necessary for text-to-speech and automatic speech recognition systems. Most g2p systems are monolingual: they require language-specific data or handcrafting of rules. Such systems are difficult to…

计算与语言 · 计算机科学 2017-10-05 Ben Peters , Jon Dehdari , Josef van Genabith

The numeral systems of Indo-Aryan languages such as Hindi, Gujarati, and Bengali are highly unusual in that unlike most numeral systems (e.g., those of English, Chinese, etc.), forms referring to 1--99 are highly non-transparent and cannot…

物理与社会 · 物理学 2026-04-07 Chundra Cathcart

The Digital Corpus of Sanskrit records around 650,000 sentences along with their morphological and lexical tagging. But inconsistencies in morphological analysis, and in providing crucial information like the segmented word, urges the need…

计算与语言 · 计算机科学 2020-05-15 Sriram Krishnan , Amba Kulkarni , Gérard Huet

Large language models (LLMs) have achieved remarkable success across various natural language processing tasks. However, most LLM models use traditional tokenizers like BPE and SentencePiece, which fail to capture the finer nuances of a…

计算与语言 · 计算机科学 2025-05-26 Pramit Bhattacharyya , Arnab Bhattacharya

The work presented here involves the design of a Multi Layer Perceptron (MLP) based pattern classifier for recognition of handwritten Bangla digits using a 76 element feature vector. Bangla is the second most popular script and language in…

计算机视觉与模式识别 · 计算机科学 2012-03-06 Subhadip Basu , Nibaran Das , Ram Sarkar , Mahantapas Kundu , Mita Nasipuri , Dipak Kumar Basu

Text normalization (TN) and inverse text normalization (ITN) are essential preprocessing and postprocessing steps for text-to-speech synthesis and automatic speech recognition, respectively. Many methods have been proposed for either TN or…

计算与语言 · 计算机科学 2021-08-24 Tuan Manh Lai , Yang Zhang , Evelina Bakhturina , Boris Ginsburg , Heng Ji

Deaf individuals confront significant communication obstacles on a daily basis. Their inability to hear makes it difficult for them to communicate with those who do not understand sign language. Moreover, it presents difficulties in…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Velmathi G , Kaushal Goyal

Character segmentation has long been one of the most critical areas of optical character recognition process. Through this operation, an image of a sequence of characters, which may be connected in some cases, is decomposed into sub-images…

计算机视觉与模式识别 · 计算机科学 2012-02-15 Subhadip Basu , Chitrita Chaudhuri , Mahantapas Kundu , Mita Nasipuri , Dipak K. Basu

Transformers have recently become very popular for sequence-to-sequence applications such as machine translation and speech recognition. In this work, we propose a multi-task learning-based transformer model for low-resource multilingual…

计算与语言 · 计算机科学 2021-09-13 Krishna D N

Dialectal Arabic is the primary spoken language used by native Arabic speakers in daily communication. The rise of social media platforms has notably expanded its use as a written language. However, Arabic dialects do not have standard…

计算与语言 · 计算机科学 2025-06-02 Bashar Alhafni , Sarah Al-Towaity , Ziyad Fawzy , Fatema Nassar , Fadhl Eryani , Houda Bouamor , Nizar Habash

With the rapid growth of graph-structured data in critical domains, unsupervised graph-level anomaly detection (UGAD) has become a pivotal task. UGAD seeks to identify entire graphs that deviate from normal behavioral patterns. However,…

机器学习 · 计算机科学 2025-11-07 Qingfeng Chen , Haojin Zeng , Jingyi Jie , Shichao Zhang , Debo Cheng

People who are visually impaired face a lot of difficulties while studying. One of the major causes to this is lack of available text in Bharti Braille script. In this paper, we have suggested a scheme to convert text in major Indian…

计算与语言 · 计算机科学 2023-05-12 Nisheeth Joshi , Pragya Katyayan

Pre-trained Language Models (PLMs) have the potential to transform software development tasks. However, despite significant advances, current PLMs struggle to capture the structured and relational attributes of code, such as control flow…

软件工程 · 计算机科学 2026-05-06 Mert Tiftikci , Amir Molzam Sharifloo , Mira Mezini

Automatic Speech Recognition (ASR) generates text which is most of the times devoid of any punctuation. Absence of punctuation is text can affect readability. Also, down stream NLP tasks such as sentiment analysis, machine translation,…

The Tajik language, written in Cyrillic script, remains severely under-resourced in terms of publicly available natural language processing (NLP) toolkits, hindering both linguistic research and applied development. This paper introduces…

计算与语言 · 计算机科学 2026-05-29 Mullosharaf K. Arabov

Indonesia is rich in languages and scripts. However, most NLP progress has been made using romanized text. In this paper, we present NusaAksara, a novel public benchmark for Indonesian languages that includes their original scripts. Our…

Building Natural Language Understanding (NLU) capabilities for Indic languages, which have a collective speaker base of more than one billion speakers is absolutely crucial. In this work, we aim to improve the NLU capabilities of Indic…

Recent advancements in large language models (LLMs) have remarkably enhanced performances on a variety of tasks in multiple languages. However, tokenizers in LLMs trained primarily on English-centric corpora often overly fragment a text…

计算与语言 · 计算机科学 2024-08-07 Jimin Hong , Gibbeum Lee , Jaewoong Cho

Hindi grapheme-to-phoneme (G2P) conversion is mostly trivial, with one exception: whether a schwa represented in the orthography is pronounced or unpronounced (deleted). Previous work has attempted to predict schwa deletion in a rule-based…

计算与语言 · 计算机科学 2020-04-28 Aryaman Arora , Luke Gessler , Nathan Schneider

Code-switching is a phenomenon of mixing grammatical structures of two or more languages under varied social constraints. The code-switching data differ so radically from the benchmark corpora used in NLP community that the application of…

计算与语言 · 计算机科学 2018-04-25 Irshad Ahmad Bhat , Riyaz Ahmad Bhat , Manish Shrivastava , Dipti Misra Sharma