English
Related papers

Related papers: FST Based Morphological Analyzer for Hindi Languag…

200 papers

We analyze the performance of large language models (LLMs) on Text Style Transfer (TST), specifically focusing on sentiment transfer and text detoxification across three languages: English, Hindi, and Bengali. Text Style Transfer involves…

Computation and Language · Computer Science 2024-08-28 Sourabrata Mukherjee , Atul Kr. Ojha , Ondřej Dušek

Machine Translation is one of the major oldest and the most active research area in Natural Language Processing. Currently, Statistical Machine Translation (SMT) dominates the Machine Translation research. Statistical Machine Translation is…

Computation and Language · Computer Science 2014-10-01 M. Anand Kumar , V. Dhanalakshmi , K. P. Soman , V. Sharmiladevi

This paper presents a methodology for training a transformer-based model to classify lexical and morphosyntactic features of Skolt Sami, an endangered Uralic language characterized by complex morphology. The goal of our approach is to…

Computation and Language · Computer Science 2024-11-06 Khalid Alnajjar , Mika Hämäläinen , Jack Rueter

We present advances in the development of a FST-based morphological analyzer and generator for Skolt Sami. Like other minority Uralic languages, Skolt Sami exhibits a rich morphology, on the one hand, and there is little golden standard…

Computation and Language · Computer Science 2020-04-13 Jack Rueter , Mika Hämäläinen

We propose Neural-FST Class Language Model (NFCLM) for end-to-end speech recognition, a novel method that combines neural network language models (NNLMs) and finite state transducers (FSTs) in a mathematically consistent framework. Our…

Computation and Language · Computer Science 2022-02-01 Antoine Bruguier , Duc Le , Rohit Prabhavalkar , Dangna Li , Zhe Liu , Bo Wang , Eun Chang , Fuchun Peng , Ozlem Kalinli , Michael L. Seltzer

In this paper, I present our work on DeepRAG, a specialized embedding model we built specifically for Hindi language in RAG systems. While LLMs have gotten really good at generating text, their performance in retrieval tasks still depends…

Computation and Language · Computer Science 2025-03-12 Nandakishor M

Stemming is the process of extracting root word from the given inflection word and also plays significant role in numerous application of Natural Language Processing (NLP). Tamil Language raises several challenges to NLP, since it has rich…

Computation and Language · Computer Science 2013-10-03 M. Thangarasu , R. Manavalan

Neural language models (LMs) have shown to benefit significantly from enhancing word vectors with subword-level information, especially for morphologically rich languages. This has been mainly tackled by providing subword-level information…

Computation and Language · Computer Science 2019-10-28 Yash Shah , Ishan Tarunesh , Harsh Deshpande , Preethi Jyothi

There have been multiple attempts to resolve various inflection matching problems in information retrieval. Stemming is a common approach to this end. Among many techniques for stemming, statistical stemming has been shown to be effective…

Information Retrieval · Computer Science 2016-06-22 Javid Dadashkarimi , Hossein Nasr Esfahani , Heshaam Faili , Azadeh Shakery

In this paper I present a classifier for automatic identification of linguistic politeness in Hindi texts. I have used the manually annotated corpus of over 25,000 blog comments to train an SVM. Making use of the discursive and…

Computation and Language · Computer Science 2021-12-01 Ritesh Kumar

In this paper we present a fundamental lexical semantics of Sinhala language and a Hidden Markov Model (HMM) based Part of Speech (POS) Tagger for Sinhala language. In any Natural Language processing task, Part of Speech is a very vital…

Computation and Language · Computer Science 2014-07-14 A. J. P. M. P. Jayaweera , N. G. J. Dias

We describe our participation in the Word Segmentation and Morphological Parsing (WSMP) for Sanskrit hackathon. We approach the word segmentation task as a sequence labelling task by predicting edit operations from which segmentations are…

Computation and Language · Computer Science 2022-02-01 Jingwen Li , Leander Girrbach

End-to-end (E2E) systems synthesise high-quality speech, but this typically requires a large amount of data. As E2E synthesis progressed from Tacotron to FastSpeech2, it became evident that features representing prosody, particularly…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-19 Anusha Prakash , S Umesh , Hema A Murthy

Stemming is the process of extracting root word from the given inflection word. It also plays significant role in numerous application of Natural Language Processing (NLP). The stemming problem has addressed in many contexts and by…

Computation and Language · Computer Science 2013-08-27 M. Thangarasu , R. Manavalan

Edit-based approaches have recently shown promising results on multiple monolingual sequence transduction tasks. In contrast to conventional sequence-to-sequence (Seq2Seq) models, which learn to generate text from scratch as they are…

Computation and Language · Computer Science 2022-05-11 Kostiantyn Omelianchuk , Vipul Raheja , Oleksandr Skurzhanskyi

State-of-the-art text-to-speech (TTS) systems realize high naturalness in monolingual environments, synthesizing speech with correct multilingual accents (especially for Indic languages) and context-relevant emotions still poses difficulty…

Machine Learning · Computer Science 2025-06-23 Pranav Pawar , Akshansh Dwivedi , Jenish Boricha , Himanshu Gohil , Aditya Dubey

In this work, we describe a conditional random fields (CRF) based system for Part-Of- Speech (POS) tagging of code-mixed Indian social media text as part of our participation in the tool contest on POS tagging for codemixed Indian social…

Computation and Language · Computer Science 2016-12-26 Kamal Sarkar

Neural transducer is now the most popular end-to-end model for speech recognition, due to its naturally streaming ability. However, it is challenging to adapt it with text-only data. Factorized neural transducer (FNT) model was proposed to…

Computation and Language · Computer Science 2023-02-24 Rui Zhao , Jian Xue , Partha Parthasarathy , Veljko Miljanic , Jinyu Li

Sentiment analysis is the most basic NLP task to determine the polarity of text data. There has been a significant amount of work in the area of multilingual text as well. Still hate and offensive speech detection faces a challenge due to…

Computation and Language · Computer Science 2021-11-02 Abhishek Velankar , Hrushikesh Patil , Amol Gore , Shubham Salunke , Raviraj Joshi

Machine Translation (MT) is one of the most prominent tasks in Natural Language Processing (NLP) which involves the automatic conversion of texts from one natural language to another while preserving its meaning and fluency. Although the…

Computation and Language · Computer Science 2023-09-26 Kavit Gangar , Hardik Ruparel , Shreyas Lele