English
Related papers

Related papers: Indonesian-English Code-Switching Speech Synthesiz…

200 papers

Code-switching, or switching between languages, occurs for many reasons and has important linguistic, sociological, and cultural implications. Multilingual speakers code-switch for a variety of purposes, such as expressing emotions,…

Computation and Language · Computer Science 2022-12-19 Ritu Belani , Jeffrey Flanigan

Text-to-Speech (TTS) models have advanced significantly, aiming to accurately replicate human speech's diversity, including unique speaker identities and linguistic nuances. Despite these advancements, achieving an optimal balance between…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-28 Jinhyeok Yang , Junhyeok Lee , Hyeong-Seok Choi , Seunghun Ji , Hyeongju Kim , Juheon Lee

Code-switching (CS) is common in daily conversations where more than one language is used within a sentence. The difficulties of CS speech recognition lie in alternating languages and the lack of transcribed data. Therefore, this paper uses…

Computation and Language · Computer Science 2021-10-08 Liang-Hsuan Tseng , Yu-Kuan Fu , Heng-Jui Chang , Hung-yi Lee

Compared to English, the amount of labeled data for Indonesian text classification tasks is very small. Recently developed multilingual language models have shown its ability to create multilingual representations effectively. This paper…

Computation and Language · Computer Science 2020-09-15 Ilham Firdausi Putra , Ayu Purwarianti

The paper aims to show how an application can be developed that converts the English language into the Punjabi Language, and the same application can convert the Text to Speech(TTS) i.e. pronounce the text. This application can be really…

Computation and Language · Computer Science 2015-03-09 Prabhsimran Singh , Amritpal Singh

Code switching (CS) refers to the phenomenon of interchangeably using words and phrases from different languages. CS can pose significant accuracy challenges to NLP, due to the often monolingual nature of the underlying systems. In this…

Computation and Language · Computer Science 2022-04-12 Orion Weller , Matthias Sperber , Telmo Pires , Hendra Setiawan , Christian Gollan , Dominic Telaar , Matthias Paulik

Code-switching, also called code-mixing, is the linguistics phenomenon where in casual settings, multilingual speakers mix words from different languages in one utterance. Due to its spontaneous nature, code-switching is extremely…

Computation and Language · Computer Science 2023-06-01 Shuyue Stella Li , Cihan Xiao , Tianjian Li , Bismarck Odoom

Transformer-based text to speech (TTS) model (e.g., Transformer TTS~\cite{li2019neural}, FastSpeech~\cite{ren2019fastspeech}) has shown the advantages of training and inference efficiency over RNN-based model (e.g.,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Mingjian Chen , Xu Tan , Yi Ren , Jin Xu , Hao Sun , Sheng Zhao , Tao Qin , Tie-Yan Liu

Recent studies on end-to-end speech translation(ST) have facilitated the exploration of multilingual end-to-end ST and end-to-end simultaneous ST. In this paper, we investigate end-to-end simultaneous speech translation in a one-to-many…

Computation and Language · Computer Science 2025-03-17 Wuwei Huang , Renren Jin , Wen Zhang , Jian Luan , Bin Wang , Deyi Xiong

Transfer tasks in text-to-speech (TTS) synthesis - where one or more aspects of the speech of one set of speakers is transferred to another set of speakers that do not feature these aspects originally - remains a challenging task. One of…

Code-switching (CS) speech translation (ST) aims to translate speech that alternates between multiple languages into a target language text, posing significant challenges due to the complexity of semantic modeling and the scarcity of CS…

Computation and Language · Computer Science 2026-05-13 Yan Gao , Yazheng Yang , Zhibin Lan , Yidong Chen , Min Zhang , Daimeng Wei , Derek F. Wong , Jinsong Su

Code-switching is a commonly observed communicative phenomenon denoting a shift from one language to another within the same speech exchange. The analysis of code-switched data often becomes an assiduous task, owing to the limited…

Computation and Language · Computer Science 2020-11-04 Tanvi Dadu , Kartikey Pant

We present a model of text analysis for text-to-speech (TTS) synthesis based on (weighted) finite-state transducers, which serves as the text-analysis module of the multilingual Bell Labs TTS system. The transducers are constructed using a…

cmp-lg · Computer Science 2008-02-03 Richard Sproat

Linguistic Code-switching (CS) is still an understudied phenomenon in natural language processing. The NLP community has mostly focused on monolingual and multi-lingual scenarios, but little attention has been given to CS in particular.…

Computation and Language · Computer Science 2020-05-05 Gustavo Aguilar , Thamar Solorio

State-of-the-art text-to-speech (TTS) systems realize high naturalness in monolingual environments, synthesizing speech with correct multilingual accents (especially for Indic languages) and context-relevant emotions still poses difficulty…

Machine Learning · Computer Science 2025-06-23 Pranav Pawar , Akshansh Dwivedi , Jenish Boricha , Himanshu Gohil , Aditya Dubey

We explore cross-dialect text-to-speech (CD-TTS), a task to synthesize learned speakers' voices in non-native dialects, especially in pitch-accent languages. CD-TTS is important for developing voice agents that naturally communicate with…

Sound · Computer Science 2024-09-12 Kazuki Yamauchi , Yuki Saito , Hiroshi Saruwatari

Speech representation learning has improved both speech understanding and speech synthesis tasks for single language. However, its ability in cross-lingual scenarios has not been explored. In this paper, we extend the pretraining method for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-06 Xiaoran Fan , Chao Pang , Tian Yuan , He Bai , Renjie Zheng , Pengfei Zhu , Shuohuan Wang , Junkun Chen , Zeyu Chen , Liang Huang , Yu Sun , Hua Wu

Code-switching entails mixing multiple languages. It is an increasingly occurring phenomenon in social media texts. Usually, code-mixed texts are written in a single script, even though the languages involved have different scripts.…

Computation and Language · Computer Science 2025-11-24 Niraj Pahari , Kazutaka Shimada

This paper presents a method for end-to-end cross-lingual text-to-speech (TTS) which aims to preserve the target language's pronunciation regardless of the original speaker's language. The model used is based on a non-attentive Tacotron…

We present a multispeaker, multilingual text-to-speech (TTS) synthesis model based on Tacotron that is able to produce high quality speech in multiple languages. Moreover, the model is able to transfer voices across languages, e.g.…

Computation and Language · Computer Science 2019-07-25 Yu Zhang , Ron J. Weiss , Heiga Zen , Yonghui Wu , Zhifeng Chen , RJ Skerry-Ryan , Ye Jia , Andrew Rosenberg , Bhuvana Ramabhadran