English
Related papers

Related papers: Cross-lingual Transfer for Speech Processing using…

200 papers

Cross-lingual transfer has become a crucial aspect of multilingual NLP, as it allows for models trained on resource-rich languages to be applied to low-resource languages more effectively. Recently massively multilingual pre-trained…

Computation and Language · Computer Science 2025-05-21 Ajitesh Bankula , Praney Bankula

Cross-lingual alignment in pretrained language models enables knowledge transfer across languages. Similar alignment has been reported in Whisper-style speech encoders, based on spoken translation retrieval using representational…

Computation and Language · Computer Science 2026-04-07 Ryan Soh-Eun Shim , Domenico De Cristofaro , Chengzhi Martin Hu , Alessandro Vietti , Barbara Plank

Large language models (LLMs) have achieved state-of-the-art performance in various software engineering tasks, including error detection, clone detection, and code translation, primarily leveraging high-resource programming languages like…

Computation and Language · Computer Science 2025-06-11 Razan Baltaji , Saurabh Pujar , Louis Mandel , Martin Hirzel , Luca Buratti , Lav Varshney

Cross-lingual vocabulary transfer plays a promising role in adapting pre-trained language models to new languages, including low-resource languages. Existing approaches that utilize monolingual or parallel corpora face challenges when…

Computation and Language · Computer Science 2025-06-03 Haruki Sakajo , Yusuke Ide , Justin Vasselli , Yusuke Sakai , Yingtao Tian , Hidetaka Kamigaito , Taro Watanabe

This study examines the cross-linguistic effectiveness of transfer learning for low-resource machine translation by fine-tuning models initially trained on typologically similar high-resource languages, using limited data from the target…

Computation and Language · Computer Science 2025-09-03 Saughmon Boujkian

Exploiting cross-lingual resources is an effective way to compensate for data scarcity of low resource languages. Recently, a novel multilingual model fusion technique has been proposed where a model is trained to learn cross-lingual…

Computation and Language · Computer Science 2023-06-16 Muhammad Umar Farooq , Thomas Hain

Phrase break prediction is a crucial task for improving the prosody naturalness of a text-to-speech (TTS) system. However, most proposed phrase break prediction models are monolingual, trained exclusively on a large amount of labeled data.…

Computation and Language · Computer Science 2023-06-06 Hoyeon Lee , Hyun-Wook Yoon , Jong-Hwan Kim , Jae-Min Kim

Multilingual machine translation has recently been in vogue given its potential for improving machine translation performance for low-resource languages via transfer learning. Empirical examinations demonstrating the success of existing…

Computation and Language · Computer Science 2020-05-13 Ion Madrazo Azpiazu , Maria Soledad Pera

Transfer learning is a vital technique that generalizes models trained for one setting or task to other settings or tasks. For example in speech recognition, an acoustic model trained for one language can be used to recognize speech in…

Computation and Language · Computer Science 2015-11-20 Dong Wang , Thomas Fang Zheng

Approaches to improving multilingual language understanding often struggle with significant performance gaps between high-resource and low-resource languages. While there are efforts to align the languages in a single latent space to…

Computation and Language · Computer Science 2024-11-18 Haeji Jung , Changdae Oh , Jooeon Kang , Jimin Sohn , Kyungwoo Song , Jinkyu Kim , David R. Mortensen

Cross-lingual transfer between a high-resource language and its dialects or closely related language varieties should be facilitated by their similarity. However, current approaches that operate in the embedding space do not take surface…

Computation and Language · Computer Science 2022-03-14 Noëmi Aepli , Rico Sennrich

Cross-lingual semantic textual similarity systems estimate the degree of the meaning similarity between two sentences, each in a different language. State-of-the-art algorithms usually employ machine translation and combine vast amount of…

Computation and Language · Computer Science 2018-07-12 Tomáš Brychcín

There has been increasing interest in building multilingual foundation models for NLP and speech research. This paper examines how to expand the speech translation capability of these models with restricted data. Whisper, a speech…

Computation and Language · Computer Science 2025-02-12 Rao Ma , Mengjie Qian , Yassir Fathullah , Siyuan Tang , Mark Gales , Kate Knill

As an effective alternative to the direct fine-tuning on target tasks in specific languages, cross-lingual transfer addresses the challenges of limited training data by decoupling ''task ability'' and ''language ability'' by fine-tuning on…

Computation and Language · Computer Science 2024-03-01 Yiran Zhao , Wenxuan Zhang , Huiming Wang , Kenji Kawaguchi , Lidong Bing

We study the selection of transfer languages for automatic abusive language detection. Instead of preparing a dataset for every language, we demonstrate the effectiveness of cross-lingual transfer learning for zero-shot abusive language…

Computation and Language · Computer Science 2022-06-07 Juuso Eronen , Michal Ptaszynski , Fumito Masui , Masaki Arata , Gniewosz Leliwa , Michal Wroczynski

Code-switching is a data augmentation scheme mixing words from multiple languages into source lingual text. It has achieved considerable generalization performance of cross-lingual transfer tasks by aligning cross-lingual contextual word…

Computation and Language · Computer Science 2024-06-21 Zhuoran Li , Chunming Hu , Junfan Chen , Zhijun Chen , Xiaohui Guo , Richong Zhang

Code-switching, the alternation of languages within a conversation or utterance, is a common communicative phenomenon that occurs in multilingual communities across the world. This survey reviews computational approaches for code-switched…

Computation and Language · Computer Science 2020-07-24 Sunayana Sitaram , Khyathi Raghavi Chandu , Sai Krishna Rallabandi , Alan W Black

Modern machine learning models for audio tasks often exhibit superior performance on English and other well-resourced languages, primarily due to the abundance of available training data. This disparity leads to an unfair performance gap…

Computation and Language · Computer Science 2025-11-26 Wesley Bian , Xiaofeng Lin , Guang Cheng

We address the problem of cross-speaker style transfer for text-to-speech (TTS) using data augmentation via voice conversion. We assume to have a corpus of neutral non-expressive data from a target speaker and supporting conversational…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-11 Manuel Sam Ribeiro , Julian Roth , Giulia Comini , Goeric Huybrechts , Adam Gabrys , Jaime Lorenzo-Trueba

Most Transformer language models are primarily pretrained on English text, limiting their use for other languages. As the model sizes grow, the performance gap between English and other languages with fewer compute and data resources…

Computation and Language · Computer Science 2023-01-24 Malte Ostendorff , Georg Rehm