English
Related papers

Related papers: Code-switching Language Modeling With Bilingual Wo…

200 papers

In this paper, we investigate the code-switching detection performance of a code-switching (CS) automatic speech recognition (ASR) system with data-augmented acoustic and language models. We focus on the recognition of Frisian-Dutch radio…

Computation and Language · Computer Science 2018-08-03 Emre Yılmaz , Henk van den Heuvel , David A. van Leeuwen

Speech recognition in mixed language has difficulties to adapt end-to-end framework due to the lack of data and overlapping phone sets, for example in words such as "one" in English and "w\`an" in Chinese. We propose a CTC-based end-to-end…

Computation and Language · Computer Science 2018-10-31 Genta Indra Winata , Andrea Madotto , Chien-Sheng Wu , Pascale Fung

In this thesis, we address the data scarcity and limitations of linguistic theory by proposing language-agnostic multi-task training methods. First, we introduce a meta-learning-based approach, meta-transfer learning, in which information…

Computation and Language · Computer Science 2021-04-14 Genta Indra Winata

Textual data is often represented as real-numbered embeddings in NLP, particularly with the popularity of large language models (LLMs) and Embeddings as a Service (EaaS). However, storing sensitive information as embeddings can be…

Computation and Language · Computer Science 2024-06-06 Yiyi Chen , Heather Lent , Johannes Bjerva

Arabic is a Semitic language which is widely spoken with many dialects. Given the success of pre-trained language models, many transformer models trained on Arabic and its dialects have surfaced. While these models have been compared with…

Computation and Language · Computer Science 2022-11-18 Ahmed Abdelali , Nadir Durrani , Fahim Dalvi , Hassan Sajjad

Building large-scale datasets for training code-switching language models is challenging and very expensive. To alleviate this problem using parallel corpus has been a major workaround. However, existing solutions use linguistic constraints…

Computation and Language · Computer Science 2018-10-31 Genta Indra Winata , Andrea Madotto , Chien-Sheng Wu , Pascale Fung

Multilingual machine translation systems aim to make knowledge accessible across languages, yet learning effective cross-lingual representations remains challenging. These challenges are especially pronounced for low-resource languages,…

Computation and Language · Computer Science 2026-01-08 David Stap

Great progress has been made in unsupervised bilingual lexicon induction (UBLI) by aligning the source and target word embeddings independently trained on monolingual corpora. The common assumption of most UBLI models is that the embedding…

Computation and Language · Computer Science 2021-05-27 Hailong Cao , Tiejun Zhao

External knowledge is often useful for natural language understanding tasks. We introduce a contextual text representation model called Conceptual-Contextual (CC) embeddings, which incorporates structured knowledge into text…

Computation and Language · Computer Science 2020-03-13 Xiao Zhang , Dejing Dou , Ji Wu

Natural language processing (NLP) techniques have become mainstream in the recent decade. Most of these advances are attributed to the processing of a single language. More recently, with the extensive growth of social media platforms focus…

Computation and Language · Computer Science 2022-01-12 Ramchandra Joshi , Raviraj Joshi

Code-Switching, a common phenomenon in written text and conversation, has been studied over decades by the natural language processing (NLP) research community. Initially, code-switching is intensively explored by leveraging linguistic…

Computation and Language · Computer Science 2023-05-26 Genta Indra Winata , Alham Fikri Aji , Zheng-Xin Yong , Thamar Solorio

Code-switching (CS) automatic speech recognition (ASR) faces challenges due to the language confusion resulting from accents, auditory similarity, and seamless language switches. Adaptation on the pre-trained multi-lingual model has shown…

Computation and Language · Computer Science 2025-01-07 Jiahui Zhao , Hao Shi , Chenrui Cui , Tianrui Wang , Hexin Liu , Zhaoheng Ni , Lingxuan Ye , Longbiao Wang

Pretrained language models are now of widespread use in Natural Language Processing. Despite their success, applying them to Low Resource languages is still a huge challenge. Although Multilingual models hold great promise, applying them to…

Computation and Language · Computer Science 2021-02-23 Usama Khalid , Mirza Omer Beg , Muhammad Umair Arshad

Code-switching deals with alternative languages in communication process. Training end-to-end (E2E) automatic speech recognition (ASR) systems for code-switching is especially challenging as code-switching training data are always…

Computation and Language · Computer Science 2022-06-30 Shuai Zhang , Jiangyan Yi , Zhengkun Tian , Jianhua Tao , Yu Ting Yeung , Liqun Deng

Code-switching (CS), the alternating use of two or more languages, challenges automatic speech recognition (ASR) due to scarce training data and linguistic similarities. The lack of dedicated CS datasets limits ASR performance, as most…

Computation and Language · Computer Science 2025-07-21 Carlos Mena , Pol Serra , Jacobo Romero , Abir Messaoudi , Jose Giraldo , Carme Armentano-Oller , Rodolfo Zevallos , Ivan Meza , Javier Hernando

Multilingual (or cross-lingual) embeddings represent several languages in a unique vector space. Using a common embedding space enables for a shared semantic between words from different languages. In this paper, we propose to embed images…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Maxime Portaz , Hicham Randrianarivo , Adrien Nivaggioli , Estelle Maudet , Christophe Servan , Sylvain Peyronnet

Code-switching (CS) speech refers to the phenomenon of mixing two or more languages within the same sentence. Despite the recent advances in automatic speech recognition (ASR), CS-ASR is still a challenging task ought to the grammatical…

Computation and Language · Computer Science 2023-10-23 Chen Chen , Yuchen Hu , Chao-Han Huck Yang , Hexin Liu , Sabato Marco Siniscalchi , Eng Siong Chng

Recent progress on unsupervised learning of cross-lingual embeddings in bilingual setting has given impetus to learning a shared embedding space for several languages without any supervision. A popular framework to solve the latter problem…

Computation and Language · Computer Science 2020-04-21 Pratik Jawanpuria , Mayank Meghwanshi , Bamdev Mishra

Data contamination undermines the validity of Large Language Model evaluation by enabling models to rely on memorized benchmark content rather than true generalization. While prior work has proposed contamination detection methods, these…

Computation and Language · Computer Science 2026-01-22 Chaymaa Abbas , Nour Shamaa , Mariette Awad

Code search is a widely used technique by developers during software development. It provides semantically similar implementations from a large code corpus to developers based on their queries. Existing techniques leverage deep learning…

Software Engineering · Computer Science 2022-02-17 Weisong Sun , Chunrong Fang , Yuchen Chen , Guanhong Tao , Tingxu Han , Quanjun Zhang