English
Related papers

Related papers: Boosting Zero-shot Cross-lingual Retrieval by Trai…

200 papers

There has been a recent spike in interest in multi-modal Language and Vision problems. On the language side, most of these models primarily focus on English since most multi-modal datasets are monolingual. We try to bridge this gap with a…

Machine Learning · Computer Science 2021-09-17 Pranav Aggarwal , Ritiz Tambi , Ajinkya Kale

Zero-shot cross-lingual transfer is a central task in multilingual NLP, allowing models trained in languages with more sufficient training resources to generalize to other low-resource languages. Earlier efforts on this task use parallel…

Computation and Language · Computer Science 2023-09-21 Fei Wang , Kuan-Hao Huang , Kai-Wei Chang , Muhao Chen

Multilingual information retrieval (IR) is challenging since annotated training data is costly to obtain in many languages. We present an effective method to train multilingual IR systems when only English IR training data and some parallel…

Information Retrieval · Computer Science 2023-05-29 Xiyang Hu , Xinchi Chen , Peng Qi , Deguang Kong , Kunlun Liu , William Yang Wang , Zhiheng Huang

Recent advances in training multilingual language models on large datasets seem to have shown promising results in knowledge transfer across languages and achieve high performance on downstream tasks. However, we question to what extent the…

Computation and Language · Computer Science 2024-02-06 Sara Rajaee , Christof Monz

Code-switching, also called code-mixing, is the linguistics phenomenon where in casual settings, multilingual speakers mix words from different languages in one utterance. Due to its spontaneous nature, code-switching is extremely…

Computation and Language · Computer Science 2023-06-01 Shuyue Stella Li , Cihan Xiao , Tianjian Li , Bismarck Odoom

Recently, large pre-trained multilingual speech models have shown potential in scaling Automatic Speech Recognition (ASR) to many low-resource languages. Some of these models employ language adapters in their formulation, which helps to…

Computation and Language · Computer Science 2023-10-12 Atharva Kulkarni , Ajinkya Kulkarni , Miguel Couceiro , Hanan Aldarmaki

Pre-trained Language Models have recently emerged in Information Retrieval as providing the backbone of a new generation of neural systems that outperform traditional methods on a variety of tasks. However, it is still unclear to what…

Information Retrieval · Computer Science 2023-01-26 Simon Lupart , Thibault Formal , Stéphane Clinchant

A lack of code-switching data complicates the training of code-switching (CS) language models. We propose an approach to train such CS language models on monolingual data only. By constraining and normalizing the output projection matrix in…

Computation and Language · Computer Science 2020-05-22 Shun-Po Chuang , Tzu-Wei Sung , Hung-Yi Lee

Multimodal Video Search by Examples (MVSE) investigates using video clips as the query term for information retrieval, rather than the more traditional text query. This enables far richer search modalities such as images, speaker, content,…

Computation and Language · Computer Science 2024-09-11 Mengjie Qian , Rao Ma , Adian Liusie , Erfan Loweimi , Kate M. Knill , Mark J. F. Gales

Recently, data-driven task-oriented dialogue systems have achieved promising performance in English. However, developing dialogue systems that support low-resource languages remains a long-standing challenge due to the absence of…

Computation and Language · Computer Science 2019-11-22 Zihan Liu , Genta Indra Winata , Zhaojiang Lin , Peng Xu , Pascale Fung

Recently, there has been significant progress made in Automatic Speech Recognition (ASR) of code-switched speech, leading to gains in accuracy on code-switched datasets in many language pairs. Code-switched speech co-occurs with monolingual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Sanket Shah , Basil Abraham , Gurunath Reddy M , Sunayana Sitaram , Vikas Joshi

Modeling code-switched speech is an important problem in automatic speech recognition (ASR). Labeled code-switched data are rare, so monolingual data are often used to model code-switched speech. These monolingual data may be more closely…

Computation and Language · Computer Science 2021-06-16 Andrew Slottje , Shannon Wotherspoon , William Hartmann , Matthew Snover , Owen Kimball

The advent of large language models (LLMs) has significantly advanced the field of code translation, enabling automated translation between programming languages. However, these models often struggle with complex translation tasks due to…

Artificial Intelligence · Computer Science 2024-07-30 Manish Bhattarai , Javier E. Santos , Shawn Jones , Ayan Biswas , Boian Alexandrov , Daniel O'Malley

Multilingual information retrieval has emerged as powerful tools for expanding knowledge sharing across languages. On the other hand, resources on high quality knowledge base are often scarce and in limited languages, therefore an effective…

Computation and Language · Computer Science 2025-06-04 Yingying Zhuang , Aman Gupta , Anurag Beniwal

Multilingual pre-trained language models (MPLMs) not only can handle tasks in different languages but also exhibit surprising zero-shot cross-lingual transferability. However, MPLMs usually are not able to achieve comparable supervised…

Computation and Language · Computer Science 2022-03-01 Ziqing Yang , Yiming Cui , Zhigang Chen , Shijin Wang

With the increasing utilization of multilingual text information, Cross-Lingual Information Retrieval (CLIR) has become a crucial research area. However, the impact of training data composition on both CLIR and Mono-Lingual Information…

Information Retrieval · Computer Science 2026-05-20 Youngjoon Jang , Junyoung Son , Taemin Lee , Seongtae Hong , Hyeonseok Moon , Seungyoon Lee , Andrew Matteson , Heuiseok Lim

State-of-the-art neural (re)rankers are notoriously data-hungry which -- given the lack of large-scale training data in languages other than English -- makes them rarely used in multilingual and cross-lingual retrieval settings. Current…

Computation and Language · Computer Science 2022-09-20 Robert Litschko , Ivan Vulić , Goran Glavaš

Zero-shot evaluation of information retrieval (IR) models is often performed using BEIR; a large and heterogeneous benchmark composed of multiple datasets, covering different retrieval tasks across various domains. Although BEIR has become…

Computation and Language · Computer Science 2024-12-12 Nikolay Banar , Ehsan Lotfi , Walter Daelemans

Multilingual neural machine translation has shown the capability of directly translating between language pairs unseen in training, i.e. zero-shot translation. Despite being conceptually attractive, it often suffers from low output quality.…

Computation and Language · Computer Science 2021-07-02 Danni Liu , Jan Niehues , James Cross , Francisco Guzmán , Xian Li

As the Information Retrieval (IR) field increasingly recognizes the importance of inclusivity, addressing the needs of low-resource languages remains a significant challenge. This paper introduces the first large-scale Urdu IR dataset,…

Computation and Language · Computer Science 2025-04-07 Umer Butt , Stalin Varanasi , Günter Neumann