English
Related papers

Related papers: Towards Best Practices for Training Multilingual D…

200 papers

Recently multi-lingual pre-trained language models (PLM) such as mBERT and XLM-R have achieved impressive strides in cross-lingual dense retrieval. Despite its successes, they are general-purpose PLM while the multilingual PLM tailored for…

Computation and Language · Computer Science 2025-09-08 Shunyu Zhang , Yaobo Liang , Ming Gong , Daxin Jiang , Nan Duan

Ranker and retriever are two important components in dense passage retrieval. The retriever typically adopts a dual-encoder model, where queries and documents are separately input into two pre-trained models, and the vectors generated by…

Information Retrieval · Computer Science 2023-12-29 Haifeng Li , Mo Hai , Dong Tang

Pretrained multilingual contextual representations have shown great success, but due to the limits of their pretraining data, their benefits do not apply equally to all language varieties. This presents a challenge for language varieties…

Computation and Language · Computer Science 2022-06-22 Ethan C. Chau , Lucy H. Lin , Noah A. Smith

Translate-test is a popular technique to improve the performance of multilingual language models. This approach works by translating the input into English using an external machine translation system, and running inference over the…

Computation and Language · Computer Science 2023-08-03 Julen Etxaniz , Gorka Azkune , Aitor Soroa , Oier Lopez de Lacalle , Mikel Artetxe

Large language models (LLMs) offer promise in generating educational content, providing instructor feedback, and reducing teacher workload on assessments. While prior studies have focused on studying LLM-powered learning analytics, limited…

Computation and Language · Computer Science 2024-11-08 Anand Syamkumar , Nora Tseng , Kaycie Barron , Shanglin Yang , Shamya Karumbaiah , Rheeya Uppal , Junjie Hu

Achieving universal translation between all human language pairs is the holy-grail of machine translation (MT) research. While recent progress in massively multilingual MT is one step closer to reaching this goal, it is becoming evident…

Computation and Language · Computer Science 2022-01-14 Aditya Siddhant , Ankur Bapna , Orhan Firat , Yuan Cao , Mia Xu Chen , Isaac Caswell , Xavier Garcia

Dense retrievers have made significant strides in text retrieval and open-domain question answering. However, most of these achievements have relied heavily on extensive human-annotated supervision. In this study, we aim to develop…

Computation and Language · Computer Science 2024-10-31 Rui Meng , Ye Liu , Semih Yavuz , Divyansh Agarwal , Lifu Tu , Ning Yu , Jianguo Zhang , Meghana Bhat , Yingbo Zhou

Multilingual Language Models (\MLLMs) such as mBERT, XLM, XLM-R, \textit{etc.} have emerged as a viable option for bringing the power of pretraining to a large number of languages. Given their success in zero-shot transfer learning, there…

Computation and Language · Computer Science 2021-12-24 Sumanth Doddapaneni , Gowtham Ramesh , Mitesh M. Khapra , Anoop Kunchukuttan , Pratyush Kumar

Information retrieval involves selecting artifacts from a corpus that are most relevant to a given search query. The flavor of retrieval typically used in classical applications can be termed as homogeneous and relaxed, where queries and…

Information Retrieval · Computer Science 2023-10-10 Anirudh Khatry , Yasharth Bajpai , Priyanshu Gupta , Sumit Gulwani , Ashish Tiwari

Dense retrievers compress source documents into (possibly lossy) vector representations, yet there is little analysis of what information is lost versus preserved, and how it affects downstream tasks. We conduct the first analysis of the…

Computation and Language · Computer Science 2024-10-07 Seraphina Goldfarb-Tarrant , Pedro Rodriguez , Jane Dwivedi-Yu , Patrick Lewis

There has been a recent spike in interest in multi-modal Language and Vision problems. On the language side, most of these models primarily focus on English since most multi-modal datasets are monolingual. We try to bridge this gap with a…

Computation and Language · Computer Science 2020-12-10 Pranav Aggarwal , Ajinkya Kale

Multilingual language models have been a crucial breakthrough as they considerably reduce the need of data for under-resourced languages. Nevertheless, the superiority of language-specific models has already been proven for languages having…

In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach. We are then able to employ attention-based NMT for many-to-many multilingual translation tasks. Our…

Computation and Language · Computer Science 2016-11-16 Thanh-Le Ha , Jan Niehues , Alexander Waibel

Dense retrievers utilize pre-trained backbone language models (e.g., BERT, LLaMA) that are fine-tuned via contrastive learning to perform the task of encoding text into sense representations that can be then compared via a shallow…

Information Retrieval · Computer Science 2025-05-13 Zheng Yao , Shuai Wang , Guido Zuccon

Neural language modeling (LM) has led to significant improvements in several applications, including Automatic Speech Recognition. However, they typically require large amounts of training data, which is not available for many domains and…

Computation and Language · Computer Science 2019-06-05 Navid Rekabsaz , Nikolaos Pappas , James Henderson , Banriskhem K. Khonglah , Srikanth Madikeri

Passage retrieval and ranking is a key task in open-domain question answering and information retrieval. Current effective approaches mostly rely on pre-trained deep language model-based retrievers and rankers. These methods have been shown…

Information Retrieval · Computer Science 2021-09-14 Shengyao Zhuang , Guido Zuccon

While billions of non-English speaking users rely on search engines every day, the problem of ad-hoc information retrieval is rarely studied for non-English languages. This is primarily due to a lack of data set that are suitable to train…

Information Retrieval · Computer Science 2020-05-01 Sean MacAvaney , Luca Soldaini , Nazli Goharian

In-context learning (ICL), teaching a large language model (LLM) to perform a task with few-shot demonstrations rather than adjusting the model parameters, has emerged as a strong paradigm for using LLMs. While early studies primarily used…

Computation and Language · Computer Science 2023-05-24 Man Luo , Xin Xu , Zhuyun Dai , Panupong Pasupat , Mehran Kazemi , Chitta Baral , Vaiva Imbrasaite , Vincent Y Zhao

Multilingual models jointly pretrained on multiple languages have achieved remarkable performance on various multilingual downstream tasks. Moreover, models finetuned on a single monolingual downstream task have shown to generalize to…

Computation and Language · Computer Science 2022-03-01 Seanie Lee , Hae Beom Lee , Juho Lee , Sung Ju Hwang

Building speech recognizers in multiple languages typically involves replicating a monolingual training recipe for each language, or utilizing a multi-task learning approach where models for different languages have separate output labels…

Computation and Language · Computer Science 2017-11-08 Suyoun Kim , Michael L. Seltzer
‹ Prev 1 8 9 10 Next ›