English
Related papers

Related papers: Mr. TyDi: A Multi-lingual Benchmark for Dense Retr…

200 papers

Retrieval-Augmented Generation (RAG) systems enable language models to access relevant information and generate accurate, well-grounded, and contextually informed responses. However, for Indian languages, the development of high-quality RAG…

Computation and Language · Computer Science 2025-06-04 Pasunuti Prasanjith , Prathmesh B More , Anoop Kunchukuttan , Raj Dabre

Typologically diverse benchmarks are increasingly created to track the progress achieved in multilingual NLP. Linguistic diversity of these data sets is typically measured as the number of languages or language families included in the…

Computation and Language · Computer Science 2024-04-17 Tanja Samardzic , Ximena Gutierrez , Christian Bentz , Steven Moran , Olga Pelloni

Current pre-trained language model approaches to information retrieval can be broadly divided into two categories: sparse retrievers (to which belong also non-neural approaches such as bag-of-words methods, e.g., BM25) and dense retrievers.…

Information Retrieval · Computer Science 2022-05-03 Hang Li , Shuai Wang , Shengyao Zhuang , Ahmed Mourad , Xueguang Ma , Jimmy Lin , Guido Zuccon

While pretrained language models (PLMs) primarily serve as general-purpose text encoders that can be fine-tuned for a wide variety of downstream tasks, recent work has shown that they can also be rewired to produce high-quality word…

Computation and Language · Computer Science 2023-05-30 Tommaso Green , Simone Paolo Ponzetto , Goran Glavaš

Recent years have witnessed the significant advance in dense retrieval (DR) based on powerful pre-trained language models (PLM). DR models have achieved excellent performance in several benchmark datasets, while they are shown to be not as…

Computation and Language · Computer Science 2023-04-25 Ruiyang Ren , Yingqi Qu , Jing Liu , Wayne Xin Zhao , Qifei Wu , Yuchen Ding , Hua Wu , Haifeng Wang , Ji-Rong Wen

Instruction tuning enhances large language models (LLMs) by aligning them with human preferences across diverse tasks. Traditional approaches to create instruction tuning datasets face serious challenges for low-resource languages due to…

Computation and Language · Computer Science 2024-09-20 Abdullatif Köksal , Marion Thaler , Ayyoob Imani , Ahmet Üstün , Anna Korhonen , Hinrich Schütze

Dense retrieval (DR) converts queries and documents into dense embeddings and measures the similarity between queries and documents in vector space. One of the challenges in DR is the lack of domain-specific training data. While DR models…

Information Retrieval · Computer Science 2024-06-18 Zhiyuan Peng , Xuyang Wu , Qifan Wang , Yi Fang

Dense Retrieval (DR) is now considered as a promising tool to enhance the memorization capacity of Large Language Models (LLM) such as GPT3 and GPT-4 by incorporating external memories. However, due to the paradigm discrepancy between text…

Computation and Language · Computer Science 2024-03-05 Si Sun , Hanqing Zhang , Zhiyuan Liu , Jie Bao , Dawei Song

The pre-trained multi-lingual XLSR model generalizes well for language identification after fine-tuning on unseen languages. However, the performance significantly degrades when the languages are not very distinct from each other, for…

Machine Learning · Computer Science 2023-02-17 Shangeth Rajaa , Kriti Anandan , Swaraj Dalmia , Tarun Gupta , Eng Siong Chng

Language fairness in multilingual information retrieval (MLIR) systems is crucial for ensuring equitable access to information across diverse languages. This paper sheds light on the issue, based on the assumption that queries in different…

Information Retrieval · Computer Science 2025-09-09 Jinrui Yang , Fan Jiang , Timothy Baldwin

Passage retrieval and ranking is a key task in open-domain question answering and information retrieval. Current effective approaches mostly rely on pre-trained deep language model-based retrievers and rankers. These methods have been shown…

Information Retrieval · Computer Science 2021-09-14 Shengyao Zhuang , Guido Zuccon

Scaling semantic parsing models for task-oriented dialog systems to new languages is often expensive and time-consuming due to the lack of available datasets. Available datasets suffer from several shortcomings: a) they contain few…

Computation and Language · Computer Science 2021-01-28 Haoran Li , Abhinav Arora , Shuohui Chen , Anchit Gupta , Sonal Gupta , Yashar Mehdad

To improve the performance of Neural Machine Translation~(NMT) for low-resource languages~(LRL), one effective strategy is to leverage parallel data from a related high-resource language~(HRL). However, multilingual data has been found more…

Computation and Language · Computer Science 2020-10-06 Luyu Gao , Xinyi Wang , Graham Neubig

Retrieval of previously fact-checked claims is a well-established task, whose automation can assist professional fact-checkers in the initial steps of information verification. Previous works have mostly tackled the task monolingually,…

Computation and Language · Computer Science 2025-09-23 Alan Ramponi , Marco Rovera , Robert Moro , Sara Tonelli

Dense retrieval has become the new paradigm in passage retrieval. Despite its effectiveness on typo-free queries, it is not robust when dealing with queries that contain typos. Current works on improving the typo-robustness of dense…

Information Retrieval · Computer Science 2024-03-19 Georgios Sidiropoulos , Evangelos Kanoulas

Large language models (LLMs) have revolutionized various domains but still struggle with non-Latin scripts and low-resource languages. This paper addresses the critical challenge of improving multilingual performance without extensive…

Computation and Language · Computer Science 2025-01-08 Somnath Kumar , Vaibhav Balloli , Mercy Ranjit , Kabir Ahuja , Sunayana Sitaram , Kalika Bali , Tanuja Ganu , Akshay Nambi

We work to create a multilingual speech synthesis system which can generate speech with the proper accent while retaining the characteristics of an individual voice. This is challenging to do because it is expensive to obtain bilingual…

Multilingual speaker verification (SV) remains challenging due to limited cross-lingual data and language-dependent information in speaker embeddings. This paper presents a language-invariant multilingual SV system for the TidyVoice 2026…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Ze Li , Xiaoxiao Miao , Juan Liu , Ming Li

This research conducts a comparative study on multilingual text classification methods, utilizing deep learning and embedding visualization. The study employs LangDetect, LangId, FastText, and Sentence Transformer on a dataset encompassing…

Computation and Language · Computer Science 2023-12-08 Arinjay Wyawhare

Learned Sparse Retrieval (LSR) models use vocabularies from pre-trained transformers, which often split entities into nonsensical fragments. Splitting entities can reduce retrieval accuracy and limits the model's ability to incorporate…

Information Retrieval · Computer Science 2024-10-17 Thong Nguyen , Shubham Chatterjee , Sean MacAvaney , Iain Mackie , Jeff Dalton , Andrew Yates
‹ Prev 1 8 9 10 Next ›