English
Related papers

Related papers: Building Retrieval Systems for the ClueWeb22-B Cor…

200 papers

The explosive growth of AI and machine learning literature -- with venues like NeurIPS and ICLR now accepting thousands of papers annually -- has made comprehensive citation coverage increasingly difficult for researchers. While citation…

Information Retrieval · Computer Science 2026-04-21 Md Toyaha Rahman Ratul , Zhiqian Chen , Kaiqun Fu , Taoran Ji , Lei Zhang

Large language models are commonly trained on a mixture of filtered web data and curated high-quality corpora, such as social media conversations, books, or technical papers. This curation process is believed to be necessary to produce…

We introduce the Cambridge Law Corpus (CLC), a dataset for legal AI research. It consists of over 250 000 court cases from the UK. Most cases are from the 21st century, but the corpus includes cases as old as the 16th century. This paper…

Computation and Language · Computer Science 2024-01-03 Andreas Östling , Holli Sargeant , Huiyuan Xie , Ludwig Bull , Alexander Terenin , Leif Jonsson , Måns Magnusson , Felix Steffek

Pre-training on larger datasets with ever increasing model size is now a proven recipe for increased performance across almost all NLP tasks. A notable exception is information retrieval, where additional pre-training has so far failed to…

Cross-lingual document alignment aims to identify pairs of documents in two distinct languages that are of comparable content or translations of each other. In this paper, we exploit the signals embedded in URLs to label web documents at…

Computation and Language · Computer Science 2020-10-13 Ahmed El-Kishky , Vishrav Chaudhary , Francisco Guzman , Philipp Koehn

Large language models record impressive performance on many natural language processing tasks. However, their knowledge capacity is limited to the pretraining corpus. Retrieval augmentation offers an effective solution by retrieving context…

Computation and Language · Computer Science 2023-11-22 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

Information retrieval systems are crucial for enabling effective access to large document collections. Recent approaches have leveraged Large Language Models (LLMs) to enhance retrieval performance through query augmentation, but often rely…

Information Retrieval · Computer Science 2025-04-15 Pengcheng Jiang , Jiacheng Lin , Lang Cao , Runchu Tian , SeongKu Kang , Zifeng Wang , Jimeng Sun , Jiawei Han

The Covid-19 pandemic has caused a spur in the medical research literature. With new research advances in understanding the virus, there is a need for robust text mining tools which can process, extract and present answers from the…

Information Retrieval · Computer Science 2021-08-04 Souvik Das , Sougata Saha , Rohini K. Srihari

This paper describes our system for SemEval 2025 Task 7: Previously Fact-Checked Claim Retrieval. The task requires retrieving relevant fact-checks for a given input claim from the extensive, multilingual MultiClaim dataset, which comprises…

Computation and Language · Computer Science 2025-03-13 Amirmohammad Azadi , Sina Zamani , Mohammadmostafa Rostamkhani , Sauleh Eetemadi

Manually curated biomedical repositories -- spanning bioactivity, genomics, and chemistry -- are expensive to maintain, lag behind primary literature, and discard experimental context, obscuring nuances needed to assess data correctness and…

With the increasing number of clinical trial reports generated every day, it is becoming hard to keep up with novel discoveries that inform evidence-based healthcare recommendations. To help automate this process and assist medical experts,…

Computation and Language · Computer Science 2023-05-03 Juraj Vladika , Florian Matthes

Retrieval question answering (ReQA) is the task of retrieving a sentence-level answer to a question from an open corpus (Ahmad et al.,2019).This paper presents MultiReQA, anew multi-domain ReQA evaluation suite com-posed of eight retrieval…

Computation and Language · Computer Science 2020-05-07 Mandy Guo , Yinfei Yang , Daniel Cer , Qinlan Shen , Noah Constant

In unsupervised learning, identifying an effective clustering algorithm for a given tabular dataset remains a fundamental challenge. We introduce ClustRecNet, a novel end-to-end deep learning framework that recommends a suitable clustering…

The performance of a large language model (LLM) depends heavily on the quality and size of its pretraining dataset. However, the pretraining datasets for state-of-the-art open LLMs like Llama 3 and Mixtral are not publicly available and…

Computation and Language · Computer Science 2024-11-01 Guilherme Penedo , Hynek Kydlíček , Loubna Ben allal , Anton Lozhkov , Margaret Mitchell , Colin Raffel , Leandro Von Werra , Thomas Wolf

Ranking models are the main components of information retrieval systems. Several approaches to ranking are based on traditional machine learning algorithms using a set of hand-crafted features. Recently, researchers have leveraged deep…

Information Retrieval · Computer Science 2021-11-03 Mohamed Trabelsi , Zhiyu Chen , Brian D. Davison , Jeff Heflin

This is the fourth year of the TREC Deep Learning track. As in previous years, we leverage the MS MARCO datasets that made hundreds of thousands of human annotated training labels available for both passage and document ranking tasks. In…

Information Retrieval · Computer Science 2025-07-16 Nick Craswell , Bhaskar Mitra , Emine Yilmaz , Daniel Campos , Jimmy Lin , Ellen M. Voorhees , Ian Soboroff

Bayesian networks (BNs) are widely used for modeling complex systems with uncertainty, yet repositories of pre-built BNs remain limited. This paper introduces bnRep, an open-source R package offering a comprehensive collection of documented…

Artificial Intelligence · Computer Science 2024-10-01 Manuele Leonelli

Ranking has always been one of the top concerns in information retrieval research. For decades, lexical matching signal has dominated the ad-hoc retrieval process, but it also has inherent defects, such as the vocabulary mismatch problem.…

Information Retrieval · Computer Science 2020-10-21 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Min Zhang , Shaoping Ma

Keeping track of the ever-increasing body of scientific literature is an escalating challenge. We present PubTree a hierarchical search tool that efficiently searches the PubMed/MEDLINE dataset based upon a decision tree constructed using…

Information Retrieval · Computer Science 2017-02-28 William Rowe , Paul D. Dobson , Bede Constantinides , Mark Platt

Large language models (LLMs) rely heavily on web-scale datasets like Common Crawl, which provides over 80\% of training data for some modern models. However, the indiscriminate nature of web crawling raises challenges in data quality,…

Computation and Language · Computer Science 2025-09-01 Inés Altemir Marinas , Anastasiia Kucherenko , Andrei Kucharavy