English
Related papers

Related papers: Building Russian Benchmark for Evaluation of Infor…

200 papers

The main approach of traditional information retrieval (IR) is to examine how many words from a query appear in a document. A drawback of this approach, however, is that it may fail to detect relevant documents where no or only few words…

Computation and Language · Computer Science 2017-10-19 Sun Kim , Nicolas Fiorini , W. John Wilbur , Zhiyong Lu

Medical information retrieval (MIR) is essential for retrieving relevant medical knowledge from diverse sources, including electronic health records, scientific literature, and medical databases. However, achieving effective zero-shot dense…

Information Retrieval · Computer Science 2025-05-27 Lei Li , Xiangxu Zhang , Xiao Zhou , Zheng Liu

We consider the situation in which a user has collected a small set of documents on a cohesive topic, and they want to retrieve additional documents on this topic from a large collection. Information Retrieval (IR) solutions treat the…

Computation and Language · Computer Science 2021-01-18 Alon Jacovi , Gang Niu , Yoav Goldberg , Masashi Sugiyama

The information retrieval community has recently witnessed a revolution due to large pretrained transformer models. Another key ingredient for this revolution was the MS MARCO dataset, whose scale and diversity has enabled zero-shot…

Computation and Language · Computer Science 2022-02-11 Luiz Bonifacio , Hugo Abonizio , Marzieh Fadaee , Rodrigo Nogueira

Existing retrieval benchmarks primarily consist of text-based queries where keyword or semantic matching is usually sufficient. Many real-world queries contain multimodal elements, particularly, images such as diagrams, charts, and…

This paper presents the system description of our entry for the COLING 2025 RegNLP RIRAG (Regulatory Information Retrieval and Answer Generation) challenge, focusing on leveraging advanced information retrieval and answer generation…

Computation and Language · Computer Science 2024-12-10 Jebish Purbey , Drishti Sharma , Siddhant Gupta , Khawaja Murad , Siddartha Pullakhandam , Ram Mohan Rao Kadiyala

Digital Forensics and Incident Response (DFIR) involves analyzing digital evidence to support legal investigations. Large Language Models (LLMs) offer new opportunities in DFIR tasks such as log analysis and memory forensics, but their…

Cryptography and Security · Computer Science 2025-05-27 Bilel Cherif , Tamas Bisztray , Richard A. Dubniczky , Aaesha Aldahmani , Saeed Alshehhi , Norbert Tihanyi

Effective disaster management requires timely access to accurate and contextually relevant information. Existing Information Retrieval (IR) benchmarks, however, focus primarily on general or specialized domains, such as medicine or finance,…

Information Retrieval · Computer Science 2025-09-23 Kai Yin , Xiangjue Dong , Chengkai Liu , Lipai Huang , Yiming Xiao , Zhewei Liu , Ali Mostafavi , James Caverlee

With the increasing accessibility and utilization of multilingual documents, Cross-Lingual Information Retrieval (CLIR) has emerged as an important research area. Conventionally, CLIR tasks have been conducted under settings where the…

Information Retrieval · Computer Science 2026-04-08 Seongtae Hong , Youngjoon Jang , Jungseob Lee , Hyeonseok Moon , Heuiseok Lim

This paper presents a multi-stage reranking system for repository-level code search, which leverages the vastly available commit histories of large open-source repositories to aid in bug fixing. We define the task of repository-level code…

Information Retrieval · Computer Science 2025-02-12 Siddharth Gandhi , Luyu Gao , Jamie Callan

Semantic relatedness of terms represents similarity of meaning by a numerical score. On the one hand, humans easily make judgments about semantic relatedness. On the other hand, this kind of information is useful in language processing…

Large language models (LLMs) have demonstrated strong capabilities in medical question answering; however, purely parametric models often suffer from knowledge gaps and limited factual grounding. Retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2026-04-09 Nusrat Sultana , Abdullah Muhammad Moosa , Kazi Afzalur Rahman , Sajal Chandra Banik

The period from 2019 to the present marks one of the most significant paradigm shifts in information retrieval (IR) and natural language processing (NLP), culminating in the emergence of powerful large language models (LLMs) from 2022…

Information Retrieval · Computer Science 2026-03-17 Zhichao Xu , Fengran Mo , Zhiqi Huang , Crystina Zhang , Puxuan Yu , Bei Wang , Jimmy Lin , Vivek Srikumar

In this paper, we present a Bayesian multilingual document model for learning language-independent document embeddings. The model is an extension of BaySMM [Kesiraju et al 2020] to the multilingual scenario. It learns to represent the…

Computation and Language · Computer Science 2024-03-26 Santosh Kesiraju , Sangeet Sagar , Ondřej Glembek , Lukáš Burget , Ján Černocký , Suryakanth V Gangashetty

Defining psycholinguistic characteristics in written texts is a task gaining increasing attention from researchers. One of the most widely used tools in the current field is Linguistic Inquiry and Word Count (LIWC) that originally was…

Computation and Language · Computer Science 2026-01-29 Elina Sigdel , Anastasia Panfilova

Information retrieval (IR) systems have played a vital role in modern digital life and have cemented their continued usefulness in this new era of generative AI via retrieval-augmented generation. With strong language processing…

Computation and Language · Computer Science 2025-03-04 Shijie Chen , Bernal Jiménez Gutiérrez , Yu Su

Modern dense information retrieval (IR) models usually rely on costly large-scale pretraining. In this paper, we introduce LLM2IR, an efficient unsupervised contrastive learning framework to convert any decoder-only large language model…

Information Retrieval · Computer Science 2026-01-12 Xiaocong Yang

Reasoning-Intensive Retrieval (RIR) targets retrieval settings where relevance is mediated by latent inferential links between a query and supporting evidence, rather than semantic similarity. Motivated by the emergent reasoning abilities…

Information Retrieval · Computer Science 2026-05-04 Yiyang Wei , Tingyu Song , Siyue Zhang , Yilun Zhao

Dense retrieval has shown great success in passage ranking in English. However, its effectiveness in document retrieval for non-English languages remains unexplored due to the limitation in training resources. In this work, we explore…

Computation and Language · Computer Science 2021-09-06 Peng Shi , Rui Zhang , He Bai , Jimmy Lin

The increasing concern with misinformation has stimulated research efforts on automatic fact checking. The recently-released FEVER dataset introduced a benchmark fact-verification task in which a system is asked to verify a claim using…

Computation and Language · Computer Science 2018-11-20 Yixin Nie , Haonan Chen , Mohit Bansal