English
Related papers

Related papers: IncDSI: Incrementally Updatable Document Retrieval

200 papers

Vocabulary mismatch is a central problem in information retrieval (IR), i.e., the relevant documents may not contain the same (symbolic) terms of the query. Recently, neural representations have shown great success in capturing semantic…

Information Retrieval · Computer Science 2018-07-24 Yan Xiao , Jiafeng Guo , Yixing Fan , Yanyan Lan , Jun Xu , Xueqi Cheng

Digitization, i.e., the process of converting information into a digital format, may provide various opportunities (e.g., increase in productivity, disaster recovery, and environmentally friendly solutions) and challenges for businesses. In…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Nouna Khandan

Full-text search engines are important tools for information retrieval. In a proximity full-text search, a document is relevant if it contains query terms near each other, especially if the query terms are frequently occurring words. For…

Information Retrieval · Computer Science 2019-07-11 Alexander B. Veretennikov

Knowledge-intensive language tasks require NLP systems to both provide the correct answer and retrieve supporting evidence for it in a given corpus. Autoregressive language models are emerging as the de-facto standard for generating…

Computation and Language · Computer Science 2022-04-25 Michele Bevilacqua , Giuseppe Ottaviano , Patrick Lewis , Wen-tau Yih , Sebastian Riedel , Fabio Petroni

One of the important factors that make a search engine fast and accurate is a concise and duplicate free index. In order to remove duplicate and near-duplicate documents from the index, a search engine needs a swift and reliable duplicate…

Information Retrieval · Computer Science 2019-09-26 Hamid Mohammadi , Seyed Hossein Khasteh

Recent research has shown that transformer networks can be used as differentiable search indexes by representing each document as a sequences of document ID tokens. These generative retrieval models cast the retrieval problem to a document…

Information Retrieval · Computer Science 2023-11-16 Hansi Zeng , Chen Luo , Bowen Jin , Sheikh Muhammad Sarwar , Tianxin Wei , Hamed Zamani

Document parsing is essential for analyzing complex document structures and extracting fine-grained information, supporting numerous downstream applications. However, existing methods often require integrating multiple independent models to…

Computation and Language · Computer Science 2025-05-23 Mingxu Chai , Ziyu Shen , Chong Zhang , Yue Zhang , Xiao Wang , Shihan Dou , Jihua Kang , Jiazheng Zhang , Qi Zhang

The parallelized multi-retrieval architecture has been widely adopted in large-scale recommender systems for its computational efficiency and comprehensive coverage of user interests. Many retrieval methods typically integrate additional…

Information Retrieval · Computer Science 2025-12-09 Tao Wang , Xun Luo , Jinlong Guo , Yuliang Yan , Jian Wu , Yuning Jiang , Bo Zheng

Requirement traceability is the process of identifying the inter-dependencies between requirements. It poses a significant challenge when conducted manually, especially when dealing with requirements at various levels of abstraction. In…

Artificial Intelligence · Computer Science 2024-06-21 Baher Mohammad , Riad Sonbol , Ghaida Rebdawi

The ability to understand and answer questions over documents can be useful in many business and practical applications. However, documents often contain lengthy and diverse multimodal contents such as texts, figures, and tables, which are…

Computation and Language · Computer Science 2024-11-12 Yew Ken Chia , Liying Cheng , Hou Pong Chan , Chaoqun Liu , Maojia Song , Sharifah Mahani Aljunied , Soujanya Poria , Lidong Bing

As the web expands in data volume and in geographical distribution, centralized search methods become inefficient, leading to increasing interest in cooperative information retrieval, e.g., federated text retrieval (FTR). Different from…

Information Retrieval · Computer Science 2018-10-08 Qijun Zhu , Dandan Li , Dik Lun Lee

To accelerate software development, developers frequently search and reuse existing code snippets from a large-scale codebase, e.g., GitHub. Over the years, researchers proposed many information retrieval based models for code search, but…

Software Engineering · Computer Science 2022-02-23 Chao Liu , Xin Xia , David Lo , Zhiwei Liu , Ahmed E. Hassan , Shanping Li

Recently, model-based retrieval has emerged as a new paradigm in text retrieval that discards the index in the traditional retrieval model and instead memorizes the candidate corpora using model parameters. This design employs a…

Information Retrieval · Computer Science 2023-05-19 Ruiyang Ren , Wayne Xin Zhao , Jing Liu , Hua Wu , Ji-Rong Wen , Haifeng Wang

In the field of multi-document summarization (MDS), transformer-based models have demonstrated remarkable success, yet they suffer an input length limitation. Current methods apply truncation after the retrieval process to fit the context…

Machine Learning · Computer Science 2025-04-24 Shiyin Tan , Jaeeon Park , Dongyuan Li , Renhe Jiang , Manabu Okumura

In recent years, tremendous efforts have been made on document image rectification, but existing advanced algorithms are limited to processing restricted document images, i.e., the input images must incorporate a complete document. Once the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Hao Feng , Shaokai Liu , Jiajun Deng , Wengang Zhou , Houqiang Li

Conventional document retrieval techniques are mainly based on the index-retrieve paradigm. It is challenging to optimize pipelines based on this paradigm in an end-to-end manner. As an alternative, generative retrieval represents documents…

Information Retrieval · Computer Science 2023-04-11 Weiwei Sun , Lingyong Yan , Zheng Chen , Shuaiqiang Wang , Haichao Zhu , Pengjie Ren , Zhumin Chen , Dawei Yin , Maarten de Rijke , Zhaochun Ren

We introduce and define the novel problem of multi-distribution information retrieval (IR) where given a query, systems need to retrieve passages from within multiple collections, each drawn from a different distribution. Some of these…

Information Retrieval · Computer Science 2023-06-23 Soumya Chatterjee , Omar Khattab , Simran Arora

Removing degradation from document images not only improves their visual quality and readability, but also enhances the performance of numerous automated document analysis and recognition tasks. However, existing regression-based methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Zongyuan Yang , Baolin Liu , Yongping Xiong , Lan Yi , Guibin Wu , Xiaojun Tang , Ziqi Liu , Junjie Zhou , Xing Zhang

Deep learning has shown great potential in accelerating diffusion tensor imaging (DTI). Nevertheless, existing methods tend to suffer from Rician noise and eddy current, leading to detail loss in reconstructing the DTI-derived parametric…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Wenxin Fan , Jian Cheng , Cheng Li , Jing Yang , Ruoyou Wu , Juan Zou , Shanshan Wang

Many early neural Information Retrieval (NeurIR) methods are re-rankers that rely on a traditional first-stage retriever due to expensive query time computations. Recently, representation-based retrievers have gained much attention, which…

Information Retrieval · Computer Science 2023-11-28 Sibo Dong , Justin Goldstein , Grace Hui Yang