English
Related papers

Related papers: Auto Search Indexer for End-to-End Document Retrie…

200 papers

Generative information retrieval, encompassing two major tasks of Generative Document Retrieval (GDR) and Grounded Answer Generation (GAR), has gained significant attention in the area of information retrieval and natural language…

Information Retrieval · Computer Science 2023-12-19 Xiaoxi Li , Yujia Zhou , Zhicheng Dou

End-to-end speech recognition models are improved by incorporating external text sources, typically by fusion with an external language model. Such language models have to be retrained whenever the corpus of interest changes. Furthermore,…

Computation and Language · Computer Science 2023-03-21 Bolaji Yusuf , Aditya Gourav , Ankur Gandhe , Ivan Bulyko

This master thesis describes an algorithm for automated categorization of scientific documents using deep learning techniques and compares the results to the results of existing classification algorithms. As an additional goal a reusable…

Information Retrieval · Computer Science 2017-06-20 Thomas Krause

This paper summarizes our work on the first track of the ninth Dialog System Technology Challenge (DSTC 9), "Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access". The goal of the task is to generate…

Computation and Language · Computer Science 2021-02-10 David Thulke , Nico Daheim , Christian Dugast , Hermann Ney

We introduce Dessurt, a relatively simple document understanding transformer capable of being fine-tuned on a greater variety of document tasks than prior methods. It receives a document image and task string as input and generates…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Brian Davis , Bryan Morse , Bryan Price , Chris Tensmeyer , Curtis Wigington , Vlad Morariu

Key information extraction (KIE) from scanned documents has gained increasing attention because of its applications in various domains. Although promising results have been achieved by some recent KIE approaches, they are usually built…

Computation and Language · Computer Science 2023-10-26 Panfeng Cao , Ye Wang , Qiang Zhang , Zaiqiao Meng

Instead of simply matching a query to pre-existing passages, generative retrieval generates identifier strings of passages as the retrieval target. At a cost, the identifier must be distinctive enough to represent a passage. Current…

Computation and Language · Computer Science 2023-05-29 Yongqi Li , Nan Yang , Liang Wang , Furu Wei , Wenjie Li

In video surveillance applications, person search is a challenging task consisting in detecting people and extracting features from their silhouette for re-identification (re-ID) purpose. We propose a new end-to-end model that jointly…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Angelique Loesch , Jaonary Rabarisoa , Romaric Audigier

Large language models (LLMs) inherently display hallucinations since the precision of generated texts cannot be guaranteed purely by the parametric knowledge they include. Although retrieval-augmented generation (RAG) systems enhance the…

Artificial Intelligence · Computer Science 2025-02-18 Bingyu Wan , Fuxi Zhang , Zhongpeng Qi , Jiayi Ding , Jijun Li , Baoshi Fan , Yijia Zhang , Jun Zhang

The goal of a technology-assisted review is to achieve high recall with low human effort. Continuous active learning algorithms have demonstrated good performance in locating the majority of relevant documents in a collection, however their…

Information Retrieval · Computer Science 2018-10-15 Jie Zou , Dan Li , Evangelos Kanoulas

Since real-world ubiquitous documents (e.g., invoices, tickets, resumes and leaflets) contain rich information, automatic document image understanding has become a hot topic. Most existing works decouple the problem into two separate tasks,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Peng Zhang , Yunlu Xu , Zhanzhan Cheng , Shiliang Pu , Jing Lu , Liang Qiao , Yi Niu , Fei Wu

Benchmarking the performance of information retrieval (IR) is mostly conducted with a fixed set of documents (static corpora). However, in realistic scenarios, this is rarely the case and the documents to be retrieved are constantly updated…

Information Retrieval · Computer Science 2024-10-08 Chaeeun Kim , Soyoung Yoon , Hyunji Lee , Joel Jang , Sohee Yang , Minjoon Seo

Query Auto-Completion (QAC) suggests query completions as users type, helping them articulate intent and reach results more efficiently. Existing approaches face fundamental challenges: traditional retrieve-and-rank pipelines have limited…

High throughput experimentation tools, machine learning (ML) methods, and open material databases are radically changing the way new materials are discovered. From the experimentally driven approach in the past, we are moving quickly…

Materials Science · Physics 2025-08-06 Albertus Denny Handoko , Riko I Made

Biomarker discovery is vital in advancing personalized medicine, offering insights into disease diagnosis, prognosis, and therapeutic efficacy. Traditionally, the identification and validation of biomarkers heavily depend on extensive…

Machine Learning · Computer Science 2024-09-25 Wangyang Ying , Dongjie Wang , Xuanming Hu , Ji Qiu , Jin Park , Yanjie Fu

We aim to develop a retrieval-augmented generation (RAG) framework that answers questions over a corpus of visually-rich documents presented in mixed modalities (e.g., charts, tables) and diverse formats (e.g., PDF, PPTX). In this paper, we…

Computation and Language · Computer Science 2025-04-15 Ryota Tanaka , Taichi Iki , Taku Hasegawa , Kyosuke Nishida , Kuniko Saito , Jun Suzuki

The similarity between the question and indexed documents is a crucial factor in document retrieval for retrieval-augmented question answering. Although this is typically the only method for obtaining the relevant documents, it is not the…

Information Retrieval · Computer Science 2024-08-07 Hassan S. Shavarani , Anoop Sarkar

Current state-of-the-art large language models are effective in generating high-quality text and encapsulating a broad spectrum of world knowledge. These models, however, often hallucinate and lack locally relevant factual data.…

Software Engineering · Computer Science 2024-02-21 Anton Shapkin , Denis Litvinov , Yaroslav Zharov , Egor Bogomolov , Timur Galimzyanov , Timofey Bryksin

Retrieval Augmented Generation (RAG) is a promising technique for mitigating two key limitations of large language models (LLMs): outdated information and hallucinations. RAG system stores documents as embedding vectors in a database. Given…

Information Retrieval · Computer Science 2026-02-10 Taehee Jeong , Xingzhe Zhao , Peizu Li , Markus Valvur , Weihua Zhao

Analytical information needs, such as trend analysis and causal impact assessment, are prevalent across various domains including law, finance, science, and much more. However, existing information retrieval paradigms, whether based on…

Information Retrieval · Computer Science 2026-02-13 Yiteng Tu , Shuo Miao , Weihang Su , Yiqun Liu , Qingyao Ai