English
Related papers

Related papers: Dense Hierarchical Retrieval for Open-Domain Quest…

200 papers

Complex question answering often requires finding a reasoning chain that consists of multiple evidence pieces. Current approaches incorporate the strengths of structured knowledge and unstructured text, assuming text corpora is…

Computation and Language · Computer Science 2021-04-14 Chen Zhao , Chenyan Xiong , Jordan Boyd-Graber , Hal Daumé

This paper describes a compact and effective model for low-latency passage retrieval in conversational search based on learned dense representations. Prior to our work, the state-of-the-art approach uses a multi-stage pipeline comprising…

Information Retrieval · Computer Science 2021-11-30 Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin

Translating renderings (e. g. PDFs, scans) into hierarchical document structures is extensively demanded in the daily routines of many real-world applications. However, a holistic, principled approach to inferring the complete hierarchical…

Machine Learning · Computer Science 2021-01-26 Johannes Rausch , Octavio Martinez , Fabian Bissig , Ce Zhang , Stefan Feuerriegel

In recent years, robots and autonomous systems have become increasingly integral to our daily lives, offering solutions to complex problems across various domains. Their application in search and rescue (SAR) operations, however, presents…

Robotics · Computer Science 2024-09-23 Dimitrios Panagopoulos , Adolfo Perrusquia , Weisi Guo

Retrieving information from EHR systems is essential for answering specific questions about patient journeys and improving the delivery of clinical care. Despite this fact, most EHR systems still rely on keyword-based searches. With the…

Computation and Language · Computer Science 2024-04-11 Shashi Kant Gupta , Aditya Basu , Bradley Taylor , Anai Kothari , Hrituraj Singh

The continually increasing number of documents produced each year necessitates ever improving information processing methods for searching, retrieving, and organizing text. Central to these information processing methods is document…

Deep neural networks have achieved significant improvements in information retrieval (IR). However, most existing models are computational costly and can not efficiently scale to long documents. This paper proposes a novel End-to-End neural…

Computation and Language · Computer Science 2019-08-13 Chen Zheng , Yu Sun , Shengxian Wan , Dianhai Yu

Speculative decoding (SD) accelerates Large Language Model (LLM) generation by using an efficient draft model to propose the next few tokens, which are verified by the LLM in a single forward call, reducing latency while preserving its…

Computation and Language · Computer Science 2025-05-30 Milan Gritta , Huiyin Xue , Gerasimos Lampouras

This paper describes a hierarchical learning strategy for generating sparse representations of multivariate datasets. The hierarchy arises from approximation spaces considered at successively finer scales. A detailed analysis of stability,…

Machine Learning · Statistics 2019-10-23 Prashant Shekhar , Abani Patra

Large Language Models have undoubtedly revolutionized the Natural Language Processing field, the current trend being to promote one-model-for-all tasks (sentiment analysis, translation, etc.). However, the statistical mechanisms at work in…

Computation and Language · Computer Science 2024-08-26 Célia D'Cruz , Jean-Marc Bereder , Frédéric Precioso , Michel Riveill

Training dense passage representations via contrastive learning has been shown effective for Open-Domain Passage Retrieval (ODPR). Existing studies focus on further optimizing by improving negative sampling strategy or extra pretraining.…

Computation and Language · Computer Science 2022-03-08 Bohong Wu , Zhuosheng Zhang , Jinyuan Wang , Hai Zhao

Outside-Knowledge Visual Question Answering (OK-VQA) is a challenging VQA task that requires retrieval of external knowledge to answer questions about images. Recent OK-VQA systems use Dense Passage Retrieval (DPR) to retrieve documents…

Computation and Language · Computer Science 2022-11-01 Weizhe Lin , Bill Byrne

Open-domain conversational question answering can be viewed as two tasks: passage retrieval and conversational question answering, where the former relies on selecting candidate passages from a large corpus and the latter requires better…

Computation and Language · Computer Science 2022-11-18 Hung-Chieh Fang , Kuo-Han Hung , Chao-Wei Huang , Yun-Nung Chen

Most existing audio-text retrieval (ATR) approaches typically rely on a single-level interaction to associate audio and text, limiting their ability to align different modalities and leading to suboptimal matches. In this work, we present a…

Sound · Computer Science 2025-05-06 Yifei Xin , Zhihong Zhu , Xuxin Cheng , Xusheng Yang , Yuexian Zou

Pseudo-relevance feedback mechanisms, from Rocchio to the relevance models, have shown the usefulness of expanding and reweighting the users' initial queries using information occurring in an initial set of retrieved documents, known as the…

Information Retrieval · Computer Science 2021-07-02 Xiao Wang , Craig Macdonald , Nicola Tonellotto , Iadh Ounis

Large language models with retrieval-augmented generation encounter a pivotal challenge in intricate retrieval tasks, e.g., multi-hop question answering, which requires the model to navigate across multiple documents and generate…

Information Retrieval · Computer Science 2025-05-06 Weijie Chen , Ting Bai , Jinbo Su , Jian Luan , Wei Liu , Chuan Shi

Recent progress in deep learning has continuously improved the accuracy of dialogue response selection. In particular, sophisticated neural network architectures are leveraged to capture the rich interactions between dialogue context and…

Computation and Language · Computer Science 2022-04-26 Tian Lan , Deng Cai , Yan Wang , Yixuan Su , Heyan Huang , Xian-Ling Mao

Generative retrieval introduces a groundbreaking paradigm to document retrieval by directly generating the identifier of a pertinent document in response to a specific query. This paradigm has demonstrated considerable benefits and…

Information Retrieval · Computer Science 2024-10-28 Mingming Li , Huimu Wang , Zuxu Chen , Guangtao Nie , Yiming Qiu , Guoyu Tang , Lin Liu , Jingwei Zhuo

Retrieval models based on dense representations in semantic space have become an indispensable branch for first-stage retrieval. These retrievers benefit from surging advances in representation learning towards compressive global…

Computation and Language · Computer Science 2023-03-06 Kai Zhang , Chongyang Tao , Tao Shen , Can Xu , Xiubo Geng , Binxing Jiao , Daxin Jiang

A fundamental trade-off between effectiveness and efficiency needs to be balanced when designing an online question answering system. Effectiveness comes from sophisticated functions such as extractive machine reading comprehension (MRC),…

Computation and Language · Computer Science 2019-08-14 Ming Yan , Jiangnan Xia , Chen Wu , Bin Bi , Zhongzhou Zhao , Ji Zhang , Luo Si , Rui Wang , Wei Wang , Haiqing Chen