English
Related papers

Related papers: Better than the real thing? Iterative pseudo-query…

200 papers

There has recently been considerable interest in incorporating information retrieval into large language models (LLMs). Retrieval from a dynamically expanding external corpus of text allows a model to incorporate current events and can be…

Computation and Language · Computer Science 2025-03-26 Yanhong Li , David Yunis , David McAllester , Jiawei Zhou

We report experimental results associated with speech-driven text retrieval, which facilitates retrieving information in multiple domains with spoken queries. Since users speak contents related to a target collection, we produce language…

Computation and Language · Computer Science 2016-11-15 Katunobu Itou , Atsushi Fujii , Tetsuya Ishikawa

We show how full-text search based on inverted indices can be accelerated by clustering the documents without losing results (SeCluD -- SEarch with CLUstered Documents). We develop a fast multilevel clustering algorithm that explicitly uses…

Information Retrieval · Computer Science 2014-11-06 Jonathan Dimond , Peter Sanders

Clustering algorithms rely on complex optimisation processes that may be difficult to comprehend, especially for individuals who lack technical expertise. While many explainable artificial intelligence techniques exist for supervised…

Machine Learning · Computer Science 2024-09-20 Aurora Spagnol , Kacper Sokol , Pietro Barbiero , Marc Langheinrich , Martin Gjoreski

Automatic query reformulation refers to rewriting a user's original query in order to improve the ranking of retrieval results compared to the original query. We present a general framework for automatic query reformulation based on…

Information Retrieval · Computer Science 2015-07-15 Fernando Diaz

Dense retrieval is a basic building block of information retrieval applications. One of the main challenges of dense retrieval in real-world settings is the handling of queries containing misspelled words. A popular approach for handling…

Effective cross-lingual dense retrieval methods that rely on multilingual pre-trained language models (PLMs) need to be trained to encompass both the relevance matching task and the cross-language alignment task. However, cross-lingual data…

Information Retrieval · Computer Science 2023-05-09 Shengyao Zhuang , Linjun Shou , Guido Zuccon

In this work, we analyze a pseudo-relevance retrieval method based on the results of web search engines. By enriching topics with text data from web search engine result pages and linked contents, we train topic-specific and cost-efficient…

Information Retrieval · Computer Science 2022-03-11 Timo Breuer , Melanie Pest , Philipp Schaer

Retrieval augmentation is critical when Language Models (LMs) exploit non-parametric knowledge related to the query through external knowledge bases before reasoning. The retrieved information is incorporated into LMs as context alongside…

Information Retrieval · Computer Science 2024-11-21 Mingzhu Wang , Yuzhe Zhang , Qihang Zhao , Junyi Yang , Hong Zhang

We consider the problem of learning overcomplete dictionaries in the context of sparse coding, where each sample selects a sparse subset of dictionary elements. Our main result is a strategy to approximately recover the unknown dictionary…

Machine Learning · Statistics 2014-07-08 Alekh Agarwal , Animashree Anandkumar , Praneeth Netrapalli

Fine tuning self supervised pretrained models using pseudo labels can effectively improve speech recognition performance. But, low quality pseudo labels can misguide decision boundaries and degrade performance. We propose a simple yet…

Sound · Computer Science 2022-11-01 Zezhong Jin , Dading Zhong , Xiao Song , Zhaoyi Liu , Naipeng Ye , Qingcheng Zeng

Retrieval-based conversation systems generally tend to highly rank responses that are semantically similar or even identical to the given conversation context. While the system's goal is to find the most appropriate response, rather than…

Computation and Language · Computer Science 2018-10-09 Denis Fedorenko , Nikita Smetanin , Artem Rodichev

Large language models (LLMs) are probabilistic in nature and perform more reliably when augmented with external information. As complex queries often require multi-step reasoning over the retrieved information, with no clear or…

Information Retrieval · Computer Science 2026-04-10 Roxana Petcu , Evangelos Kanoulas , Maarten de Rijke

We compare the performance of different clustering algorithms applied to the task of unsupervised text categorization. We consider agglomerative clustering algorithms, principal direction divisive partitioning and (for the first time)…

Disordered Systems and Neural Networks · Physics 2007-05-23 D. Volk , M. G. Stepanov

We consider the case of a domain expert who wishes to explore the extent to which a particular idea is expressed in a text collection. We propose the task of semantically matching the idea, expressed as a natural language proposition,…

Computation and Language · Computer Science 2018-08-30 Lucy H. Lin , Scott Miles , Noah A. Smith

We present {\em generative clustering} (GC) for clustering a set of documents, $\mathrm{X}$, by using texts $\mathrm{Y}$ generated by large language models (LLMs) instead of by clustering the original documents $\mathrm{X}$. Because LLMs…

Machine Learning · Computer Science 2024-12-19 Xin Du , Kumiko Tanaka-Ishii

Current state-of-the-art nonparametric Bayesian text clustering methods model documents through multinomial distribution on bags of words. Although these methods can effectively utilize the word burstiness representation of documents and…

Machine Learning · Computer Science 2018-12-03 Tiehang Duan , Qi Lou , Sargur N. Srihari , Xiaohui Xie

Ensuring that Large Language Models (LLMs) generate text representative of diverse sub-populations is essential, particularly when key concepts related to under-represented groups are scarce in the training data. We address this challenge…

Computation and Language · Computer Science 2024-12-17 Sabit Hassan , Anthony Sicilia , Malihe Alikhani

Multilingual Large Language Models (LLMs) offer powerful capabilities for cross-lingual fact-checking. However, these models often exhibit language bias, performing disproportionately better on high-resource languages such as English than…

Computation and Language · Computer Science 2025-09-30 Ivan Vykopal , Antonia Karamolegkou , Jaroslav Kopčan , Qiwei Peng , Tomáš Javůrek , Michal Gregor , Marián Šimko

Query expansion is a functionality of search engines that suggests a set of related queries for a user-issued keyword query. Typical corpus-driven keyword query expansion approaches return popular words in the results as expanded queries.…

Information Retrieval · Computer Science 2011-04-19 Ziyang Liu , Sivaramakrishnan Natarajan , Yi Chen