English
Related papers

Related papers: Information Retrieval in long documents: Word clus…

200 papers

Automated detection of semantically equivalent questions in longitudinal social science surveys is crucial for long-term studies informing empirical research in the social, economic, and health sciences. Retrieving equivalent questions…

Computation and Language · Computer Science 2025-07-08 Wing Yan Li , Zeqiang Wang , Jon Johnson , Suparna De

A major computational burden, while performing document clustering, is the calculation of similarity measure between a pair of documents. Similarity measure is a function that assigns a real number between 0 and 1 to a pair of documents,…

Information Retrieval · Computer Science 2013-03-19 Muhammad Rafi , Mohammad Shahid Shaikh

This paper presents a new Bayesian non-parametric model by extending the usage of Hierarchical Dirichlet Allocation to extract tree structured word clusters from text data. The inference algorithm of the model collects words in a cluster if…

Computation and Language · Computer Science 2016-01-22 Halid Ziya Yerebakan , Fitsum Reda , Yiqiang Zhan , Yoshihisa Shinagawa

This paper evaluates existing and newly proposed answer selection methods based on pre-trained word embeddings. Word embeddings are highly effective in various natural language processing tasks and their integration into traditional…

Information Retrieval · Computer Science 2017-08-16 Rishav Chakravarti , Jiri Navratil , Cicero Nogueira dos Santos

Textual queries are largely employed in information retrieval to let users specify search goals in a natural way. However, differences in user and system terminologies can challenge the identification of the user's information needs, and…

Information Retrieval · Computer Science 2020-03-31 Noemi Mauro , Liliana Ardissono , Adriano Savoca

In this paper, we rethink sparse lexical representations for image retrieval. By utilizing multi-modal large language models (M-LLMs) that support visual prompting, we can extract image features and convert them into textual data, enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Kengo Nakata , Daisuke Miyashita , Youyang Ng , Yasuto Hoshi , Jun Deguchi

Most of the fastest-growing string collections today are repetitive, that is, most of the constituent documents are similar to many others. As these collections keep growing, a key approach to handling them is to exploit their…

Information Retrieval · Computer Science 2017-05-22 Travis Gagie , Aleksi Hartikainen , Kalle Karhu , Juha Kärkkäinen , Gonzalo Navarro , Simon J. Puglisi , Jouni Sirén

Information Retrieval (IR) methods aim to identify documents relevant to a query, which have been widely applied in various natural language tasks. However, existing approaches typically consider only the textual content within documents,…

Computation and Language · Computer Science 2026-01-26 Jaewoo Lee , Joonho Ko , Jinheon Baek , Soyeong Jeong , Sung Ju Hwang

On a wide range of natural language processing and information retrieval tasks, transformer-based models, particularly pre-trained language models like BERT, have demonstrated tremendous effectiveness. Due to the quadratic complexity of the…

Information Retrieval · Computer Science 2022-10-18 Minghan Li , Diana Nicoleta Popa , Johan Chagnon , Yagmur Gizem Cinar , Eric Gaussier

With the advent of the Internet, a new era of digital information exchange has begun. Currently, the Internet encompasses more than five billion online sites and this number is exponentially increasing every day. Fundamentally, Information…

Information Retrieval · Computer Science 2012-04-03 Youssef Bassil , Paul Semaan

External linguistic resources have been used for a very long time in information extraction. These methods enrich a document with data that are semantically equivalent, in order to improve recall. For instance, some of these methods use…

Information Retrieval · Computer Science 2007-05-23 Bernard Jacquemin , Caroline Brun , Claude Roux

We develop and test a novel unsupervised algorithm for word sense induction and disambiguation which uses topological data analysis. Typical approaches to the problem involve clustering, based on simple low level features of distance in…

Computation and Language · Computer Science 2022-03-02 Michael Rawson , Samuel Dooley , Mithun Bharadwaj , Rishabh Choudhary

In this work, we focus on the problem of retrieving relevant arguments for a query claim covering diverse aspects. State-of-the-art methods rely on explicit mappings between claims and premises, and thus are unable to utilize large…

Information Retrieval · Computer Science 2021-03-18 Michael Fromm , Max Berrendorf , Sandra Obermeier , Thomas Seidl , Evgeniy Faerman

We present a novel approach to pseudo-feedback-based ad hoc retrieval that uses language models induced from both documents and clusters. First, we treat the pseudo-feedback documents produced in response to the original query as a set of…

Information Retrieval · Computer Science 2007-05-23 Oren Kurland , Lillian Lee , Carmel Domshlak

Vector representations and vector space modeling (VSM) play a central role in modern machine learning. We propose a novel approach to `vector similarity searching' over dense semantic representations of words and documents that can be…

Information Retrieval · Computer Science 2017-06-06 Jan Rygl , Jan Pomikálek , Radim Řehůřek , Michal Růžička , Vít Novotný , Petr Sojka

Search engines perform the task of retrieving information related to the user-supplied query words. This task has two parts; one is finding "featured words" which describe an article best and the other is finding a match among these words…

Neural and Evolutionary Computing · Computer Science 2007-05-23 A. Das , M. Marko , A. Probst , M. A. Porter , C. Gershenson

Recent advances in large language models enable documents to be represented as dense semantic embeddings, supporting similarity-based operations over large text collections. However, many web-scale systems still rely on flat clustering or…

Computation and Language · Computer Science 2026-01-30 Thomas Haschka , Joseph Bakarji

Recognition and retrieval of textual content from the large document collections have been a powerful use case for the document image analysis community. Often the word is the basic unit for recognition as well as retrieval. Systems that…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Siddhant Bansal , Praveen Krishnan , C. V. Jawahar

In this paper we propose a graph-community detection approach to identify cross-document relationships at the topic segment level. Given a set of related documents, we automatically find these relationships by clustering segments with…

Computation and Language · Computer Science 2016-06-14 Pedro Mota , Maxine Eskenazi , Luisa Coheur

Querying over XML elements using keyword search is steadily gaining popularity. The traditional similarity measure is widely employed in order to effectively retrieve various XML documents. A number of authors have already proposed…

Information Retrieval · Computer Science 2010-12-20 Yang Wang , Zhikui Chen , Xiaodi Huang