English
Related papers

Related papers: Large scale citation matching using Apache Hadoop

200 papers

Bibliographic coupling (BC) and co-citation (CC) are the two most common citation-based coupling measures of similarity between scientific items. One can interpret these measures as second-neighbor relations distinguished by the direction…

Physics and Society · Physics 2021-11-01 Jinhyuk Yun

Assessing the quality of scientific research is essential for scholarly communication, yet widely used approaches face limitations in scalability, subjectivity, and time delay. Recent advances in large language models (LLMs) offer new…

Information Retrieval · Computer Science 2026-04-21 Mengjia Wu , Yi Zhang , Robin Haunschild , Lutz Bornmann

We present the architecture behind Twitter's real-time related query suggestion and spelling correction service. Although these tasks have received much attention in the web search literature, the Twitter context introduces a real-time…

Information Retrieval · Computer Science 2012-10-30 Gilad Mishne , Jeff Dalton , Zhenghua Li , Aneesh Sharma , Jimmy Lin

Predicting highly-cited papers is a long-standing challenge due to the complex interactions of research content, scholarly communities, and temporal dynamics. Recent advances in large language models (LLMs) raise the question of whether…

Applications · Statistics 2026-01-21 Zhanshuo Ye , Yiming Hou , Rui Pan , Tianchen Gao , Hansheng Wang

For the study of citation networks, a challenging problem is modeling the high clustering. Existing studies indicate that the promising way to model the high clustering is a copying strategy, i.e., a paper copies the references of its…

Physics and Society · Physics 2015-03-19 Fu-Xin Ren , Xue-Qi Cheng , Hua-Wei Shen

Schema matching is a crucial task in data integration, involving the alignment of a source schema with a target schema to establish correspondence between their elements. This task is challenging due to textual and semantic heterogeneity,…

Databases · Computer Science 2024-05-31 Eitam Sheetrit , Menachem Brief , Moshik Mishaeli , Oren Elisha

Large-scale systems, such as MapReduce and Hadoop, perform aggressive materialization of intermediate job results in order to support fault tolerance. When jobs correspond to exploratory queries submitted by data analysts, these…

Nowadays distributed computing environments, large amounts of data are generated from different resources with a high velocity, rendering the data difficult to capture, manage, and process within existing relational databases. Hadoop is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-24 Rana Ghazali , Douglas G. Down

In the scientific digital libraries, some papers from different research communities can be described by community-dependent keywords even if they share a semantically similar topic. Articles that are not tagged with enough keyword…

Digital Libraries · Computer Science 2018-06-22 Hussein T. Al-Natsheh , Lucie Martinet , Fabrice Muhlenbach , Fabien Rico , Djamel A. Zighed

Assessing relevance between a query and a document is challenging in ad-hoc retrieval due to its diverse patterns, i.e., a document could be relevant to a query as a whole or partially as long as it provides sufficient information for…

Information Retrieval · Computer Science 2018-05-16 Yixing Fan , Jiafeng Guo , Yanyan Lan , Jun Xu , Chengxiang Zhai , Xueqi Cheng

The attribution technique enhances the credibility of LLMs by adding citations to the generated sentences, enabling users to trace back to the original sources and verify the reliability of the output. However, existing instruction-tuned…

Information Retrieval · Computer Science 2026-03-24 Yue Yu , Ting Bai , HengZhi Lan , Li Qian , Li Peng , Jie Wu , Wei Liu , Jian Luan , Chuan Shi

The growth of the amount of medical image data produced on a daily basis in modern hospitals forces the adaptation of traditional medical image analysis and indexing approaches towards scalable solutions. The number of images and their…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-26 Dimitrios Markonis , Roger Schaer , Ivan Eggel , Henning Müller , Adrien Depeursinge

Cross-document event coreference resolution is a foundational task for NLP applications involving multi-text processing. However, existing corpora for this task are scarce and relatively small, while annotating only modest-size clusters of…

Computation and Language · Computer Science 2021-05-03 Alon Eirew , Arie Cattan , Ido Dagan

Access plan recommendation is a query optimization approach that executes new queries using prior created query execution plans (QEPs). The query optimizer divides the query space into clusters in the mentioned method. However, traditional…

Databases · Computer Science 2022-10-14 Elham Azhir , Mehdi Hosseinzadeh , Faheem Khan , Amir Mosavi

Citation count of a paper is a commonly used proxy for evaluating the significance of a paper in the scientific community. Yet citation measures are widely criticized for failing to accurately reflect the true impact of a paper. Thus, we…

Computation and Language · Computer Science 2024-05-29 Ishan Kumar , Zhijing Jin , Ehsan Mokhtarian , Siyuan Guo , Yuen Chen , Mrinmaya Sachan , Bernhard Schölkopf

Retrieval and recommendation are two essential tasks in modern search tools. This paper introduces a novel retrieval-reranking framework leveraging Large Language Models (LLMs) to enhance the spatiotemporal and semantic associated mining…

Information Retrieval · Computer Science 2024-11-21 Yuanyuan Tian , Wenwen Li , Lei Hu , Xiao Chen , Michael Brook , Michael Brubaker , Fan Zhang , Anna K. Liljedahl

The application described has been designed to create bibliographic entries in large databases with diverse sources automatically, which reduces both the frequency of mistakes and the workload for the administrators. This new system…

We present an overview of the SCIDOCA 2025 Shared Task, which focuses on citation discovery and prediction in scientific documents. The task is divided into three subtasks: (1) Citation Discovery, where systems must identify relevant…

Digital Libraries · Computer Science 2025-09-30 An Dao , Vu Tran , Le-Minh Nguyen , Yuji Matsumoto

Statements about entities occur everywhere, from newspapers and web pages to structured databases. Correlating references to entities across systems that use different identifiers or names for them is a widespread problem. In this paper, we…

Artificial Intelligence · Computer Science 2014-06-27 R. V. Guha

To retrieve more relevant, appropriate and useful documents given a query, finding clues about that query through the text is crucial. Recent deep learning models regard the task as a term-level matching problem, which seeks exact or…

Information Retrieval · Computer Science 2021-02-01 Yufeng Zhang , Jinghao Zhang , Zeyu Cui , Shu Wu , Liang Wang