English
Related papers

Related papers: Benchmarking Large Language Models on Reference Ex…

200 papers

Entity Linking (EL) and Relation Extraction (RE) are fundamental tasks in Natural Language Processing, serving as critical components in a wide range of applications. In this paper, we propose ReLiK, a Retriever-Reader architecture for both…

Computation and Language · Computer Science 2025-05-12 Riccardo Orlando , Pere-Lluis Huguet Cabot , Edoardo Barba , Roberto Navigli

Query by Example is a well-known information retrieval task in which a document is chosen by the user as the search query and the goal is to retrieve relevant documents from a large collection. However, a document often covers multiple…

Information Retrieval · Computer Science 2021-11-09 Sheshera Mysore , Tim O'Gorman , Andrew McCallum , Hamed Zamani

Scientific paper retrieval is essential for supporting literature discovery and research. While dense retrieval methods demonstrate effectiveness in general-purpose tasks, they often fail to capture fine-grained scientific concepts that are…

Information Retrieval · Computer Science 2025-10-07 Yunyi Zhang , Ruozhen Yang , Siqi Jiao , SeongKu Kang , Jiawei Han

The rapid advancement of large language models (LLMs) has accelerated their integration into clinical decision support, particularly in prescription review. To enable systematic and fine-grained evaluation, we developed RxBench, a…

Computation and Language · Computer Science 2025-12-03 Yan Yang , Mouxiao Bian , Peiling Li , Bingjian Wen , Ruiyao Chen , Kangkun Mao , Xiaojun Ye , Tianbin Li , Pengcheng Chen , Bing Han , Jie Xu , Kaifeng Qiu , Junyan Wu

In retrieval-augmented systems, context ranking techniques are commonly employed to reorder the retrieved contexts based on their relevance to a user query. A standard approach is to measure this relevance through the similarity between…

Information Retrieval · Computer Science 2024-10-22 Weichao Zhou , Jiaxin Zhang , Hilaf Hasson , Anu Singh , Wenchao Li

Recently, there has been a growing interest among large language model (LLM) developers in LLM-based document reading systems, which enable users to upload their own documents and pose questions related to the document contents, going…

Computation and Language · Computer Science 2024-07-16 Anni Zou , Wenhao Yu , Hongming Zhang , Kaixin Ma , Deng Cai , Zhuosheng Zhang , Hai Zhao , Dong Yu

This paper introduces a novel, multi-source framework for the relational validation of Large Language Models (LLMs). While existing benchmarks have demonstrated LLMs' proficiency at factual recall, their ability to understand and reproduce…

Social and Information Networks · Computer Science 2026-05-22 Moses Boudourides

Document-to-table (Doc2Table) extraction derives structured tables from unstructured documents under a target schema, enabling reliable and verifiable SQL-based data analytics. Although large language models (LLMs) have shown promise in…

Databases · Computer Science 2026-02-18 Yuxiang Guo , Zhuoran Du , Nan Tang , Kezheng Tang , Congcong Ge , Yunjun Gao

Large Language Models (LLMs) have demonstrated strong potential across legal tasks, yet the problem of legal citation prediction remains under-explored. At its core, this task demands fine-grained contextual understanding and precise…

Computation and Language · Computer Science 2025-05-23 Jiuzhou Han , Paul Burgess , Ehsan Shareghi

Recently, research on explainable recommender systems has drawn much attention from both academia and industry, resulting in a variety of explainable models. As a consequence, their evaluation approaches vary from model to model, which…

Information Retrieval · Computer Science 2021-05-11 Lei Li , Yongfeng Zhang , Li Chen

Recent advances in machine learning have significantly impacted the field of information extraction, with Language Models (LMs) playing a pivotal role in extracting structured information from unstructured text. Prior works typically…

Computation and Language · Computer Science 2024-10-03 Haolun Wu , Ye Yuan , Liana Mikaelyan , Alexander Meulemans , Xue Liu , James Hensman , Bhaskar Mitra

Across all fields of academic study, experts cite their sources when sharing information. While large language models (LLMs) excel at synthesizing information, they do not provide reliable citation to sources, making it difficult to trace…

Computation and Language · Computer Science 2024-11-27 Theodora Worledge , Tatsunori Hashimoto , Carlos Guestrin

Large language models (LLMs) call for extension of context to handle many critical applications. However, the existing approaches are prone to expensive costs and inferior quality of context extension. In this work, we proposeExtensible…

Computation and Language · Computer Science 2024-02-20 Kun Luo , Zheng Liu , Shitao Xiao , Kang Liu

Adapting general-domain retrievers to scientific domains is challenging due to the scarcity of large-scale domain-specific relevance annotations and the substantial mismatch in vocabulary and information needs. Recent approaches address…

Information Retrieval · Computer Science 2026-01-05 Jeyun Lee , Junhyoung Lee , Wonbin Kweon , Bowen Jin , Yu Zhang , Susik Yoon , Dongha Lee , Hwanjo Yu , Jiawei Han , Seongku Kang

Query expansion is an effective approach for mitigating vocabulary mismatch between queries and documents in information retrieval. One recent line of research uses language models to generate query-related contexts for expansion. Along…

Computation and Language · Computer Science 2022-10-14 Linqing Liu , Minghan Li , Jimmy Lin , Sebastian Riedel , Pontus Stenetorp

The knowledge extraction task is to extract triple relations (head entity-relation-tail entity) from unstructured text data. The existing knowledge extraction methods are divided into "pipeline" method and joint extraction method. The…

Computation and Language · Computer Science 2022-04-01 Suyu Ouyang , Yingxia Shao , Junping Du , Ang Li

Systematic reviews and meta-analyses rely on converting narrative articles into structured, numerically grounded study records. Despite rapid advances in large language models (LLMs), it remains unclear whether they can meet the structural…

Computation and Language · Computer Science 2026-02-12 Zhiyin Tan , Jennifer D'Souza

We present the methodology and results of the Deep Retrieval team for subtask 4b of the CLEF CheckThat! 2025 competition, which focuses on retrieving relevant scientific literature for given social media posts. To address this task, we…

Information Retrieval · Computer Science 2025-07-08 Pascal J. Sager , Ashwini Kamaraj , Benjamin F. Grewe , Thilo Stadelmann

Recently, numerous efforts have continued to push up performance boundaries of document-level relation extraction (DocRE) and have claimed significant progress in DocRE. In this paper, we do not aim at proposing a novel model for DocRE.…

Computation and Language · Computer Science 2023-06-16 Jing Li , Yequan Wang , Shuai Zhang , Min Zhang

LaTeX's precision and flexibility in typesetting have made it the gold standard for the preparation of scientific documentation. Large Language Models (LLMs) present a promising opportunity for researchers to produce publication-ready…

Computation and Language · Computer Science 2025-09-16 Sahil Kale , Vijaykant Nadadur