中文
相关论文

相关论文: Benchmarking Large Language Models on Reference Ex…

200 篇论文

Entity Linking (EL) and Relation Extraction (RE) are fundamental tasks in Natural Language Processing, serving as critical components in a wide range of applications. In this paper, we propose ReLiK, a Retriever-Reader architecture for both…

计算与语言 · 计算机科学 2025-05-12 Riccardo Orlando , Pere-Lluis Huguet Cabot , Edoardo Barba , Roberto Navigli

Query by Example is a well-known information retrieval task in which a document is chosen by the user as the search query and the goal is to retrieve relevant documents from a large collection. However, a document often covers multiple…

信息检索 · 计算机科学 2021-11-09 Sheshera Mysore , Tim O'Gorman , Andrew McCallum , Hamed Zamani

Scientific paper retrieval is essential for supporting literature discovery and research. While dense retrieval methods demonstrate effectiveness in general-purpose tasks, they often fail to capture fine-grained scientific concepts that are…

信息检索 · 计算机科学 2025-10-07 Yunyi Zhang , Ruozhen Yang , Siqi Jiao , SeongKu Kang , Jiawei Han

The rapid advancement of large language models (LLMs) has accelerated their integration into clinical decision support, particularly in prescription review. To enable systematic and fine-grained evaluation, we developed RxBench, a…

In retrieval-augmented systems, context ranking techniques are commonly employed to reorder the retrieved contexts based on their relevance to a user query. A standard approach is to measure this relevance through the similarity between…

信息检索 · 计算机科学 2024-10-22 Weichao Zhou , Jiaxin Zhang , Hilaf Hasson , Anu Singh , Wenchao Li

Recently, there has been a growing interest among large language model (LLM) developers in LLM-based document reading systems, which enable users to upload their own documents and pose questions related to the document contents, going…

计算与语言 · 计算机科学 2024-07-16 Anni Zou , Wenhao Yu , Hongming Zhang , Kaixin Ma , Deng Cai , Zhuosheng Zhang , Hai Zhao , Dong Yu

This paper introduces a novel, multi-source framework for the relational validation of Large Language Models (LLMs). While existing benchmarks have demonstrated LLMs' proficiency at factual recall, their ability to understand and reproduce…

社会与信息网络 · 计算机科学 2026-05-22 Moses Boudourides

Document-to-table (Doc2Table) extraction derives structured tables from unstructured documents under a target schema, enabling reliable and verifiable SQL-based data analytics. Although large language models (LLMs) have shown promise in…

数据库 · 计算机科学 2026-02-18 Yuxiang Guo , Zhuoran Du , Nan Tang , Kezheng Tang , Congcong Ge , Yunjun Gao

Large Language Models (LLMs) have demonstrated strong potential across legal tasks, yet the problem of legal citation prediction remains under-explored. At its core, this task demands fine-grained contextual understanding and precise…

计算与语言 · 计算机科学 2025-05-23 Jiuzhou Han , Paul Burgess , Ehsan Shareghi

Recently, research on explainable recommender systems has drawn much attention from both academia and industry, resulting in a variety of explainable models. As a consequence, their evaluation approaches vary from model to model, which…

信息检索 · 计算机科学 2021-05-11 Lei Li , Yongfeng Zhang , Li Chen

Recent advances in machine learning have significantly impacted the field of information extraction, with Language Models (LMs) playing a pivotal role in extracting structured information from unstructured text. Prior works typically…

计算与语言 · 计算机科学 2024-10-03 Haolun Wu , Ye Yuan , Liana Mikaelyan , Alexander Meulemans , Xue Liu , James Hensman , Bhaskar Mitra

Across all fields of academic study, experts cite their sources when sharing information. While large language models (LLMs) excel at synthesizing information, they do not provide reliable citation to sources, making it difficult to trace…

计算与语言 · 计算机科学 2024-11-27 Theodora Worledge , Tatsunori Hashimoto , Carlos Guestrin

Large language models (LLMs) call for extension of context to handle many critical applications. However, the existing approaches are prone to expensive costs and inferior quality of context extension. In this work, we proposeExtensible…

计算与语言 · 计算机科学 2024-02-20 Kun Luo , Zheng Liu , Shitao Xiao , Kang Liu

Adapting general-domain retrievers to scientific domains is challenging due to the scarcity of large-scale domain-specific relevance annotations and the substantial mismatch in vocabulary and information needs. Recent approaches address…

信息检索 · 计算机科学 2026-01-05 Jeyun Lee , Junhyoung Lee , Wonbin Kweon , Bowen Jin , Yu Zhang , Susik Yoon , Dongha Lee , Hwanjo Yu , Jiawei Han , Seongku Kang

Query expansion is an effective approach for mitigating vocabulary mismatch between queries and documents in information retrieval. One recent line of research uses language models to generate query-related contexts for expansion. Along…

计算与语言 · 计算机科学 2022-10-14 Linqing Liu , Minghan Li , Jimmy Lin , Sebastian Riedel , Pontus Stenetorp

The knowledge extraction task is to extract triple relations (head entity-relation-tail entity) from unstructured text data. The existing knowledge extraction methods are divided into "pipeline" method and joint extraction method. The…

计算与语言 · 计算机科学 2022-04-01 Suyu Ouyang , Yingxia Shao , Junping Du , Ang Li

Systematic reviews and meta-analyses rely on converting narrative articles into structured, numerically grounded study records. Despite rapid advances in large language models (LLMs), it remains unclear whether they can meet the structural…

计算与语言 · 计算机科学 2026-02-12 Zhiyin Tan , Jennifer D'Souza

We present the methodology and results of the Deep Retrieval team for subtask 4b of the CLEF CheckThat! 2025 competition, which focuses on retrieving relevant scientific literature for given social media posts. To address this task, we…

信息检索 · 计算机科学 2025-07-08 Pascal J. Sager , Ashwini Kamaraj , Benjamin F. Grewe , Thilo Stadelmann

Recently, numerous efforts have continued to push up performance boundaries of document-level relation extraction (DocRE) and have claimed significant progress in DocRE. In this paper, we do not aim at proposing a novel model for DocRE.…

计算与语言 · 计算机科学 2023-06-16 Jing Li , Yequan Wang , Shuai Zhang , Min Zhang

LaTeX's precision and flexibility in typesetting have made it the gold standard for the preparation of scientific documentation. Large Language Models (LLMs) present a promising opportunity for researchers to produce publication-ready…

计算与语言 · 计算机科学 2025-09-16 Sahil Kale , Vijaykant Nadadur