中文
相关论文

相关论文: Highly Parallel Autoregressive Entity Linking with…

200 篇论文

Autoregressive sequence Generation models have achieved state-of-the-art performance in areas like machine translation and image captioning. These models are autoregressive in that they generate each word by conditioning on previously…

计算与语言 · 计算机科学 2021-01-26 Longteng Guo , Jing Liu , Xinxin Zhu , Hanqing Lu

We introduce EXIT, an extractive context compression framework that enhances both the effectiveness and efficiency of retrieval-augmented generation (RAG) in question answering (QA). Current RAG systems often struggle when retrieval models…

计算与语言 · 计算机科学 2025-05-30 Taeho Hwang , Sukmin Cho , Soyeong Jeong , Hoyun Song , SeungYoon Han , Jong C. Park

A major challenge in Entity Linking (EL) is making effective use of contextual information to disambiguate mentions to Wikipedia that might refer to different entities in different contexts. The problem exacerbates with cross-lingual EL…

计算与语言 · 计算机科学 2017-12-06 Avirup Sil , Gourab Kundu , Radu Florian , Wael Hamza

Biomedical entity linking is the task of identifying mentions of biomedical concepts in text documents and mapping them to canonical entities in a target thesaurus. Recent advancements in entity linking using BERT-based models follow a…

计算与语言 · 计算机科学 2021-03-10 Rajarshi Bhowmik , Karl Stratos , Gerard de Melo

In Natural Language Processing, entity linking (EL) has centered around Wikipedia, but yet remains underexplored for the job market domain. Disambiguating skill mentions can help us get insight into the current labor market demands. In this…

计算与语言 · 计算机科学 2024-02-01 Mike Zhang , Rob van der Goot , Barbara Plank

Explainable Recommender System (ExRec) provides transparency to the recommendation process, increasing users' trust and boosting the operation of online services. With the rise of large language models (LLMs), whose extensive world…

信息检索 · 计算机科学 2025-07-15 Bangcheng Sun , Yazhe Chen , Jilin Yang , Xiaodong Li , Hui Li

We present Entropy Adaptive Decoding (EAD), a novel approach for efficient language model inference that dynamically switches between different-sized models based on prediction uncertainty. By monitoring rolling entropy in model logit…

机器学习 · 计算机科学 2025-02-12 Toby Simonds

The predominant approach for language modeling is to process sequences from left to right, but this eliminates a source of information: the order by which the sequence was generated. One strategy to recover this information is to decode…

计算与语言 · 计算机科学 2021-11-01 Xuanlin Li , Brandon Trabucco , Dong Huk Park , Michael Luo , Sheng Shen , Trevor Darrell , Yang Gao

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

计算与语言 · 计算机科学 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Despite of the recent success of collective entity linking (EL) methods, these "global" inference methods may yield sub-optimal results when the "all-mention coherence" assumption breaks, and often suffer from high computational cost at the…

计算与语言 · 计算机科学 2019-09-06 Xiyuan Yang , Xiaotao Gu , Sheng Lin , Siliang Tang , Yueting Zhuang , Fei Wu , Zhigang Chen , Guoping Hu , Xiang Ren

Autoregressive decoding of large language models (LLMs) is memory bandwidth bounded, resulting in high latency and significant wastes of the parallel processing power of modern accelerators. Existing methods for accelerating LLM decoding…

机器学习 · 计算机科学 2024-02-06 Yichao Fu , Peter Bailis , Ion Stoica , Hao Zhang

Autoregressive decoding strategy is a commonly used method for text generation tasks with pre-trained language models, while early-exiting is an effective approach to speedup the inference stage. In this work, we propose a novel decoding…

计算与语言 · 计算机科学 2024-03-25 Yunqi Zhu , Xuebing Yang , Yuanyuan Wu , Wensheng Zhang

This paper proposes an iterative inference algorithm for multi-hop explanation regeneration, that retrieves relevant factual evidence in the form of text snippets, given a natural language question and its answer. Combining multiple sources…

信息检索 · 计算机科学 2020-12-22 Ruben Cartuyvels , Graham Spinks , Marie-Francine Moens

We study reasoning tasks through a framework that integrates auto-regressive (AR) and non-autoregressive (NAR) language models. AR models, which generate text sequentially, excel at producing coherent outputs but often suffer from slow…

人工智能 · 计算机科学 2025-09-26 Qihang Ai , Haiyun Jiang

Large-scale digitization initiatives have unlocked massive collections of historical newspapers, yet effective computational access remains hindered by OCR corruption, multilingual orthographic variation, and temporal language drift. We…

数字图书馆 · 计算机科学 2025-12-16 Anthony Mudet , Souhail Bakkali

Heterogeneous graphs are widely present in real-world complex networks, where the diversity of node and relation types leads to complex and rich semantics. Efforts for modeling complex relation semantics in heterogeneous graphs are…

计算与语言 · 计算机科学 2025-11-25 Wenda Li , Tongya Zheng , Shunyu Liu , Yu Wang , Kaixuan Chen , Hanyang Yuan , Bingde Hu , Zujie Ren , Mingli Song , Gang Chen

Retrieval-Augmented Generation (RAG) grounds large language models in external evidence, yet it still falters when answers must be pieced together across semantically distant documents. We close this gap with the Hierarchical Lexical Graph…

Generative retrieval represents a novel approach to information retrieval. It uses an encoder-decoder architecture to directly produce relevant document identifiers (docids) for queries. While this method offers benefits, current approaches…

信息检索 · 计算机科学 2024-09-30 Yubao Tang , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Wei Chen , Xueqi Cheng

Generating long and coherent reports to describe medical images poses challenges to bridging visual patterns with informative human linguistic descriptions. We propose a novel Hybrid Retrieval-Generation Reinforced Agent (HRGR-Agent) which…

计算机视觉与模式识别 · 计算机科学 2018-11-27 Christy Y. Li , Xiaodan Liang , Zhiting Hu , Eric P. Xing

Entity resolution (ER; also known as record linkage or de-duplication) is the process of merging noisy databases, often in the absence of unique identifiers. A major advancement in ER methodology has been the application of Bayesian…