English
Related papers

Related papers: Recall, Retrieve and Reason: Towards Better In-Con…

200 papers

Despite the success of large language models (LLMs) in various natural language processing (NLP) tasks, the stored knowledge in these models may inevitably be incomplete, out-of-date, or incorrect. This motivates the need to utilize…

Computation and Language · Computer Science 2023-01-03 Hangfeng He , Hongming Zhang , Dan Roth

The context window of large language models (LLMs) has been extended significantly in recent years. However, while the context length that the LLM can process has grown, the capability of the model to accurately reason over that context…

Computation and Language · Computer Science 2024-10-07 Huayang Li , Pat Verga , Priyanka Sen , Bowen Yang , Vijay Viswanathan , Patrick Lewis , Taro Watanabe , Yixuan Su

Relation extraction (RE) consistently involves a certain degree of labeled or unlabeled data even if under zero-shot setting. Recent studies have shown that large language models (LLMs) transfer well to new tasks out-of-the-box simply given…

Artificial Intelligence · Computer Science 2023-11-27 Guozheng Li , Peng Wang , Wenjun Ke

Relation Extraction (RE) is a fundamental task of information extraction, which has attracted a large amount of research attention. Previous studies focus on extracting the relations within a sentence or document, while currently…

Computation and Language · Computer Science 2022-11-01 Fengqi Wang , Fei Li , Hao Fei , Jingye Li , Shengqiong Wu , Fangfang Su , Wenxuan Shi , Donghong Ji , Bo Cai

Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks. In order to alleviate this critical problem…

Information Retrieval · Computer Science 2022-10-11 Chengwei Hu , Deqing Yang , Haoliang Jin , Zhen Chen , Yanghua Xiao

Large language models (LLMs) exhibit strong semantic understanding, yet struggle when user instructions involve ambiguous or conceptually misaligned terms. We propose the Language Graph Model (LGM) to enhance conceptual clarity by…

Computation and Language · Computer Science 2025-11-06 Wenchang Lei , Ping Zou , Yue Wang , Feng Sun , Lei Zhao

Multimodal relation extraction (MRE) is the task of identifying the semantic relationships between two entities based on the context of the sentence image pair. Existing retrieval-augmented approaches mainly focused on modeling the…

Computation and Language · Computer Science 2023-05-26 Xuming Hu , Zhijiang Guo , Zhiyang Teng , Irwin King , Philip S. Yu

The Retrieval Augmented Generation (RAG) framework utilizes a combination of parametric knowledge and external knowledge to demonstrate state-of-the-art performance on open-domain question answering tasks. However, the RAG framework suffers…

Computation and Language · Computer Science 2024-10-25 Kiseung Kim , Jay-Yoon Lee

Relation extraction is the task of identifying relation instance between two entities given a corpus whereas Knowledge base modeling is the task of representing a knowledge base, in terms of relations between entities. This paper proposes…

Computation and Language · Computer Science 2020-11-20 Xiaoyu Chen , Rohan Badlani

Relation extraction is the task of determining the relation between two entities in a sentence. Distantly-supervised models are popular for this task. However, sentences can be long and two entities can be located far from each other in a…

Computation and Language · Computer Science 2019-12-10 Tapas Nayak , Hwee Tou Ng

There has been increasing interest in exploring the capabilities of advanced large language models (LLMs) in the field of information extraction (IE), specifically focusing on tasks related to named entity recognition (NER) and relation…

Computation and Language · Computer Science 2024-06-25 Ying Mo , Jiahao Liu , Jian Yang , Qifan Wang , Shun Zhang , Jingang Wang , Zhoujun Li

In this paper, we demonstrate how Large Language Models (LLMs) can effectively learn to use an off-the-shelf information retrieval (IR) system specifically when additional context is required to answer a given question. Given the…

Computation and Language · Computer Science 2024-05-08 Tiziano Labruna , Jon Ander Campos , Gorka Azkune

The extraction of lung lesion information from clinical and medical imaging reports is crucial for research on and clinical care of lung-related diseases. Large language models (LLMs) can be effective at interpreting unstructured text in…

Computation and Language · Computer Science 2024-11-18 Diya Li , Asim Kadav , Aijing Gao , Rui Li , Richard Bourgon

Named entity recognition (NER) and relation extraction (RE) are two important tasks in information extraction and retrieval (IE \& IR). Recent work has demonstrated that it is beneficial to learn these tasks jointly, which avoids the…

Computation and Language · Computer Science 2020-01-01 John Giorgi , Xindi Wang , Nicola Sahar , Won Young Shin , Gary D. Bader , Bo Wang

Relation extraction (RE) is an indispensable information extraction task in several disciplines. RE models typically assume that named entity recognition (NER) is already performed in a previous step by another independent model. Several…

Computation and Language · Computer Science 2019-08-29 Tung Tran , Ramakanth Kavuluru

Transformers have a quadratic scaling of computational complexity with input size, which limits the input context window size of large language models (LLMs) in both training and inference. Meanwhile, retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2024-10-18 Yimin Tang , Yurong Xu , Ning Yan , Masood Mortazavi

Pre-trained language models have contributed significantly to relation extraction by demonstrating remarkable few-shot learning abilities. However, prompt tuning methods for relation extraction may still fail to generalize to those rare or…

Computation and Language · Computer Science 2023-09-20 Xiang Chen , Lei Li , Ningyu Zhang , Chuanqi Tan , Fei Huang , Luo Si , Huajun Chen

The goal of open relation extraction (OpenRE) is to develop an RE model that can generalize to new relations not encountered during training. Existing studies primarily formulate OpenRE as a clustering task. They first cluster all test…

Computation and Language · Computer Science 2025-09-19 Hongyao Tu , Liang Zhang , Yujie Lin , Xin Lin , Haibo Zhang , Long Zhang , Jinsong Su

Large language models (LLMs) have transformed AI research thanks to their powerful internal capabilities and knowledge. However, existing LLMs still fail to effectively incorporate the massive external knowledge when interacting with the…

Computation and Language · Computer Science 2026-04-15 Tao Feng , Pengrui Han , Guanyu Lin , Ge Liu , Jiaxuan You

Large language models (LLMs) exhibit remarkable generative capabilities but often suffer from hallucinations. Retrieval-augmented generation (RAG) offers an effective solution by incorporating external knowledge, but existing methods still…

Computation and Language · Computer Science 2024-12-17 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yongkang Wu , Zhonghua Li , Qi Ye , Zhicheng Dou