English
Related papers

Related papers: Rationale-Enhanced Language Models are Better Cont…

200 papers

Relation Extraction (RE) is a pivotal task in automatically extracting structured information from unstructured text. In this paper, we present a multi-faceted approach that integrates representative examples and through co-set expansion.…

Computation and Language · Computer Science 2023-08-24 Yerong Li , Roxana Girju

Domain-specific intelligence demands specialized knowledge and sophisticated reasoning for problem-solving, posing significant challenges for large language models (LLMs) that struggle with knowledge hallucination and inadequate reasoning…

Computation and Language · Computer Science 2025-05-20 Zhengren Wang , Jiayang Yu , Dongsheng Ma , Zhe Chen , Yu Wang , Zhiyu Li , Feiyu Xiong , Yanfeng Wang , Weinan E , Linpeng Tang , Wentao Zhang

The goal of continual learning (CL) is to learn a sequence of tasks without suffering from the phenomenon of catastrophic forgetting. Previous work has shown that leveraging memory in the form of a replay buffer can reduce performance…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Sayna Ebrahimi , Suzanne Petryk , Akash Gokul , William Gan , Joseph E. Gonzalez , Marcus Rohrbach , Trevor Darrell

Domain-Specific Chinese Relation Extraction (DSCRE) aims to extract relations between entities from domain-specific Chinese text. Despite the rapid development of PLMs in recent years, especially LLMs, DSCRE still faces three core…

Computation and Language · Computer Science 2024-04-30 Zhengpeng Shi , Haoran Luo

Relation extraction is the task of identifying relation instance between two entities given a corpus whereas Knowledge base modeling is the task of representing a knowledge base, in terms of relations between entities. This paper proposes…

Computation and Language · Computer Science 2020-11-20 Xiaoyu Chen , Rohan Badlani

Large language models (LLMs) often struggle with context fidelity, producing inconsistent answers when responding to questions based on provided information. Existing approaches either rely on expensive supervised fine-tuning to generate…

Computation and Language · Computer Science 2025-09-18 Suyuchen Wang , Jinlin Wang , Xinyu Wang , Shiqi Li , Xiangru Tang , Sirui Hong , Xiao-Wen Chang , Chenglin Wu , Bang Liu

Relation extraction (RE) involves identifying the relations between entities from underlying content. RE serves as the foundation for many natural language processing (NLP) and information retrieval applications, such as knowledge graph…

Computation and Language · Computer Science 2024-06-25 Xiaoyan Zhao , Yang Deng , Min Yang , Lingzhi Wang , Rui Zhang , Hong Cheng , Wai Lam , Ying Shen , Ruifeng Xu

Generative relation extraction (RE) commonly involves first reformulating RE as a linguistic modeling problem easily tackled with pre-trained language models (PLM) and then fine-tuning a PLM with supervised cross-entropy loss. Although…

Computation and Language · Computer Science 2025-01-07 Jiaxin Duan , Fengyu Lu , Junfei Liu

Large language models (LLMs) struggle in knowledge-intensive tasks, as retrievers often overfit to surface similarity and fail on queries involving complex logical relations. The capacity for logical analysis is inherent in model…

Computation and Language · Computer Science 2026-02-03 Wenxuan Zhang , Yuan-Hao Jiang , Changyong Qi , Rui Jia , Yonghe Wu

This paper introduces a novel perspective to significantly mitigate catastrophic forgetting in continuous learning (CL), which emphasizes models' capacity to preserve existing knowledge and assimilate new information. Current replay-based…

Machine Learning · Computer Science 2024-04-10 Jianshu Zhang , Yankai Fu , Ziheng Peng , Dongyu Yao , Kun He

Dialogue relation extraction (DRE) aims to extract relations between two arguments within a dialogue, which is more challenging than standard RE due to the higher person pronoun frequency and lower information density in dialogues. However,…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Zijie Xu , Ziyu Shang , Jiajun Liu , Ke Ji , Yikai Guo

Continual learning is a promising machine learning paradigm to learn new tasks while retaining previously learned knowledge over streaming training data. Till now, rehearsal-based methods, keeping a small part of data from old tasks as a…

Machine Learning · Computer Science 2023-08-04 Quanziang Wang , Renzhen Wang , Yuexiang Li , Dong Wei , Kai Ma , Yefeng Zheng , Deyu Meng

Continual learning (CL) is crucial for evaluating adaptability in learning solutions to retain knowledge. Our research addresses the challenge of catastrophic forgetting, where models lose proficiency in previously learned tasks as they…

Relation extraction (RE) is an important task that aims to identify the relationships between entities in texts. While large language models (LLMs) have revealed remarkable in-context learning (ICL) capability for general zero and few-shot…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Peng Wang , Jiajun Liu , Yikai Guo , Ke Ji , Ziyu Shang , Zijie Xu

The field of relation extraction (RE) is experiencing a notable shift towards generative relation extraction (GRE), leveraging the capabilities of large language models (LLMs). However, we discovered that traditional relation extraction…

Computation and Language · Computer Science 2024-02-19 Pengcheng Jiang , Jiacheng Lin , Zifeng Wang , Jimeng Sun , Jiawei Han

In natural language, often multiple entities appear in the same text. However, most previous works in Relation Extraction (RE) limit the scope to identifying the relation between two entities at a time. Such an approach induces a quadratic…

Computation and Language · Computer Science 2020-10-13 Zhijing Jin , Yongyi Yang , Xipeng Qiu , Zheng Zhang

For Relation Extraction (RE), the manual annotation of training data may be prohibitively expensive, since the sentences that contain the target relations in texts can be very scarce and difficult to find. It is therefore beneficial to…

Computation and Language · Computer Science 2025-09-11 Zexuan Li , Hongliang Dai , Piji Li

The intrinsic capability to continuously learn a changing data stream is a desideratum of deep neural networks (DNNs). However, current DNNs suffer from catastrophic forgetting, which interferes with remembering past knowledge. To mitigate…

Machine Learning · Computer Science 2026-02-03 Nghia D. Nguyen , Hieu Trung Nguyen , Ang Li , Hoang Pham , Viet Anh Nguyen , Khoa D. Doan

Large language models (LLMs) have demonstrated limitations in handling combinatorial optimization problems involving long-range reasoning, partially due to causal hallucinations and huge search space. As for causal hallucinations, i.e., the…

Artificial Intelligence · Computer Science 2024-10-03 Kangsheng Wang , Xiao Zhang , Hao Liu , Songde Han , Huimin Ma , Tianyu Hu

Relation extraction (RE) aims at extracting the relation between two entities from the text corpora. It is a crucial task for Knowledge Graph (KG) construction. Most existing methods predict the relation between an entity pair by learning…

Computation and Language · Computer Science 2020-11-30 Jun Kuang , Yixin Cao , Jianbing Zheng , Xiangnan He , Ming Gao , Aoying Zhou