English
Related papers

Related papers: Preserving Generalization of Language models in Fe…

200 papers

Knowledge graphs (KGs) serve as useful resources for various natural language processing applications. Previous KG completion approaches require a large number of training instances (i.e., head-tail entity pairs) for every relation. The…

Computation and Language · Computer Science 2019-11-27 Chuxu Zhang , Huaxiu Yao , Chao Huang , Meng Jiang , Zhenhui Li , Nitesh V. Chawla

Depicting novel classes with language descriptions by observing few-shot samples is inherent in human-learning systems. This lifelong learning capability helps to distinguish new knowledge from old ones through the increase of open-world…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Yifan Zhao , Jia Li , Zeyin Song , Yonghong Tian

Information Extraction (IE) is crucial for converting unstructured data into structured formats like Knowledge Graphs (KGs). A key task within IE is Relation Extraction (RE), which identifies relationships between entities in text. Various…

Computation and Language · Computer Science 2024-06-25 Sefika Efeoglu , Adrian Paschke

The intrinsic capability to continuously learn a changing data stream is a desideratum of deep neural networks (DNNs). However, current DNNs suffer from catastrophic forgetting, which interferes with remembering past knowledge. To mitigate…

Machine Learning · Computer Science 2026-02-03 Nghia D. Nguyen , Hieu Trung Nguyen , Ang Li , Hoang Pham , Viet Anh Nguyen , Khoa D. Doan

It is an important yet challenging setting to continually learn new tasks from a few examples. Although numerous efforts have been devoted to either continual learning or few-shot learning, little work has considered this new setting of…

Machine Learning · Computer Science 2021-04-20 Liyuan Wang , Qian Li , Yi Zhong , Jun Zhu

Few-shot continual learning (FSCL) has attracted intensive attention and achieved some advances in recent years, but now it is difficult to again make a big stride in accuracy due to the limitation of only few-shot incremental samples.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Ziqi Gu , Chunyan Xu , Zihan Lu , Xin Liu , Anbo Dai , Zhen Cui

Scaling language models have revolutionized widespread NLP tasks, yet little comprehensively explored few-shot relation extraction with large language models. In this paper, we investigate principal methodologies, in-context learning and…

Computation and Language · Computer Science 2023-06-12 Xin Xu , Yuqi Zhu , Xiaohan Wang , Ningyu Zhang

We present a Few-Shot Relation Classification Dataset (FewRel), consisting of 70, 000 sentences on 100 relations derived from Wikipedia and annotated by crowdworkers. The relation of each sentence is first recognized by distant supervision…

Machine Learning · Computer Science 2018-10-30 Xu Han , Hao Zhu , Pengfei Yu , Ziyun Wang , Yuan Yao , Zhiyuan Liu , Maosong Sun

Few-shot learning has been proposed and rapidly emerging as a viable means for completing various tasks. Many few-shot models have been widely used for relation learning tasks. However, each of these models has a shortage of capturing a…

Computation and Language · Computer Science 2021-05-26 Qing Lin , Yongbin Liu , Wen Wen , Zhihua Tao

Although having achieved great success in medical image segmentation, deep convolutional neural networks usually require a large dataset with manual annotations for training and are difficult to generalize to unseen classes. Few-shot…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Hao Tang , Xingwei Liu , Shanlin Sun , Xiangyi Yan , Xiaohui Xie

Distant Supervised Relation Extraction (DSRE) is usually formulated as a problem of classifying a bag of sentences that contain two query entities, into the predefined relation classes. Most existing methods consider those relation classes…

Computation and Language · Computer Science 2019-12-16 Yanjie Gou , Yinjie Lei , Lingqiao Liu , Pingping Zhang , Xi Peng

Relation extraction (RE), which has relied on structurally annotated corpora for model training, has been particularly challenging in low-resource scenarios and domains. Recent literature has tackled low-resource RE by self-supervised…

Computation and Language · Computer Science 2023-06-01 Wenxuan Zhou , Sheng Zhang , Tristan Naumann , Muhao Chen , Hoifung Poon

Few-shot tabular learning, in which machine learning models are trained with a limited amount of labeled data, provides a cost-effective approach to addressing real-world challenges. The advent of Large Language Models (LLMs) has sparked…

Machine Learning · Computer Science 2025-05-09 Ruxue Shi , Hengrui Gu , Hangting Ye , Yiwei Dai , Xu Shen , Xin Wang

Multimodal relation extraction (MRE) is the task of identifying the semantic relationships between two entities based on the context of the sentence image pair. Existing retrieval-augmented approaches mainly focused on modeling the…

Computation and Language · Computer Science 2023-05-26 Xuming Hu , Zhijiang Guo , Zhiyang Teng , Irwin King , Philip S. Yu

Analysing the generalisation capabilities of relation extraction (RE) models is crucial for assessing whether they learn robust relational patterns or rely on spurious correlations. Our cross-dataset experiments find that RE models struggle…

Computation and Language · Computer Science 2025-12-16 Varvara Arzt , Allan Hanbury , Michael Wiegand , Gábor Recski , Terra Blevins

Continual learning is a promising machine learning paradigm to learn new tasks while retaining previously learned knowledge over streaming training data. Till now, rehearsal-based methods, keeping a small part of data from old tasks as a…

Machine Learning · Computer Science 2023-08-04 Quanziang Wang , Renzhen Wang , Yuexiang Li , Dong Wei , Kai Ma , Yefeng Zheng , Deyu Meng

For Relation Extraction (RE), the manual annotation of training data may be prohibitively expensive, since the sentences that contain the target relations in texts can be very scarce and difficult to find. It is therefore beneficial to…

Computation and Language · Computer Science 2025-09-11 Zexuan Li , Hongliang Dai , Piji Li

Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks. In order to alleviate this critical problem…

Information Retrieval · Computer Science 2022-10-11 Chengwei Hu , Deqing Yang , Haoliang Jin , Zhen Chen , Yanghua Xiao

This comprehensive survey delves into the latest advancements in Relation Extraction (RE), a pivotal task in natural language processing essential for applications across biomedical, financial, and legal sectors. This study highlights the…

Computation and Language · Computer Science 2025-07-03 Jose A. Diaz-Garcia , Julio Amador Diaz Lopez

Compositional embedding models build a representation (or embedding) for a linguistic structure based on its component word embeddings. We propose a Feature-rich Compositional Embedding Model (FCM) for relation extraction that is…

Computation and Language · Computer Science 2015-09-16 Matthew R. Gormley , Mo Yu , Mark Dredze