English
Related papers

Related papers: Preserving Generalization of Language models in Fe…

200 papers

The primary goal of continual learning (CL) task in medical image segmentation field is to solve the "catastrophic forgetting" problem, where the model totally forgets previously learned features when it is extended to new categories…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Qian Chen , Lei Zhu , Hangzhou He , Xinliang Zhang , Shuang Zeng , Qiushi Ren , Yanye Lu

Recent advancements in Large Language Models (LLMs) have showcased their remarkable capabilities in text understanding and generation. However, even stronger LLMs are susceptible to acquiring erroneous or obsolete information from the…

Computation and Language · Computer Science 2024-02-19 Shiwen Ni , Dingwei Chen , Chengming Li , Xiping Hu , Ruifeng Xu , Min Yang

Open relation extraction (OpenRE) is the task of extracting relation schemes from open-domain corpora. Most existing OpenRE methods either do not fully benefit from high-quality labeled corpora or can not learn semantic representation…

Computation and Language · Computer Science 2022-06-02 Yutong Wang , Renze Lou , Kai Zhang , MaoYan Chen , Yujiu Yang

Current state-of-the-art relation extraction methods typically rely on a set of lexical, syntactic, and semantic features, explicitly computed in a pre-processing step. Training feature extraction models requires additional annotated…

Computation and Language · Computer Science 2019-06-10 Christoph Alt , Marc Hübner , Leonhard Hennig

Recent research in zero-shot Relation Extraction (RE) has focused on using Large Language Models (LLMs) due to their impressive zero-shot capabilities. However, current methods often perform suboptimally, mainly due to a lack of detailed,…

Information Retrieval · Computer Science 2024-12-24 Siyi Liu , Yang Li , Jiang Li , Shan Yang , Yunshi Lan

Unsupervised relation extraction (URE) aims to extract relations between named entities from raw text without requiring manual annotations or pre-existing knowledge bases. In recent studies of URE, researchers put a notable emphasis on…

Computation and Language · Computer Science 2023-12-04 Qing Wang , Kang Zhou , Qiao Qiao , Yuepei Li , Qi Li

Relation extraction (RE) aims to identify relations between entities mentioned in texts. Although large language models (LLMs) have demonstrated impressive in-context learning (ICL) abilities in various tasks, they still suffer from poor…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Peng Wang , Wenjun Ke , Yikai Guo , Ke Ji , Ziyu Shang , Jiajun Liu , Zijie Xu

Large language models (LLMs) face challenges with internal knowledge inaccuracies and outdated information. Knowledge editing has emerged as a pivotal approach to mitigate these issues. Although current knowledge editing techniques exhibit…

Computation and Language · Computer Science 2024-08-23 Mengqi Zhang , Bowen Fang , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen , Liang Wang

Federated Learning (FL) is a novel machine learning approach that allows the model trainer to access more data samples, by training the model across multiple decentralized data sources, while data access constraints are in place. Such…

Computation and Language · Computer Science 2022-11-18 Andre Manoel , Mirian Hipolito Garcia , Tal Baumel , Shize Su , Jialei Chen , Dan Miller , Danny Karmon , Robert Sim , Dimitrios Dimitriadis

Knowledge-based question answering relies on the availability of facts, the majority of which cannot be found in structured sources (e.g. Wikipedia info-boxes, Wikidata). One of the major components of extracting facts from unstructured…

Computation and Language · Computer Science 2018-03-28 Christos Christodoulopoulos , Arpit Mittal

Zero-shot Relation Triplet Extraction (ZeroRTE) aims to extract relation triplets from texts containing unseen relation types. This capability benefits various downstream information retrieval (IR) tasks. The primary challenge lies in…

Computation and Language · Computer Science 2025-04-29 Wanli Li , Tieyun Qian , Yi Song , Zeyu Zhang , Jiawei Li , Zhuang Chen , Lixin Zou

Relation extraction (RE) is an indispensable information extraction task in several disciplines. RE models typically assume that named entity recognition (NER) is already performed in a previous step by another independent model. Several…

Computation and Language · Computer Science 2019-08-29 Tung Tran , Ramakanth Kavuluru

During the past decade, neural networks have become prominent in Natural Language Processing (NLP), notably for their capacity to learn relevant word representations from large unlabeled corpora. These word embeddings can then be…

Computation and Language · Computer Science 2022-06-16 Bruno Taillé

Large Language Models (LLMs) are often English-centric due to the disproportionate distribution of languages in their pre-training data. Enhancing non-English language capabilities through post-pretraining often results in catastrophic…

Computation and Language · Computer Science 2024-08-22 Hao Zhou , Zhijun Wang , Shujian Huang , Xin Huang , Xue Han , Junlan Feng , Chao Deng , Weihua Luo , Jiajun Chen

Modern language models are powerful, but typically static after deployment. A major obstacle to building models that continually learn over time is catastrophic forgetting, where updating on new data erases previously acquired capabilities.…

Computation and Language · Computer Science 2025-10-20 Jessy Lin , Luke Zettlemoyer , Gargi Ghosh , Wen-Tau Yih , Aram Markosyan , Vincent-Pierre Berges , Barlas Oğuz

Document-level relation extraction (DocRE) is a task that focuses on identifying relations between entities within a document. However, existing DocRE models often overlook the correlation between relations and lack a quantitative analysis…

Information Retrieval · Computer Science 2023-10-23 Yusheng Huang , Zhouhan Lin

This paper presents an empirical study to build relation extraction systems in low-resource settings. Based upon recent pre-trained language models, we comprehensively investigate three schemes to evaluate the performance in low-resource…

Computation and Language · Computer Science 2023-09-19 Xin Xu , Xiang Chen , Ningyu Zhang , Xin Xie , Xi Chen , Huajun Chen

Document-level Relation Extraction (DocRE) is the task of extracting all semantic relationships from a document. While studies have been conducted on English DocRE, limited attention has been given to DocRE in non-English languages. This…

Computation and Language · Computer Science 2024-04-26 Youmi Ma , An Wang , Naoaki Okazaki

Few-shot learning presents a challenge that a classifier must quickly adapt to new classes that do not appear in the training set, given only a few labeled examples of each new class. This paper proposes a position-aware relation network…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Ziyang Wu , Yuwei Li , Lihua Guo , Kui Jia

Self-Explainable Models (SEMs) rely on Prototypical Concept Learning (PCL) to enable their visual recognition processes more interpretable, but they often struggle in data-scarce settings where insufficient training samples lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Zhong Ji , Rongshuai Wei , Jingren Liu , Yanwei Pang , Jungong Han