中文
相关论文

相关论文: Preserving Generalization of Language models in Fe…

200 篇论文

Few-shot learning (FSL) is an emergent paradigm of learning that attempts to learn to reason with low sample complexity to mimic the way humans learn, generalise and extrapolate from only a few seen examples. While FSL attempts to mimic…

机器学习 · 计算机科学 2023-12-08 Jaron Mar , Jiamou Liu

Recent years have seen rapid development in Information Extraction, as well as its subtask, Relation Extraction. Relation Extraction is able to detect semantic relations between entities in sentences. Currently, many efficient approaches…

计算与语言 · 计算机科学 2024-03-19 Zhuang Li

We introduce CogRE, a novel framework for relation extraction (RE), enhancing RE from both accuracy and explainability. The framework has two key components: (i) a reasoning mechanism that formulates relation extraction as a series of…

计算与语言 · 计算机科学 2026-02-17 Xinyu Guo , Zhengliang Shi , Minglai Yang , Mahdi Rahimi , Mihai Surdeanu

Few-shot classification is a challenging problem due to the uncertainty caused by using few labelled samples. In the past few years, many methods have been proposed with the common aim of transferring knowledge acquired on a previously…

机器学习 · 计算机科学 2021-10-19 Yuqing Hu , Vincent Gripon , Stéphane Pateux

Large Language Models (LLMs) have shown impressive capabilities, yet updating their knowledge remains a significant challenge, often leading to outdated or inaccurate responses. A proposed solution is the integration of external knowledge…

计算与语言 · 计算机科学 2025-07-16 Dehao Tao , Congqi Wang , Feng Huang , Junhao Chen , Yongfeng Huang , Minghu Jiang

As new knowledge rapidly accumulates, language models (LMs) with pretrained knowledge quickly become obsolete. A common approach to updating LMs is fine-tuning them directly on new knowledge. However, recent studies have shown that…

计算与语言 · 计算机科学 2025-02-28 Howard Chen , Jiayi Geng , Adithya Bhaskar , Dan Friedman , Danqi Chen

Relation extraction (RE) seeks to detect and classify semantic relationships between entities, which provides useful information for many NLP applications. Since the state-of-the-art RE models require large amounts of manually annotated…

计算与语言 · 计算机科学 2019-11-13 Jian Ni , Radu Florian

While state-of-the-art models that rely upon massively multilingual pretrained encoders achieve sample efficiency in downstream applications, they still require abundant amounts of unlabelled text. Nevertheless, most of the world's…

计算与语言 · 计算机科学 2024-02-16 Yaoyiran Li , Edoardo M. Ponti , Ivan Vulić , Anna Korhonen

The goal of few-shot learning is to learn a model that can recognize novel classes based on one or few training data. It is challenging mainly due to two aspects: (1) it lacks good feature representation of novel classes; (2) a few of…

计算机视觉与模式识别 · 计算机科学 2020-03-11 Canyu Le , Zhonggui Chen , Xihan Wei , Biao Wang , Lei Zhang

Distantly Supervised Relation Extraction (DSRE) remains a long-standing challenge in NLP, where models must learn from noisy bag-level annotations while making sentence-level predictions. While existing state-of-the-art (SoTA) DSRE models…

计算与语言 · 计算机科学 2025-10-22 Vipul Rathore , Malik Hammad Faisal , Parag Singla , Mausam

Existing research on multimodal relation extraction (MRE) faces two co-existing challenges, internal-information over-utilization and external-information under-exploitation. To combat that, we propose a novel framework that simultaneously…

计算机视觉与模式识别 · 计算机科学 2023-05-26 Shengqiong Wu , Hao Fei , Yixin Cao , Lidong Bing , Tat-Seng Chua

Few-shot relation classification seeks to classify incoming query instances after meeting only few support instances. This ability is gained by training with large amount of in-domain annotated data. In this paper, we tackle an even harder…

计算与语言 · 计算机科学 2020-12-15 Xiaoqing Geng , Xiwen Chen , Kenny Q. Zhu , Libin Shen , Yinggong Zhao

Recently, large language models (LLMs) have been successful in relational extraction (RE) tasks, especially in the few-shot learning. An important problem in the field of RE is long-tailed data, while not much attention is paid to this…

计算与语言 · 计算机科学 2024-12-23 Xuemei Tang , Jun Wang

Knowledge graphs (KGs) have been successfully applied to the analysis of complex scientific and technological domains, with automatic KG generation methods typically building upon relation extraction models capturing fine-grained relations…

计算与语言 · 计算机科学 2025-10-15 Vanni Zavarella , Juan Carlos Gamero-Salinas , Sergio Consoli

Few-shot learning refers to understanding new concepts from only a few examples. We propose an information retrieval-inspired approach for this problem that is motivated by the increased importance of maximally leveraging all the available…

机器学习 · 计算机科学 2017-11-15 Eleni Triantafillou , Richard Zemel , Raquel Urtasun

Current language models are unable to quickly learn new concepts on the fly, often requiring a more involved finetuning process to learn robustly. Prompting in-context is not robust to context distractions, and often fails to confer much…

计算与语言 · 计算机科学 2024-10-18 Ryan Teehan , Brenden Lake , Mengye Ren

Relation Extraction (RE) is a vital step to complete Knowledge Graph (KG) by extracting entity relations from texts.However, it usually suffers from the long-tail issue. The training data mainly concentrates on a few types of relations,…

计算与语言 · 计算机科学 2020-11-30 Yixin Cao , Jun Kuang , Ming Gao , Aoying Zhou , Yonggang Wen , Tat-Seng Chua

Relation extraction (RE) is a fundamental task in information extraction, whose extension to multilingual settings has been hindered by the lack of supervised resources comparable in size to large English datasets such as TACRED (Zhang et…

计算与语言 · 计算机科学 2023-05-16 Leonhard Hennig , Philippe Thomas , Sebastian Möller

Concerned with user data privacy, this paper presents a new federated learning (FL) method that trains machine learning models on edge devices without accessing sensitive data. Traditional FL methods, although privacy-protective, fail to…

分布式、并行与集群计算 · 计算机科学 2023-10-03 Duy Phuong Nguyen , Sixing Yu , J. Pablo Muñoz , Ali Jannesari

Despite the huge and continuous advances in computational linguistics, the lack of annotated data for Named Entity Recognition (NER) is still a challenging issue, especially in low-resource languages and when domain knowledge is required…

计算与语言 · 计算机科学 2021-11-25 Valerio La Gatta , Vincenzo Moscato , Marco Postiglione , Giancarlo Sperlì