English
Related papers

Related papers: Efficient Information Extraction in Few-Shot Relat…

200 papers

Unsupervised sentence representation learning is one of the fundamental problems in natural language processing with various downstream applications. Recently, contrastive learning has been widely adopted which derives high-quality sentence…

Computation and Language · Computer Science 2023-05-29 Jiduan Liu , Jiahao Liu , Qifan Wang , Jingang Wang , Wei Wu , Yunsen Xian , Dongyan Zhao , Kai Chen , Rui Yan

Relation Extraction (RE) is a pivotal task in automatically extracting structured information from unstructured text. In this paper, we present a multi-faceted approach that integrates representative examples and through co-set expansion.…

Computation and Language · Computer Science 2023-08-24 Yerong Li , Roxana Girju

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

Machine Learning · Computer Science 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

In machine learning applications, gradual data ingress is common, especially in audio processing where incremental learning is vital for real-time analytics. Few-shot class-incremental learning addresses challenges arising from limited…

Sound · Computer Science 2024-08-08 Riyansha Singh , Parinita Nema , Vinod K Kurmi

In this study, a novel method for extracting named entities and relations from unstructured text based on the table representation is presented. By using contextualized word embeddings, the proposed method computes representations for…

Computation and Language · Computer Science 2022-01-28 Youmi Ma , Tatsuya Hiraoka , Naoaki Okazaki

Contrastive learning is a discriminative approach that aims at grouping similar samples closer and diverse samples far from each other. It it an efficient technique to train an encoder generating distinguishable and informative…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Qing Chen , Jian Zhang

Contrastive learning between different views of the data achieves outstanding success in the field of self-supervised representation learning and the learned representations are useful in broad downstream tasks. Since all supervision…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Haoqing Wang , Xun Guo , Zhi-Hong Deng , Yan Lu

Few-shot text classification has recently been promoted by the meta-learning paradigm which aims to identify target classes with knowledge transferred from source classes with sets of small tasks named episodes. Despite their success,…

Computation and Language · Computer Science 2023-05-17 Junfan Chen , Richong Zhang , Yongyi Mao , Jie Xu

Few-shot Continual Relation Extraction is a crucial challenge for enabling AI systems to identify and adapt to evolving relationships in dynamic real-world domains. Traditional memory-based approaches often overfit to limited samples,…

Computation and Language · Computer Science 2025-03-03 Nguyen Xuan Thanh , Anh Duc Le , Quyen Tran , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

To disclose overlapped multiple relations from a sentence still keeps challenging. Most current works in terms of neural models inconveniently assuming that each sentence is explicitly mapped to a relation label, cannot handle multiple…

Computation and Language · Computer Science 2018-11-13 Xinsong Zhang , Pengshuai Li , Weijia Jia , Hai Zhao

Contrastive learning has been extensively studied in sentence embedding learning, which assumes that the embeddings of different views of the same sentence are closer. The constraint brought by this assumption is weak, and a good sentence…

Computation and Language · Computer Science 2022-10-17 Xing Wu , Chaochen Gao , Zijia Lin , Jizhong Han , Zhongyuan Wang , Songlin Hu

Fine-tuning a pre-trained language model via the contrastive learning framework with a large amount of unlabeled sentences or labeled sentence pairs is a common way to obtain high-quality sentence representations. Although the contrastive…

Computation and Language · Computer Science 2022-11-01 Tianduo Wang , Wei Lu

This paper presents miCSE, a mutual information-based contrastive learning framework that significantly advances the state-of-the-art in few-shot sentence embedding. The proposed approach imposes alignment between the attention pattern of…

Computation and Language · Computer Science 2023-05-24 Tassilo Klein , Moin Nabi

Contrastive learning has been used to learn a high-quality representation of the image in computer vision. However, contrastive learning is not widely utilized in natural language processing due to the lack of a general method of data…

Computation and Language · Computer Science 2021-04-29 Peng Su , Yifan Peng , K. Vijay-Shanker

Few-Shot learning aims to train and optimize a model that can adapt to unseen visual classes with only a few labeled examples. The existing few-shot learning (FSL) methods, heavily rely only on visual data, thus fail to capture the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Mohamed Afham , Ranga Rodrigo

This paper presents several strategies to automatically obtain additional examples for in-context learning of one-shot relation extraction. Specifically, we introduce a novel strategy for example selection, in which new examples are…

Computation and Language · Computer Science 2026-01-29 Aunabil Chakma , Mihai Surdeanu , Eduardo Blanco

Short text classification, as a research subtopic in natural language processing, is more challenging due to its semantic sparsity and insufficient labeled samples in practical scenarios. We propose a novel model named MI-DELIGHT for short…

Computation and Language · Computer Science 2025-01-17 Yonghao Liu , Mengyu Li , Wei Pang , Fausto Giunchiglia , Lan Huang , Xiaoyue Feng , Renchu Guan

We propose a lightly-supervised approach for information extraction, in particular named entity classification, which combines the benefits of traditional bootstrapping, i.e., use of limited annotations and interpretability of extraction…

Computation and Language · Computer Science 2018-05-30 Marco A. Valenzuela-Escárcega , Ajay Nagesh , Mihai Surdeanu

Extracting entities and relations is an essential task of information extraction. Triplets extracted from a sentence might overlap with each other. Previous methods either did not address the overlapping issues or solved overlapping issues…

Computation and Language · Computer Science 2023-04-07 Hao Zhang

Automatic extraction of medical information from clinical documents poses several challenges: high costs of required clinical expertise, limited interpretability of model predictions, restricted computational resources and privacy…