English
Related papers

Related papers: Improving Long-Tail Relation Extraction with Colla…

200 papers

Learning from noisy labels is an important and long-standing problem in machine learning for real applications. One of the main research lines focuses on learning a label corrector to purify potential noisy labels. However, these methods…

Machine Learning · Computer Science 2023-12-05 Jian Chen , Ruiyi Zhang , Tong Yu , Rohan Sharma , Zhiqiang Xu , Tong Sun , Changyou Chen

This paper presents an empirical study to build relation extraction systems in low-resource settings. Based upon recent pre-trained language models, we comprehensively investigate three schemes to evaluate the performance in low-resource…

Computation and Language · Computer Science 2023-09-19 Xin Xu , Xiang Chen , Ningyu Zhang , Xin Xie , Xi Chen , Huajun Chen

The clustering-based unsupervised relation discovery method has gradually become one of the important methods of open relation extraction (OpenRE). However, high-dimensional vectors can encode complex linguistic information which leads to…

Computation and Language · Computer Science 2021-09-16 Jun Zhao , Tao Gui , Qi Zhang , Yaqian Zhou

Relation extraction (RE) aims at extracting the relation between two entities from the text corpora. It is a crucial task for Knowledge Graph (KG) construction. Most existing methods predict the relation between an entity pair by learning…

Computation and Language · Computer Science 2020-11-30 Jun Kuang , Yixin Cao , Jianbing Zheng , Xiangnan He , Ming Gao , Aoying Zhou

Connections between relations in relation extraction, which we call class ties, are common. In distantly supervised scenario, one entity tuple may have multiple relation facts. Exploiting class ties between relations of one entity tuple…

Artificial Intelligence · Computer Science 2017-08-08 Hai Ye , Wenhan Chao , Zhunchen Luo , Zhoujun Li

Distant supervision (DS) has been widely used to automatically construct (noisy) labeled data for relation extraction (RE). Given two entities, distant supervision exploits sentences that directly mention them for predicting their semantic…

Computation and Language · Computer Science 2020-06-29 Xiang Deng , Huan Sun

Class imbalance problems frequently occur in real-world tasks, and conventional deep learning algorithms are well known for performance degradation on imbalanced training datasets. To mitigate this problem, many approaches have aimed to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Sumyeong Ahn , Jongwoo Ko , Se-Young Yun

Document-level relation extraction (DocRE) predicts relations for entity pairs that rely on long-range context-dependent reasoning in a document. As a typical multi-label classification problem, DocRE faces the challenge of effectively…

Computation and Language · Computer Science 2023-04-04 Jia Guo , Stanley Kok , Lidong Bing

Recent neural models for relation extraction with distant supervision alleviate the impact of irrelevant sentences in a bag by learning importance weights for the sentences. Efforts thus far have focused on improving extraction accuracy but…

Information Retrieval · Computer Science 2020-06-01 Hamed Shahbazi , Xiaoli Z. Fern , Reza Ghaeini , Prasad Tadepalli

Although contrastive learning methods have shown prevailing performance on a variety of representation learning tasks, they encounter difficulty when the training dataset is long-tailed. Many researchers have combined contrastive learning…

Machine Learning · Computer Science 2023-08-09 Min-Kook Suh , Seung-Woo Seo

In real-world scenarios, where knowledge distributions exhibit long-tail. Humans manage to master knowledge uniformly across imbalanced distributions, a feat attributed to their diligent practices of reviewing, summarizing, and correcting…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Qihao Zhao , Yalun Dai , Shen Lin , Wei Hu , Fan Zhang , Jun Liu

Retrieval-Augmented Generation (RAG) has become a powerful paradigm for enhancing large language models (LLMs) through external knowledge retrieval. Despite its widespread attention, existing academic research predominantly focuses on…

Information Retrieval · Computer Science 2024-10-31 Yiruo Cheng , Kelong Mao , Ziliang Zhao , Guanting Dong , Hongjin Qian , Yongkang Wu , Tetsuya Sakai , Ji-Rong Wen , Zhicheng Dou

Since large language models (LLMs) have a tendency to generate factually inaccurate output, retrieval-augmented generation (RAG) has gained significant attention as a key means to mitigate this downside of harnessing only LLMs. However,…

Computation and Language · Computer Science 2025-12-18 Youmin Ko , Sungjong Seo , Hyunjoon Kim

Recognizing images with long-tailed distributions remains a challenging problem while there lacks an interpretable mechanism to solve this problem. In this study, we formulate Long-tailed recognition as Domain Adaption (LDA), by modeling…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Zhiliang Peng , Wei Huang , Zonghao Guo , Xiaosong Zhang , Jianbin Jiao , Qixiang Ye

The strong zero-shot and long-context capabilities of recent Large Language Models (LLMs) have paved the way for highly effective re-ranking systems. Attention-based re-rankers leverage attention weights from transformer heads to produce…

Information Retrieval · Computer Science 2026-03-04 Linh Tran , Yulong Li , Radu Florian , Wei Sun

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs), especially for knowledge-intensive tasks. Despite its advantages, current RAG methods often struggle to fully exploit knowledge during generation. In particular,…

Computation and Language · Computer Science 2025-10-10 Yi Jiang , Sendong Zhao , Jianbo Li , Haochun Wang , Lizhe Zhang , Yan Liu , Bing Qin

Retrieval-Augmented Generation (RAG) models excel in knowledge-intensive tasks, especially under few-shot learning constraints. We introduce CoRAG, a framework extending RAG to collaborative settings, where clients jointly train a shared…

Artificial Intelligence · Computer Science 2025-04-03 Aashiq Muhamed , Mona Diab , Virginia Smith

Distantly supervision automatically generates plenty of training samples for relation extraction. However, it also incurs two major problems: noisy labels and imbalanced training data. Previous works focus more on reducing wrongly labeled…

Computation and Language · Computer Science 2021-05-24 Chenhao Xie , Jiaqing Liang , Jingping Liu , Chengsong Huang , Wenhao Huang , Yanghua Xiao

Distant supervised relation extraction has been successfully applied to large corpus with thousands of relations. However, the inevitable wrong labeling problem by distant supervision will hurt the performance of relation extraction. In…

Computation and Language · Computer Science 2018-11-15 Shanchan Wu , Kai Fan , Qiong Zhang

Fine-tuning is the primary methodology for tailoring pre-trained large language models to specific tasks. As the model's scale and the diversity of tasks expand, parameter-efficient fine-tuning methods are of paramount importance. One of…

Machine Learning · Computer Science 2024-01-10 Wenhan Xia , Chengwei Qin , Elad Hazan