English
Related papers

Related papers: Empower Distantly Supervised Relation Extraction w…

200 papers

Adversarial training (AT) as a regularization method has proved its effectiveness in various tasks, such as image classification and text classification. Though there are successful applications of AT in many tasks of natural language…

Computation and Language · Computer Science 2019-11-12 Ziqing Yang , Yiming Cui , Wanxiang Che , Ting Liu , Shijin Wang , Guoping Hu

Distant supervision for relation extraction provides uniform bag labels for each sentence inside the bag, while accurate sentence labels are important for downstream applications that need the exact relation type. Directly using bag labels…

Computation and Language · Computer Science 2021-06-23 Ruotian Ma , Tao Gui , Linyang Li , Qi Zhang , Yaqian Zhou , Xuanjing Huang

Adversarial training is one effective approach for training robust deep neural networks against adversarial attacks. While being able to bring reliable robustness, adversarial training (AT) methods in general favor high capacity models,…

Cryptography and Security · Computer Science 2021-08-19 Bojia Zi , Shihao Zhao , Xingjun Ma , Yu-Gang Jiang

Contrastive pre-training on distant supervision has shown remarkable effectiveness in improving supervised relation extraction tasks. However, the existing methods ignore the intrinsic noise of distant supervision during the pre-training…

Computation and Language · Computer Science 2023-02-13 Zhen Wan , Fei Cheng , Qianying Liu , Zhuoyuan Mao , Haiyue Song , Sadao Kurohashi

Distant supervision has become the standard method for relation extraction. However, even though it is an efficient method, it does not come at no cost---The resulted distantly-supervised training samples are often very noisy. To combat the…

Computation and Language · Computer Science 2018-05-28 Pengda Qin , Weiran Xu , William Yang Wang

To alleviate human efforts from obtaining large-scale annotations, Semi-Supervised Relation Extraction methods aim to leverage unlabeled data in addition to learning from limited samples. Existing self-training methods suffer from the…

Computation and Language · Computer Science 2021-09-13 Xuming Hu , Chenwei Zhang , Fukun Ma , Chenyao Liu , Lijie Wen , Philip S. Yu

In this paper, we propose a semi-supervised learning (SSL) technique for training deep neural networks (DNNs) to generate speaker-discriminative acoustic embeddings (speaker embeddings). Obtaining large amounts of speaker recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Florian L. Kreyssig , Philip C. Woodland

Attention mechanisms are often used in deep neural networks for distantly supervised relation extraction (DS-RE) to distinguish valid from noisy instances. However, traditional 1-D vector attention models are insufficient for the learning…

Computation and Language · Computer Science 2018-09-05 Jinhua Du , Jingguang Han , Andy Way , Dadong Wan

Relation extraction (RE) plays an important role in extracting knowledge from unstructured text but requires a large amount of labeled corpus. To reduce the expensive annotation efforts, semisupervised learning aims to leverage both labeled…

Computation and Language · Computer Science 2021-03-16 Yusen Lin

Distant supervision can effectively label data for relation extraction, but suffers from the noise labeling problem. Recent works mainly perform soft bag-level noise reduction strategies to find the relatively better samples in a sentence…

Computation and Language · Computer Science 2018-05-28 Pengda Qin , Weiran Xu , William Yang Wang

Current deep neural networks (DNNs) are vulnerable to adversarial attacks, where adversarial perturbations to the inputs can change or manipulate classification. To defend against such attacks, an effective and popular approach, known as…

Machine Learning · Computer Science 2022-09-08 Gaoyuan Zhang , Songtao Lu , Yihua Zhang , Xiangyi Chen , Pin-Yu Chen , Quanfu Fan , Lee Martie , Lior Horesh , Mingyi Hong , Sijia Liu

Relation extraction aims to extract relational facts from sentences. Previous models mainly rely on manually labeled datasets, seed instances or human-crafted patterns, and distant supervision. However, the human annotation is expensive,…

Machine Learning · Computer Science 2019-08-23 Ningyu Zhang , Shumin Deng , Zhanlin Sun , Jiaoyan Chen , Wei Zhang , Huajun Chen

Semi-supervised learning (SSL) partially circumvents the high cost of labeling data by augmenting a small labeled dataset with a large and relatively cheap unlabeled dataset drawn from the same distribution. This paper offers a novel…

Machine Learning · Computer Science 2017-12-13 Saki Shinoda , Daniel E. Worrall , Gabriel J. Brostow

Learning robust models under adversarial settings is widely recognized as requiring a considerably large number of training samples. Recent work proposes semi-supervised adversarial training (SSAT), which utilizes external unlabeled or…

Machine Learning · Computer Science 2026-03-10 Somrita Ghosh , Yuelin Xu , Xiao Zhang

To ensure that the data collected from human subjects is entrusted with a secret, rival labels are introduced to conceal the information provided by the participants on purpose. The corresponding learning task can be formulated as a noisy…

Machine Learning · Computer Science 2023-04-04 Cheng Chen , Yueming Lyu , Ivor W. Tsang

Distant supervision leverages knowledge bases to automatically label instances, thus allowing us to train relation extractor without human annotations. However, the generated training data typically contain massive noise, and may result in…

Computation and Language · Computer Science 2018-12-31 Yujin Yuan , Liyuan Liu , Siliang Tang , Zhongfei Zhang , Yueting Zhuang , Shiliang Pu , Fei Wu , Xiang Ren

Traditional supervised learning tasks require a label for every instance in the training set, but in many real-world applications, labels are only available for collections (bags) of instances. This problem setting, known as multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Georg Wölflein , Lucie Charlotte Magister , Pietro Liò , David J. Harrison , Ognjen Arandjelović

Distantly-supervised relation extraction (RE) is an effective method to scale RE to large corpora but suffers from noisy labels. Existing approaches try to alleviate noise through multi-instance learning and by providing additional…

Computation and Language · Computer Science 2021-02-03 Despina Christou , Grigorios Tsoumakas

Lack of labeled data is a main obstacle in relation extraction. Semi-supervised relation extraction (SSRE) has been proven to be a promising way for this problem through annotating unlabeled samples as additional training data. Almost all…

Computation and Language · Computer Science 2021-12-03 Wanli Li , Tieyun Qian

Relation extraction is an important task in structuring content of text data, and becomes especially challenging when learning with weak supervision---where only a limited number of labeled sentences are given and a large number of…

Computation and Language · Computer Science 2019-02-26 Hongtao Lin , Jun Yan , Meng Qu , Xiang Ren