English
Related papers

Related papers: Representation Learning for Weakly Supervised Rela…

200 papers

Due to the semantic complexity of the Relation extraction (RE) task, obtaining high-quality human labelled data is an expensive and noisy process. To improve the sample efficiency of the models, semi-supervised learning (SSL) methods aim to…

Computation and Language · Computer Science 2023-06-21 Komal K. Teru

We explore methods to extract relations between named entities from free text in an unsupervised setting. In addition to standard feature extraction, we develop a novel method to re-weight word embeddings. We alleviate the problem of…

Computation and Language · Computer Science 2018-01-23 Hady Elsahar , Elena Demidova , Simon Gottschalk , Christophe Gravier , Frederique Laforest

A principal barrier to training temporal relation extraction models in new domains is the lack of varied, high quality examples and the challenge of collecting more. We present a method of automatically collecting distantly-supervised…

Computation and Language · Computer Science 2021-09-16 Xinyu Zhao , Shih-ting Lin , Greg Durrett

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

Learning robust representations that allow to reliably establish relations between images is of paramount importance for virtually all of computer vision. Annotating the quadratic number of pairwise relations between training images is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Timo Milbich , Omair Ghori , Ferran Diego , Björn Ommer

Training models on low-resource named entity recognition tasks has been shown to be a challenge, especially in industrial applications where deploying updated models is a continuous effort and crucial for business operations. In such cases…

Computation and Language · Computer Science 2019-10-18 Peter Izsak , Shira Guskin , Moshe Wasserblat

Open relation extraction is the task of extracting open-domain relation facts from natural language sentences. Existing works either utilize heuristics or distant-supervised annotations to train a supervised classifier over pre-defined…

Computation and Language · Computer Science 2020-10-07 Xuming Hu , Chenwei Zhang , Yusong Xu , Lijie Wen , Philip S. Yu

Existing methods in relation extraction have leveraged the lexical features in the word sequence and the syntactic features in the parse tree. Though effective, the lexical features extracted from the successive word sequence may introduce…

Computation and Language · Computer Science 2021-07-29 Mi Zhang , Tieyun Qian

Capabilities of detecting temporal relations between two events can benefit many applications. Most of existing temporal relation classifiers were trained in a supervised manner. Instead, we explore the observation that regular event pairs…

Computation and Language · Computer Science 2017-08-01 Wenlin Yao , Saipravallika Nettyam , Ruihong Huang

This thesis focuses on representation learning for sequence data over time or space, aiming to improve downstream sequence prediction tasks by using the learned representations. Supervised learning has been the most dominant approach for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-02 Qingming Tang

Semi-supervised learning is an important and active topic of research in pattern recognition. For classification using linear discriminant analysis specifically, several semi-supervised variants have been proposed. Using any one of these…

Machine Learning · Statistics 2014-11-18 Jesse H. Krijthe , Marco Loog

Recent research put a big effort in the development of deep learning architectures and optimizers obtaining impressive results in areas ranging from vision to language processing. However little attention has been addressed to the need of a…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Gabriele Valvano , Andrea Leo , Daniele Della Latta , Nicola Martini , Gianmarco Santini , Dante Chiappino , Emiliano Ricciardi

In self-supervised learning, a model is trained to solve a pretext task, using a data set whose annotations are created by a machine. The objective is to transfer the trained weights to perform a downstream task in the target domain. We…

Machine Learning · Computer Science 2021-10-22 Prathamesh Sonawane , Sparsh Drolia , Saqib Shamsi , Bhargav Jain

We present a technique to improve the transferability of deep representations learned on small labeled datasets by introducing self-supervised tasks as auxiliary loss functions. While recent approaches for self-supervised learning have…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Jong-Chyi Su , Subhransu Maji , Bharath Hariharan

Aggregated data obtained from job postings provide powerful insights into labor market demands, and emerging skills, and aid job matching. However, most extraction approaches are supervised and thus need costly and time-consuming…

Computation and Language · Computer Science 2022-09-19 Mike Zhang , Kristian Nørgaard Jensen , Rob van der Goot , Barbara Plank

Learning good representations without supervision is still an open issue in machine learning, and is particularly challenging for speech signals, which are often characterized by long sequences with a complex hierarchical structure. Some…

Machine Learning · Computer Science 2019-04-09 Santiago Pascual , Mirco Ravanelli , Joan Serrà , Antonio Bonafonte , Yoshua Bengio

Many real world systems need to operate on heterogeneous information networks that consist of numerous interacting components of different types. Examples include systems that perform data analysis on biological information networks; social…

Artificial Intelligence · Computer Science 2017-07-26 Parisa Kordjamshidi , Sameer Singh , Daniel Khashabi , Christos Christodoulopoulos , Mark Summons , Saurabh Sinha , Dan Roth

Self-supervised learning offers an efficient way of extracting rich representations from various types of unlabeled data while avoiding the cost of annotating large-scale datasets. This is achievable by designing a pretext task to form…

Machine Learning · Computer Science 2023-10-11 Pouya Mehralian , Bagher BabaAli , Ashena Gorgan Mohammadi

Knowledge-enhanced pre-trained models for language representation have been shown to be more effective in knowledge base construction tasks (i.e.,~relation extraction) than language models such as BERT. These knowledge-enhanced language…

Computation and Language · Computer Science 2022-10-25 Jiacheng Li , Yannis Katsis , Tyler Baldwin , Ho-Cheol Kim , Andrew Bartko , Julian McAuley , Chun-Nan Hsu

To alleviate human efforts from obtaining large-scale annotations, Semi-Supervised Relation Extraction methods aim to leverage unlabeled data in addition to learning from limited samples. Existing self-training methods suffer from the…

Computation and Language · Computer Science 2021-09-13 Xuming Hu , Chenwei Zhang , Fukun Ma , Chenyao Liu , Lijie Wen , Philip S. Yu