English
Related papers

Related papers: HiURE: Hierarchical Exemplar Contrastive Learning …

200 papers

Contrastive learning has been the dominant approach to train state-of-the-art sentence embeddings. Previous studies have typically learned sentence embeddings either through the use of human-annotated natural language inference (NLI) data…

Computation and Language · Computer Science 2023-10-25 Junlei Zhang , Zhenzhong Lan , Junxian He

Existing self-supervised methods in natural language processing (NLP), especially hierarchical text classification (HTC), mainly focus on self-supervised contrastive learning, extremely relying on human-designed augmentation rules to…

Computation and Language · Computer Science 2024-03-27 He Zhu , Junran Wu , Ruomei Liu , Yue Hou , Ze Yuan , Shangzhe Li , Yicheng Pan , Ke Xu

Open Relation Extraction (OpenRE) seeks to identify and extract novel relational facts between named entities from unlabeled data without pre-defined relation schemas. Traditional OpenRE methods typically assume that the unlabeled data…

Computation and Language · Computer Science 2025-05-30 Qing Wang , Yuepei Li , Qiao Qiao , Kang Zhou , Qi Li

In zero-resource settings where transcribed speech audio is unavailable, unsupervised feature learning is essential for downstream speech processing tasks. Here we compare two recent methods for frame-level acoustic feature learning. For…

Computation and Language · Computer Science 2020-03-31 Petri-Johan Last , Herman A. Engelbrecht , Herman Kamper

Person re-identification (ReID) aims at searching the same identity person among images captured by various cameras. Unsupervised person ReID attracts a lot of attention recently, due to it works without intensive manual annotation and thus…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Bo Pang , Deming Zhai , Junjun Jiang , Xianming Liu

Contrastive learning has become a popular approach in natural language processing, particularly for the learning of sentence embeddings. However, the discrete nature of natural language makes it difficult to ensure the quality of positive…

Computation and Language · Computer Science 2023-05-23 Qinyuan Cheng , Xiaogui Yang , Tianxiang Sun , Linyang Li , Xipeng Qiu

Continual relation extraction (CRE) aims to continuously train a model on data with new relations while avoiding forgetting old ones. Some previous work has proved that storing a few typical samples of old relations and replaying them when…

Computation and Language · Computer Science 2022-05-24 Kang Zhao , Hua Xu , Jiangong Yang , Kai Gao

Electronic Health Record (EHR) data has been of tremendous utility in Artificial Intelligence (AI) for healthcare such as predicting future clinical events. These tasks, however, often come with many challenges when using classical machine…

Machine Learning · Computer Science 2021-04-08 Tingyi Wanyan , Jing Zhang , Ying Ding , Ariful Azad , Zhangyang Wang , Benjamin S Glicksberg

Hierarchical multi-label text classification (HMTC) aims at utilizing a label hierarchy in multi-label classification. Recent approaches to HMTC deal with the problem of imposing an over-constrained premise on the output space by using…

Computation and Language · Computer Science 2024-06-21 Simon Yu , Jie He , Víctor Gutiérrez-Basulto , Jeff Z. Pan

Automatic extraction of temporal relations between event pairs is an important task for several natural language processing applications such as Question Answering, Information Extraction, and Summarization. Since most existing methods are…

Machine Learning · Computer Science 2014-01-27 Seyed Abolghasem Mirroshandel , Gholamreza Ghassem-Sani

Continual relation extraction (RE) aims to learn constantly emerging relations while avoiding forgetting the learned relations. Existing works store a small number of typical samples to re-train the model for alleviating forgetting.…

Computation and Language · Computer Science 2023-05-12 Wenzheng Zhao , Yuanning Cui , Wei Hu

Sentence-level relation extraction aims to identify the relation between two entities for a given sentence. The existing works mostly focus on obtaining a better entity representation and adopting a multi-label classifier for relation…

Computation and Language · Computer Science 2023-04-12 Jiewen Zheng , Ze Chen

Sentence-level relation extraction mainly aims to classify the relation between two entities in a sentence. The sentence-level relation extraction corpus often contains data that are difficult for the model to infer or noise data. In this…

Computation and Language · Computer Science 2021-08-05 Seongsik Park , Harksoo Kim

Relation extraction is a key task in Natural Language Processing (NLP), which aims to extract relations between entity pairs from given texts. Recently, relation extraction (RE) has achieved remarkable progress with the development of deep…

Computation and Language · Computer Science 2022-04-12 Xinnian Liang , Shuangzhi Wu , Mu Li , Zhoujun Li

The growing demand for structured knowledge has led to great interest in relation extraction, especially in cases with limited supervision. However, existing distance supervision approaches only extract relations expressed in single…

Computation and Language · Computer Science 2017-08-16 Chris Quirk , Hoifung Poon

Pre-trained language models have proven their unique powers in capturing implicit language features. However, most pre-training approaches focus on the word-level training objective, while sentence-level objectives are rarely studied. In…

Computation and Language · Computer Science 2021-01-01 Zhuofeng Wu , Sinong Wang , Jiatao Gu , Madian Khabsa , Fei Sun , Hao Ma

Many unsupervised hashing methods are implicitly established on the idea of reconstructing the input data, which basically encourages the hashing codes to retain as much information of original data as possible. However, this requirement…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Zexuan Qiu , Qinliang Su , Zijing Ou , Jianxing Yu , Changyou Chen

Contrastive learning has been used to learn a high-quality representation of the image in computer vision. However, contrastive learning is not widely utilized in natural language processing due to the lack of a general method of data…

Computation and Language · Computer Science 2021-04-29 Peng Su , Yifan Peng , K. Vijay-Shanker

Distant Supervision for Relation Extraction uses heuristically aligned text data with an existing knowledge base as training data. The unsupervised nature of this technique allows it to scale to web-scale relation extraction tasks, at the…

Computation and Language · Computer Science 2017-10-30 Tushar Nagarajan , Sharmistha , Partha Talukdar

Natural Language Inference (NLI) is a growingly essential task in natural language understanding, which requires inferring the relationship between the sentence pairs (premise and hypothesis). Recently, low-resource natural language…

Computation and Language · Computer Science 2022-06-01 Shu'ang Li , Xuming Hu , Li Lin , Aiwei Liu , Lijie Wen , Philip S. Yu