English
Related papers

Related papers: Incorporating Hierarchy into Text Encoder: a Contr…

200 papers

Hierarchical text classification (HTC) is an important task with broad applications, while few-shot HTC has gained increasing interest recently. While in-context learning (ICL) with large language models (LLMs) has achieved significant…

Computation and Language · Computer Science 2024-07-02 Huiyao Chen , Yu Zhao , Zulong Chen , Mengjia Wang , Liangyue Li , Meishan Zhang , Min Zhang

In task-oriented dialogue scenarios, cross-domain zero-shot slot filling plays a vital role in leveraging source domain knowledge to learn a model with high generalization ability in unknown target domain where annotated data is…

Artificial Intelligence · Computer Science 2023-10-23 Junwen Zhang , Yin Zhang

Hierarchical multi-label text classification (HMTC) has been gaining popularity in recent years thanks to its applicability to a plethora of real-world applications. The existing HMTC algorithms largely focus on the design of classifiers,…

Computation and Language · Computer Science 2021-04-13 Xinyi Zhang , Jiahao Xu , Charlie Soh , Lihui Chen

Text classification plays an important role in various downstream text-related tasks, such as sentiment analysis, fake news detection, and public opinion analysis. Recently, text classification based on Graph Neural Networks (GNNs) has made…

Computation and Language · Computer Science 2025-12-24 Zuo Wang , Ye Yuan

Multi-label text classification (MLTC) is an attractive and challenging task in natural language processing (NLP). Compared with single-label text classification, MLTC has a wider range of applications in practice. In this paper, we propose…

Computation and Language · Computer Science 2022-05-24 Irene Li , Aosong Feng , Hao Wu , Tianxiao Li , Toyotaro Suzumura , Ruihai Dong

Contrastive learning has gained significant attention in short text clustering, yet it has an inherent drawback of mistakenly identifying samples from the same category as negatives and then separating them in the feature space (false…

Machine Learning · Computer Science 2026-03-16 Zhihao Yao

Contrastive learning has emerged as a powerful tool for graph representation learning. However, most contrastive learning methods learn features of graphs with fixed coarse-grained scale, which might underestimate either local or global…

Machine Learning · Computer Science 2022-10-24 Jun Wang , Weixun Li , Changyu Hou , Xin Tang , Yixuan Qiao , Rui Fang , Pengyong Li , Peng Gao , Guotong Xie

Image classification has been studied extensively but there has been limited work in the direction of using non-conventional, external guidance other than traditional image-label pairs to train such models. In this thesis we present a set…

Machine Learning · Computer Science 2020-04-14 Ankit Dhall

Unsupervised graph representation learning is a non-trivial topic. The success of contrastive methods in the unsupervised representation learning on structured data inspires similar attempts on the graph. Existing graph contrastive learning…

Machine Learning · Computer Science 2024-04-02 Tianyu Zhang , Yuxiang Ren , Wenzheng Feng , Weitao Du , Xuecang Zhang

Contrastive pretraining techniques for text classification has been largely studied in an unsupervised setting. However, oftentimes labeled data from related tasks which share label semantics with current task is available. We hypothesize…

Computation and Language · Computer Science 2021-12-22 Samujjwal Ghosh , Subhadeep Maji , Maunendra Sankar Desarkar

Hierarchical text classification (HTC) is a challenging subtask of multi-label classification as the labels form a complex hierarchical structure. Existing dual-encoder methods in HTC achieve weak performance gains with huge memory…

Computation and Language · Computer Science 2023-06-12 He Zhu , Chong Zhang , Junjie Huang , Junran Wu , Ke Xu

Extreme multi-label text classification utilizes the label hierarchy to partition extreme labels into multiple label groups, turning the task into simple multi-group multi-label classification tasks. Current research encodes labels as a…

Computation and Language · Computer Science 2023-03-03 Li Wang , Ying Wah Teh , Mohammed Ali Al-Garadi

Unsupervised representation learning has recently received lots of interest due to its powerful generalizability through effectively leveraging large-scale unlabeled data. There are two prevalent approaches for this, contrastive learning…

Machine Learning · Computer Science 2021-06-14 Saehoon Kim , Sungwoong Kim , Juho Lee

Text classification is a crucial and fundamental task in web content mining. Compared with the previous learning paradigm of pre-training and fine-tuning by cross entropy loss, the recently proposed supervised contrastive learning approach…

Computation and Language · Computer Science 2026-01-26 Mengyu Li , Yonghao Liu , Fausto Giunchiglia , Ximing Li , Xiaoyue Feng , Renchu Guan

Multi-label text classification refers to the problem of assigning each given document its most relevant labels from the label set. Commonly, the metadata of the given documents and the hierarchy of the labels are available in real-world…

Computation and Language · Computer Science 2023-10-24 Yu Zhang , Zhihong Shen , Yuxiao Dong , Kuansan Wang , Jiawei Han

The task of text classification is usually divided into two stages: {\it text feature extraction} and {\it classification}. In this standard formalization categories are merely represented as indexes in the label vocabulary, and the model…

Computation and Language · Computer Science 2020-06-05 Duo Chai , Wei Wu , Qinghong Han , Fei Wu , Jiwei Li

Recently, as an effective way of learning latent representations, contrastive learning has been increasingly popular and successful in various domains. The success of constrastive learning in single-label classifications motivates us to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Son D. Dao , Ethan Zhao , Dinh Phung , Jianfei Cai

Multi-label classification is an important yet challenging task in natural language processing. It is more complex than single-label classification in that the labels tend to be correlated. Existing methods tend to ignore the correlations…

Computation and Language · Computer Science 2018-06-18 Pengcheng Yang , Xu Sun , Wei Li , Shuming Ma , Wei Wu , Houfeng Wang

Self-supervised learning (especially contrastive learning) methods on heterogeneous graphs can effectively get rid of the dependence on supervisory data. Meanwhile, most existing representation learning methods embed the heterogeneous…

Machine Learning · Computer Science 2022-06-28 Shichao Zhu , Chuan Zhou , Anfeng Cheng , Shirui Pan , Shuaiqiang Wang , Dawei Yin , Bin Wang

Graph contrastive learning defines a contrastive task to pull similar instances close and push dissimilar instances away. It learns discriminative node embeddings without supervised labels, which has aroused increasing attention in the past…

Machine Learning · Computer Science 2023-04-25 Lin Shu , Chuan Chen , Zibin Zheng