English
Related papers

Related papers: Incorporating Hierarchy into Text Encoder: a Contr…

200 papers

Graph representation learning has attracted a surge of interest recently, whose target at learning discriminant embedding for each node in the graph. Most of these representation methods focus on supervised learning and heavily depend on…

Machine Learning · Computer Science 2021-07-07 Pengpeng Shao , Tong Liu , Dawei Zhang , Jianhua Tao , Feihu Che , Guohua Yang

An important problem in multi-label classification is to capture label patterns or underlying structures that have an impact on such patterns. This paper addresses one such problem, namely how to exploit hierarchical structures over labels.…

Machine Learning · Computer Science 2015-04-17 Jinseok Nam , Johannes Fürnkranz

Text alignment finds application in tasks such as citation recommendation and plagiarism detection. Existing alignment methods operate at a single, predefined level and cannot learn to align texts at, for example, sentence and document…

Computation and Language · Computer Science 2020-10-06 Xuhui Zhou , Nikolaos Pappas , Noah A. Smith

Contrastive learning methods have attracted considerable attention due to their remarkable success in analyzing graph-structured data. Inspired by the success of contrastive learning, we propose a novel framework for contrastive…

Machine Learning · Computer Science 2023-06-21 Xiaojuan Zhang , Jun Fu , Shuang Li

The rise of self-supervised learning, which operates without the need for labeled data, has garnered significant interest within the graph learning community. This enthusiasm has led to the development of numerous Graph Contrastive Learning…

Machine Learning · Computer Science 2024-02-27 Qian Ma , Hongliang Chi , Hengrui Zhang , Kay Liu , Zhiwei Zhang , Lu Cheng , Suhang Wang , Philip S. Yu , Yao Ma

We investigate node representation learning on text-attributed graphs (TAGs), where nodes are associated with text information. Although recent studies on graph neural networks (GNNs) and pretrained language models (PLMs) have exhibited…

Information Retrieval · Computer Science 2024-04-22 Peiyan Zhang , Chaozhuo Li , Liying Kang , Feiran Huang , Senzhang Wang , Xing Xie , Sunghun Kim

Heterogeneous graph neural networks (HGNNs) as an emerging technique have shown superior capacity of dealing with heterogeneous information network (HIN). However, most HGNNs follow a semi-supervised learning manner, which notably limits…

Machine Learning · Computer Science 2024-03-06 Nian Liu , Xiao Wang , Hui Han , Chuan Shi

Cross-lingual text classification aims at training a classifier on the source language and transferring the knowledge to target languages, which is very useful for low-resource languages. Recent multilingual pretrained language models…

Computation and Language · Computer Science 2021-05-25 Ziyun Wang , Xuan Liu , Peiji Yang , Shixing Liu , Zhisheng Wang

Hierarchical text classification has many real-world applications. However, labeling a large number of documents is costly. In practice, we can use semi-supervised learning or weakly supervised learning (e.g., dataless classification) to…

Machine Learning · Computer Science 2019-02-26 Huiru Xiao , Xin Liu , Yangqiu Song

Hierarchical Multi-Label Classification (HMC) faces critical challenges in maintaining structural consistency and balancing loss weighting in Multi-Task Learning (MTL). In order to address these issues, we propose a classifier called HCAL…

Machine Learning · Computer Science 2025-08-20 Ruobing Jiang , Mengzhe Liu , Haobing Liu , Yanwei Yu

Existed pre-trained models have achieved state-of-the-art performance on various text classification tasks. These models have proven to be useful in learning universal language representations. However, the semantic discrepancy between…

Machine Learning · Computer Science 2022-01-07 Jinhe Lan , Qingyuan Zhan , Chenhao Jiang , Kunping Yuan , Desheng Wang

Hierarchical Text Classification (HTC) involves assigning documents to labels organized within a taxonomy. Most previous research on HTC has focused on supervised methods. However, in real-world scenarios, employing supervised HTC can be…

Computation and Language · Computer Science 2026-05-18 Qianbo Zang , Christophe Zgrzendek , Igor Tchappi , Afshin Khadangi , Johannes Sedlmeir

Hierarchical classification problems are commonly seen in practice. However, most existing methods do not fully utilize the hierarchical information among class labels. In this paper, a novel label embedding approach is proposed, which…

Methodology · Statistics 2020-07-23 Yiwei Fan , Xiaoling Lu , Yufeng Liu , Junlong Zhao

Multi-label text classification (MLTC) aims to assign multiple labels to each sample in the dataset. The labels usually have internal correlations. However, traditional methods tend to ignore the correlations between labels. In order to…

Computation and Language · Computer Science 2018-09-11 Pengcheng Yang , Shuming Ma , Yi Zhang , Junyang Lin , Qi Su , Xu Sun

Large language models (LLMs) excel at a range of tasks through in-context learning (ICL), where only a few task examples guide their predictions. However, prior research highlights that LLMs often overlook input-label mapping information in…

Computation and Language · Computer Science 2025-06-10 Keqin Peng , Liang Ding , Yuanxin Ouyang , Meng Fang , Yancheng Yuan , Dacheng Tao

Hierarchy is a common and effective way of organizing data and representing their relationships at different levels of abstraction. However, hierarchical data dependencies cause difficulties in the estimation of "separable" models that can…

Information Retrieval · Computer Science 2016-09-05 Mostafa Dehghani , Hosein Azarbonyad , Jaap Kamps , Maarten Marx

Hierarchical classification aims to sort the object into a hierarchical structure of categories. For example, a bird can be categorized according to a three-level hierarchy of order, family, and species. Existing methods commonly address…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Renzhen Wang , De cai , Kaiwen Xiao , Xixi Jia , Xiao Han , Deyu Meng

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

Machine Learning · Computer Science 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

In hierarchical text classification, we perform a sequence of inference steps to predict the category of a document from top to bottom of a given class taxonomy. Most of the studies have focused on developing novels neural network…

Computation and Language · Computer Science 2020-05-25 Kervy Rivas Rojas , Gina Bustamante , Arturo Oncevay , Marco A. Sobrevilla Cabezudo

Cross-graph Relational Learning (CGRL) refers to the problem of predicting the strengths or labels of multi-relational tuples of heterogeneous object types, through the joint inference over multiple graphs which specify the internal…

Machine Learning · Computer Science 2016-05-09 Hanxiao Liu , Yiming Yang