English
Related papers

Related papers: Hierarchical Text Classification Using Contrastive…

200 papers

Image classification has been studied extensively but there has been limited work in the direction of using non-conventional, external guidance other than traditional image-label pairs to train such models. In this thesis we present a set…

Machine Learning · Computer Science 2020-04-14 Ankit Dhall

Recent studies are leveraging advancements in large language models (LLMs) trained on extensive internet-crawled text data to generate textual descriptions of downstream classes in CLIP-based zero-shot image classification. While most of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Tong Liang , Jim Davis

Hierarchical multi-label text classification aims to classify the input text into multiple labels, among which the labels are structured and hierarchical. It is a vital task in many real world applications, e.g. scientific literature…

Computation and Language · Computer Science 2023-08-01 Rundong Liu , Wenhan Liang , Weijun Luo , Yuxiang Song , He Zhang , Ruohua Xu , Yunfeng Li , Ming Liu

Learning semantic-rich representations from raw unlabeled time series data is critical for downstream tasks such as classification and forecasting. Contrastive learning has recently shown its promising representation learning capability in…

Machine Learning · Computer Science 2023-03-31 Qianwen Meng , Hangwei Qian , Yong Liu , Lizhen Cui , Yonghui Xu , Zhiqi Shen

The continually increasing number of documents produced each year necessitates ever improving information processing methods for searching, retrieving, and organizing text. Central to these information processing methods is document…

Multimodal representation learning is commonly built on a shared-private decomposition, treating latent information as either common to all modalities or specific to one. This binary view is often inadequate: many factors are shared by only…

Machine Learning · Statistics 2026-04-08 Huichao Li , Junhan Yu , Doudou Zhou

Graph contrastive learning (GCL) aims to align the positive features while differentiating the negative features in the latent space by minimizing a pair-wise contrastive loss. As the embodiment of an outstanding discriminative unsupervised…

Machine Learning · Computer Science 2023-12-27 Jiangmeng Li , Yifan Jin , Hang Gao , Wenwen Qiang , Changwen Zheng , Fuchun Sun

Existing vision-text contrastive learning like CLIP aims to match the paired image and caption embeddings while pushing others apart, which improves representation transferability and supports zero-shot prediction. However, medical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Zifeng Wang , Zhenbang Wu , Dinesh Agarwal , Jimeng Sun

Hierarchical text classification aims to leverage label hierarchy in multi-label text classification. Existing methods encode label hierarchy in a global view, where label hierarchy is treated as the static hierarchical structure containing…

Computation and Language · Computer Science 2022-11-09 Ting Jiang , Deqing Wang , Leilei Sun , Zhongzhi Chen , Fuzhen Zhuang , Qinghong Yang

Existed pre-trained models have achieved state-of-the-art performance on various text classification tasks. These models have proven to be useful in learning universal language representations. However, the semantic discrepancy between…

Machine Learning · Computer Science 2022-01-07 Jinhe Lan , Qingyuan Zhan , Chenhao Jiang , Kunping Yuan , Desheng Wang

Hierarchical text classification, which aims to classify text documents into a given hierarchy, is an important task in many real-world applications. Recently, deep neural models are gaining increasing popularity for text classification due…

Computation and Language · Computer Science 2019-01-01 Yu Meng , Jiaming Shen , Chao Zhang , Jiawei Han

Heterogeneous graph neural networks (HGNNs) have significantly propelled the information retrieval (IR) field. Still, the effectiveness of HGNNs heavily relies on high-quality labels, which are often expensive to acquire. This challenge has…

Machine Learning · Computer Science 2024-09-12 Siqing Li , Jin-Duk Park , Wei Huang , Xin Cao , Won-Yong Shin , Zhiqiang Xu

Medical image labels are often organized by taxonomies (e.g., organ - tissue - subtype), yet standard self-supervised learning (SSL) ignores this structure. We present a hierarchy-preserving contrastive framework that makes the label tree a…

Quantitative Methods · Quantitative Biology 2025-11-07 Alif Elham Khan

CLIP achieves strong zero-shot image-text retrieval by aligning global vision and text representations, yet it falls behind on fine-grained tasks even when fine-tuned on long, detailed captions. In this work, we propose $\beta$-CLIP, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Fatimah Zohra , Chen Zhao , Hani Itani , Bernard Ghanem

Graph contrastive learning (GCL) aims to learn discriminative semantic invariance by contrasting different views of the same graph that share critical topological patterns. However, existing GCL approaches with structural augmentations…

Machine Learning · Computer Science 2025-12-03 Qirui Ji , Bin Qin , Yifan Jin , Yunze Zhao , Chuxiong Sun , Changwen Zheng , Jianwen Cao , Jiangmeng Li

Object categories are typically organized into a multi-granularity taxonomic hierarchy. When classifying categories at different hierarchy levels, traditional uni-modal approaches focus primarily on image features, revealing limitations in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Peng Xia , Xingtong Yu , Ming Hu , Lie Ju , Zhiyong Wang , Peibo Duan , Zongyuan Ge

We consider the hierarchical representation of documents as graphs and use geometric deep learning to classify them into different categories. While graph neural networks can efficiently handle the variable structure of hierarchical…

Computation and Language · Computer Science 2021-11-01 Sohrab Ferdowsi , Nikolay Borissov , Julien Knafou , Poorya Amini , Douglas Teodoro

Contrastive learning (CL) has become a dominant paradigm for self-supervised hypergraph learning, enabling effective training without costly labels. However, node entities in real-world hypergraphs are often associated with rich textual…

Machine Learning · Computer Science 2026-05-26 Mengting Pan , Fan Li , Chen Chen , Xiaoyang Wang , Wenjie Zhang

In this paper, we propose a hierarchical contrastive learning framework, HiCL, which considers local segment-level and global sequence-level relationships to improve training efficiency and effectiveness. Traditional methods typically…

Computation and Language · Computer Science 2023-10-17 Zhuofeng Wu , Chaowei Xiao , VG Vinod Vydiswaran

Classification algorithms in machine learning often assume a flat label space. However, most real world data have dependencies between the labels, which can often be captured by using a hierarchy. Utilizing this relation can help develop a…

Machine Learning · Computer Science 2020-06-09 Palash Goyal , Shalini Ghosh