English
Related papers

Related papers: Multi-Level Contrastive Learning for Dense Predict…

200 papers

Learning an effective representation in multi-label text classification (MLTC) is a significant challenge in NLP. This challenge arises from the inherent complexity of the task, which is shaped by two key factors: the intricate connections…

Machine Learning · Computer Science 2024-04-16 Alexandre Audibert , Aurélien Gauffre , Massih-Reza Amini

The field of generating recommendations within the framework of causal inference has seen a recent surge, with recommendations being likened to treatments. This approach enhances insights into the influence of recommendations on user…

Information Retrieval · Computer Science 2023-08-21 Guanglin Zhou , Chengkai Huang , Xiaocong Chen , Xiwei Xu , Chen Wang , Liming Zhu , Lina Yao

In recent years, there has been a notable increase in the use of supervised detection methods of major depressive disorder (MDD) based on electroencephalogram (EEG) signals. However, the process of labeling MDD remains challenging. As a…

Machine Learning · Computer Science 2025-12-17 Li-Xuan Zhao , Chen-Yang Xu , Wen-Qiang Li , Bo Wang , Rong-Xing Wei , Qing-Hao Menga

Most Neural Networks (NNs) for classification are trained using Cross-Entropy as a loss function. This approach requires the model to have an explicit classification layer. However, there exist alternative approaches, such as Contrastive…

Machine Learning · Computer Science 2026-04-27 Leonardo Arrighi , Julia Eva Belloni , Aurélie Gallet , Ivan Gentile , Matteo Lippi , Marco Zullich

Hierarchical multi-label text classification (HMTC) aims at utilizing a label hierarchy in multi-label classification. Recent approaches to HMTC deal with the problem of imposing an over-constrained premise on the output space by using…

Computation and Language · Computer Science 2024-06-21 Simon Yu , Jie He , Víctor Gutiérrez-Basulto , Jeff Z. Pan

The success of deep learning heavily depends on the availability of large labeled training sets. However, it is hard to get large labeled datasets in medical image domain because of the strict privacy concern and costly labeling efforts.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Haiyun Yuan , Meiping Huang , Jian Zhuang , Jingtong Hu , Yiyu Shi

Feature representation via self-supervised learning has reached remarkable success in image-level contrastive learning, which brings impressive performances on image classification tasks. While image-level feature representation mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Junwei Yang , Ke Zhang , Zhaolin Cui , Jinming Su , Junfeng Luo , Xiaolin Wei

Learning representations for individual instances when only bag-level labels are available is a fundamental challenge in multiple instance learning (MIL). Recent works have shown promising results using contrastive self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Kangning Liu , Weicheng Zhu , Yiqiu Shen , Sheng Liu , Narges Razavian , Krzysztof J. Geras , Carlos Fernandez-Granda

Pixel-level labels are particularly expensive to acquire. Hence, pretraining is a critical step to improve models on a task like semantic segmentation. However, prominent algorithms for pretraining neural networks use image-level…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Mathilde Caron , Neil Houlsby , Cordelia Schmid

Integrating supervised contrastive loss to cross entropy-based communication has recently been proposed as a solution to address the long-tail learning problem. However, when the class imbalance ratio is high, it requires adjusting the…

Machine Learning · Computer Science 2024-07-10 Charika De Alvis , Dishanika Denipitiyage , Suranga Seneviratne

Link prediction tasks focus on predicting possible future connections. Most existing researches measure the likelihood of links by different similarity scores on node pairs and predict links between nodes. However, the similarity-based…

Machine Learning · Computer Science 2023-03-09 Zehua Zhang , Shilin Sun , Guixiang Ma , Caiming Zhong

In business analysis, providing effective recommendations is essential for enhancing company profits. The utilization of graph-based structures, such as bipartite graphs, has gained popularity for their ability to analyze complex data…

Information Retrieval · Computer Science 2025-01-14 Jiayang Wu , Wensheng Gan , Huashen Lu , Philip S. Yu

Contrastive learning (CL) has recently emerged as an effective approach to learning representation in a range of downstream tasks. Central to this approach is the selection of positive (similar) and negative (dissimilar) sets to provide the…

Machine Learning · Computer Science 2021-10-25 Anh Bui , Trung Le , He Zhao , Paul Montague , Seyit Camtepe , Dinh Phung

Contrastive learning is one of the fastest growing research areas in machine learning due to its ability to learn useful representations without labeled data. However, contrastive learning is susceptible to feature suppression, i.e., it may…

Machine Learning · Computer Science 2021-11-30 Tianhong Li , Lijie Fan , Yuan Yuan , Hao He , Yonglong Tian , Rogerio Feris , Piotr Indyk , Dina Katabi

Deep learning-based AMC methods have achieved remarkable performance, but their practical deployment remains constrained by the high cost of labeled data. Although self-supervised learning (SSL) reduces the reliance on labels, existing…

Signal Processing · Electrical Eng. & Systems 2026-05-13 Chenxu Wang , Shuang Wang , Lirong Han , Xinyu Hu , Hanlin Mo , Hantong Xing , Licheng Jiao

Although machine learning on hypergraphs has attracted considerable attention, most of the works have focused on (semi-)supervised learning, which may cause heavy labeling costs and poor generalization. Recently, contrastive learning has…

Machine Learning · Computer Science 2023-01-06 Dongjin Lee , Kijung Shin

Through minimization of an appropriate loss function such as the InfoNCE loss, contrastive learning (CL) learns a useful representation function by pulling positive samples close to each other while pushing negative samples far apart in the…

Machine Learning · Computer Science 2024-05-13 Ruijie Jiang , Thuan Nguyen , Prakash Ishwar , Shuchin Aeron

During the past decade, deep neural networks have led to fast-paced progress and significant achievements in computer vision problems, for both academia and industry. Yet despite their success, state-of-the-art image classification…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Aristotelis Ballas , Christos Diou

Contrastive learning methods based on InfoNCE loss are popular in node representation learning tasks on graph-structured data. However, its reliance on data augmentation and its quadratic computational complexity might lead to inconsistency…

Machine Learning · Computer Science 2022-12-12 Hengrui Zhang , Qitian Wu , Yu Wang , Shaofeng Zhang , Junchi Yan , Philip S. Yu

Quantifying and evaluating image complexity can be instrumental in enhancing the performance of various computer vision tasks. Supervised learning can effectively learn image complexity features from well-annotated datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Shipeng Liu , Liang Zhao , Dengfeng Chen , Zhanping Song