English
Related papers

Related papers: Self-supervised Graph Learning for Long-tailed Cog…

200 papers

Deep learning has achieved remarkable progress for visual recognition on large-scale balanced datasets but still performs poorly on real-world long-tailed data. Previous methods often adopt class re-balanced training strategies to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Tianhao Li , Limin Wang , Gangshan Wu

Real-world data is extremely imbalanced and presents a long-tailed distribution, resulting in models that are biased towards classes with sufficient samples and perform poorly on rare classes. Recent methods propose to rebalance classes but…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Weiqi Li , Fan Lyu , Fanhua Shang , Liang Wan , Wei Feng

Self-supervised learning has gradually emerged as a powerful technique for graph representation learning. However, transferable, generalizable, and robust representation learning on graph data still remains a challenge for pre-training…

Machine Learning · Computer Science 2021-12-13 Pengyong Li , Jun Wang , Ziliang Li , Yixuan Qiao , Xianggen Liu , Fei Ma , Peng Gao , Seng Song , Guotong Xie

Real-world data often have a long-tailed distribution, where the number of samples per class is not equal over training classes. The imbalanced data form a biased feature space, which deteriorates the performance of the recognition model.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Minki Jeong , Changick Kim

The human ability to synchronize the feedback from all their senses inspired recent works in multi-task and multi-modal learning. While these works rely on expensive supervision, our multi-task graph requires only pseudo-labels from expert…

Machine Learning · Computer Science 2021-11-05 Emanuela Haller , Elena Burceanu , Marius Leordeanu

Self-supervised contrastive representation learning has proved incredibly successful in the vision and natural language domains, enabling state-of-the-art performance with orders of magnitude less labeled data. However, such methods are…

Machine Learning · Computer Science 2022-03-17 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler

Continual learning (CL) has shown promising results and comparable performance to learning at once in a fully supervised manner. However, CL strategies typically require a large number of labeled samples, making their real-life deployment…

Machine Learning · Computer Science 2025-01-15 Yan Fan , Yu Wang , Pengfei Zhu , Qinghua Hu

Scene Graph Generation (SGG) as a critical task in image understanding, facing the challenge of head-biased prediction caused by the long-tail distribution of predicates. However, current unbiased SGG methods can easily prioritize improving…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Lei Wang , Zejian Yuan , Yao Lu , Badong Chen

We address the challenging problem of semi-supervised learning in the context of multiple visual interpretations of the world by finding consensus in a graph of neural networks. Each graph node is a scene interpretation layer, while each…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Marius Leordeanu , Mihai Pirvu , Dragos Costea , Alina Marcu , Emil Slusanschi , Rahul Sukthankar

Supervised Contrastive Loss (SCL) is popular in visual representation learning. Given an anchor image, SCL pulls two types of positive samples, i.e., its augmentation and other images from the same class together, while pushes negative…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shiyu Xuan , Shiliang Zhang

Graph Convolutional Networks (GCNs) have been successfully applied to analyze non-grid data, where the classical convolutional neural networks (CNNs) cannot be directly used. One similarity shared by GCNs and CNNs is the requirement of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Qikui Zhu , Bo Du , Pingkun Yan

In practical domains, high-dimensional data are usually associated with diverse semantic labels, whereas traditional feature selection methods are designed for single-label data. Moreover, existing multi-label methods encounter two main…

Machine Learning · Computer Science 2025-05-26 Yan Zhong , Xingyu Wu , Xinping Zhao , Li Zhang , Xinyuan Song , Lei Shi , Bingbing Jiang

Graph Convolutional Networks (GCNs) show promising results for semi-supervised learning tasks on graphs, thus become favorable comparing with other approaches. Despite the remarkable success of GCNs, it is difficult to train GCNs with…

Machine Learning · Computer Science 2020-08-14 Xianfeng Tang , Huaxiu Yao , Yiwei Sun , Yiqi Wang , Jiliang Tang , Charu Aggarwal , Prasenjit Mitra , Suhang Wang

Mental disorder populations exhibit pronounced heterogeneity -- that is, the significant differences between samples -- poses a significant challenge to the definition of positive pairs in contrastive learning. To address this, we propose a…

Machine Learning · Computer Science 2026-03-23 Xiaolong Li , Guiliang Guo , Guangqi Wen , Peng Cao , Jinzhu Yang , Honglin Wu , Xiaoli Liu , Fei Wang , Osmar R. Zaiane

Data in real-world object detection often exhibits the long-tailed distribution. Existing solutions tackle this problem by mitigating the competition between the head and tail categories. However, due to the scarcity of training samples,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Bo Li , Yongqiang Yao , Jingru Tan , Xin Lu , Fengwei Yu , Ye Luo , Jianwei Lu

Existing graph learning-based cognitive diagnosis (CD) methods have made relatively good results, but their student, exercise, and concept representations are learned and exchanged in an implicit unified graph, which makes the…

Machine Learning · Computer Science 2024-10-24 Shangshang Yang , Mingyang Chen , Ziwen Wang , Xiaoshan Yu , Panpan Zhang , Haiping Ma , Xingyi Zhang

Graph contrastive learning (GCL) alleviates the heavy reliance on label information for graph representation learning (GRL) via self-supervised learning schemes. The core idea is to learn by maximising mutual information for similar…

Machine Learning · Computer Science 2022-10-18 Yizhen Zheng , Shirui Pan , Vincent Cs Lee , Yu Zheng , Philip S. Yu

Cognitive diagnosis (CD) models latent cognitive states of human learners by analyzing their response patterns on diagnostic tests, serving as a crucial machine learning technique for educational assessment and evaluation. Traditional…

Machine Learning · Computer Science 2025-07-15 Jiatong Li , Qi Liu , Mengxiao Zhu

Long-tail class incremental learning (LT CIL) remains highly challenging because the scarcity of samples in tail classes not only hampers their learning but also exacerbates catastrophic forgetting under continuously evolving and imbalanced…

Artificial Intelligence · Computer Science 2026-03-24 Xi Wang , Xu Yang , Donghao Sun , Cheng Deng

Deep learning has achieved remarkable success in bearing fault diagnosis. However, its performance oftentimes deteriorates when dealing with highly imbalanced or long-tailed data, while such cases are prevalent in industrial settings…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Wei-En Yu , Jinwei Sun , Shiping Zhang , Xiaoge Zhang , Jing-Xiao Liao