English
Related papers

Related papers: Structure-Aware Label Smoothing for Graph Neural N…

200 papers

Graph Neural Networks (GNNs) have achieved state-of-the-art results for semi-supervised node classification on graphs. Nevertheless, the challenge of how to effectively learn GNNs with very few labels is still under-explored. As one of the…

Machine Learning · Computer Science 2022-01-21 Yayong Li , Jie Yin , Ling Chen

Label smoothing loss is a widely adopted technique to mitigate overfitting in deep neural networks. This paper studies label smoothing from the perspective of Neural Collapse (NC), a powerful empirical and theoretical framework which…

Machine Learning · Computer Science 2025-09-30 Li Guo , George Andriopoulos , Zifan Zhao , Shuyang Ling , Zixuan Dong , Keith Ross

Label Smoothing (LS) is an effective regularizer to improve the generalization of state-of-the-art deep models. For each training sample the LS strategy smooths the one-hot encoded training signal by distributing its distribution mass over…

Machine Learning · Computer Science 2020-12-04 Hongyu Guo

Graph-based methods have been demonstrated as one of the most effective approaches for semi-supervised learning, as they can exploit the connectivity patterns between labeled and unlabeled data samples to improve learning performance.…

Machine Learning · Computer Science 2019-07-01 Qimai Li , Xiao-Ming Wu , Han Liu , Xiaotong Zhang , Zhichao Guan

In the transductive setting, where the full graph is observed but node labels are only partially available, progress in semi-supervised node classification has largely focused on architectural innovation. In this paper, we revisit an…

Machine Learning · Computer Science 2026-05-21 Brown Zaz , Mar Gonzàlez I Català , Ferran Hernandez Caralt , Moshe Eliasof , Pietro Liò

Despite the success of the carefully-annotated benchmarks, the effectiveness of existing graph neural networks (GNNs) can be considerably impaired in practice when the real-world graph data is noisily labeled. Previous explorations in…

Machine Learning · Computer Science 2024-08-30 Yuhao Wu , Jiangchao Yao , Xiaobo Xia , Jun Yu , Ruxin Wang , Bo Han , Tongliang Liu

In this work, we study semi-supervised multi-label node classification problem in attributed graphs. Classic solutions to multi-label node classification follow two steps, first learn node embedding and then build a node classifier on the…

Machine Learning · Computer Science 2024-03-14 Uchenna Akujuobi , Han Yufei , Qiannan Zhang , Xiangliang Zhang

We introduce a novel loss function for training deep learning architectures to perform classification. It consists in minimizing the smoothness of label signals on similarity graphs built at the output of the architecture. Equivalently, it…

Machine Learning · Computer Science 2019-05-02 Myriam Bontonou , Carlos Lassance , Ghouthi Boukli Hacene , Vincent Gripon , Jian Tang , Antonio Ortega

Recent studies have revealed that, beyond conventional accuracy, calibration should also be considered for training modern deep neural networks. To address miscalibration during learning, some methods have explored different penalty…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Bingyuan Liu , Jérôme Rony , Adrian Galdran , Jose Dolz , Ismail Ben Ayed

Graph neural networks (GNNs) and label propagation represent two interrelated modeling strategies designed to exploit graph structure in tasks such as node property prediction. The former is typically based on stacked message-passing layers…

Machine Learning · Computer Science 2021-10-15 Yangkun Wang , Jiarui Jin , Weinan Zhang , Yongyi Yang , Jiuhai Chen , Quan Gan , Yong Yu , Zheng Zhang , Zengfeng Huang , David Wipf

It is hard to directly implement Graph Neural Networks (GNNs) on large scaled graphs. Besides of existed neighbor sampling techniques, scalable methods decoupling graph convolutions and other learnable transformations into preprocessing and…

Machine Learning · Computer Science 2021-07-02 Chuxiong Sun , Hongming Gu , Jie Hu

We study the problem of node classification on graphs with few-shot novel labels, which has two distinctive properties: (1) There are novel labels to emerge in the graph; (2) The novel labels have only a few representative nodes for…

Machine Learning · Computer Science 2020-10-23 Lin Lan , Pinghui Wang , Xuefeng Du , Kaikai Song , Jing Tao , Xiaohong Guan

We study Label Smoothing (LS), a widely used regularization technique, in the context of neural learning to rank (L2R) models. LS combines the ground-truth labels with a uniform distribution, encouraging the model to be less confident in…

Information Retrieval · Computer Science 2020-12-17 Gustavo Penha , Claudia Hauff

Graph Neural Networks have achieved remarkable accuracy in semi-supervised node classification tasks. However, these results lack reliable uncertainty estimates. Conformal prediction methods provide a theoretical guarantee for node…

Machine Learning · Computer Science 2025-01-07 Jianqing Song , Jianguo Huang , Wenyu Jiang , Baoming Zhang , Shuangjie Li , Chongjun Wang

Graph Neural Networks (GNNs) have achieved great success in various tasks, but their performance highly relies on a large number of labeled nodes, which typically requires considerable human effort. GNN-based Active Learning (AL) methods…

Machine Learning · Computer Science 2022-03-03 Wentao Zhang , Yexin Wang , Zhenbang You , Meng Cao , Ping Huang , Jiulong Shan , Zhi Yang , Bin Cui

Graph Neural Networks (GNNs) have emerged as a powerful tool for semi-supervised node classification tasks. However, recent studies have revealed various biases in GNNs stemming from both node features and graph topology. In this work, we…

Machine Learning · Computer Science 2023-05-26 Haoyu Han , Xiaorui Liu , Feng Shi , MohamadAli Torkamani , Charu C. Aggarwal , Jiliang Tang

Node classification is an important problem in graph data management. It is commonly solved by various label propagation methods that work iteratively starting from a few labeled seed nodes. For graphs with arbitrary compatibilities between…

Machine Learning · Computer Science 2020-03-06 Krishna Kumar P. , Paul Langton , Wolfgang Gatterbauer

Speaker identification in the household scenario (e.g., for smart speakers) is typically based on only a few enrollment utterances but a much larger set of unlabeled data, suggesting semisupervised learning to improve speaker profiles. We…

Sound · Computer Science 2022-02-22 Long Chen , Venkatesh Ravichandran , Andreas Stolcke

Traditional graph-based semi-supervised learning (SSL) approaches, even though widely applied, are not suited for massive data and large label scenarios since they scale linearly with the number of edges $|E|$ and distinct labels $m$. To…

Machine Learning · Computer Science 2016-05-17 Sujith Ravi , Qiming Diao

Node classification on graphs is an important task in many practical domains. It usually requires labels for training, which can be difficult or expensive to obtain in practice. Given a budget for labelling, active learning aims to improve…

Machine Learning · Computer Science 2022-07-21 Juncheng Liu , Yiwei Wang , Bryan Hooi , Renchi Yang , Xiaokui Xiao