English
Related papers

Related papers: Structure-Aware Label Smoothing for Graph Neural N…

200 papers

Deep Learning, particularly Convolutional Neural Networks (CNN), has been successful in computer vision tasks and medical image analysis. However, modern CNNs can be overconfident, making them difficult to deploy in real-world scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Somenath Kuiry , Alaka Das , Mita Nasipuri , Nibaran Das

Label smoothing is a widely used technique in various domains, such as text classification, image classification and speech recognition, known for effectively combating model overfitting. However, there is little fine-grained analysis on…

Computation and Language · Computer Science 2024-02-26 Yijie Gao , Shijing Si , Hua Luo , Haixia Sun , Yugui Zhang

Semi-supervised learning on graphs is a widely applicable problem in network science and machine learning. Two standard algorithms -- label propagation and graph neural networks -- both operate by repeatedly passing information along edges,…

Machine Learning · Computer Science 2021-02-02 Junteng Jia , Austin R. Benson

The success of graph embeddings or node representation learning in a variety of downstream tasks, such as node classification, link prediction, and recommendation systems, has led to their popularity in recent years. Representation learning…

Machine Learning · Computer Science 2018-09-07 Saba A. Al-Sayouri , Danai Koutra , Evangelos E. Papalexakis , Sarah S. Lam

Learning with noisy labels is an important and challenging task for training accurate deep neural networks. Some commonly-used loss functions, such as Cross Entropy (CE), suffer from severe overfitting to noisy labels. Robust loss functions…

Machine Learning · Computer Science 2021-08-03 Xiong Zhou , Xianming Liu , Chenyang Wang , Deming Zhai , Junjun Jiang , Xiangyang Ji

Graph Neural Networks (GNNs) are the predominant technique for learning over graphs. However, there is relatively little understanding of why GNNs are successful in practice and whether they are necessary for good performance. Here, we show…

Machine Learning · Computer Science 2020-11-04 Qian Huang , Horace He , Abhay Singh , Ser-Nam Lim , Austin R. Benson

Graph Neural Networks (GNNs) have achieved a lot of success with graph-structured data. However, it is observed that the performance of GNNs does not improve (or even worsen) as the number of layers increases. This effect has known as…

Machine Learning · Computer Science 2023-01-10 Yeskendir Koishekenov

Node classification on graphs is of great importance in many applications. Due to the limited labeling capability and evolution in real-world open scenarios, novel classes can emerge on unlabeled testing nodes. However, little attention has…

Machine Learning · Computer Science 2024-04-01 Yucheng Jin , Yun Xiong , Juncheng Fang , Xixi Wu , Dongxiao He , Xing Jia , Bingchen Zhao , Philip Yu

Despite the great success of state-of-the-art deep neural networks, several studies have reported models to be over-confident in predictions, indicating miscalibration. Label Smoothing has been proposed as a solution to the over-confidence…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Shuang Ao , Stefan Rueger , Advaith Siddharthan

Given the ubiquitous existence of graph-structured data, learning the representations of nodes for the downstream tasks ranging from node classification, link prediction to graph classification is of crucial importance. Regarding missing…

Machine Learning · Computer Science 2022-04-21 Bisheng Li , Min Zhou , Shengzhong Zhang , Menglin Yang , Defu Lian , Zengfeng Huang

In this work, we address semi-supervised classification of graph data, where the categories of those unlabeled nodes are inferred from labeled nodes as well as graph structures. Recent works often solve this problem via advanced graph…

Machine Learning · Computer Science 2020-01-20 Chunyan Xu , Zhen Cui , Xiaobin Hong , Tong Zhang , Jian Yang , Wei Liu

Open-world semi-supervised learning aims at inferring both known and novel classes in unlabeled data, by harnessing prior knowledge from a labeled set with known classes. Despite its importance, there is a lack of theoretical foundations…

Machine Learning · Computer Science 2023-11-08 Yiyou Sun , Zhenmei Shi , Yixuan Li

In this paper, we study using graph neural networks (GNNs) for \textit{multi-node representation learning}, where a representation for a set of more than one node (such as a link) is to be learned. Existing GNNs are mainly designed to learn…

Machine Learning · Computer Science 2025-03-11 Xiyuan Wang , Pan Li , Muhan Zhang

Graph representation learning has emerged as a cornerstone for tasks like node classification and link prediction, yet prevailing self-supervised learning (SSL) methods face challenges such as computational inefficiency, reliance on…

Machine Learning · Computer Science 2025-09-04 Srinitish Srinivasan , Omkumar CU

We focus on developing a novel scalable graph-based semi-supervised learning (SSL) method for a small number of labeled data and a large amount of unlabeled data. Due to the lack of labeled data and the availability of large-scale unlabeled…

Machine Learning · Computer Science 2019-12-06 Zitong Wang , Li Wang , Raymond Chan , Tieyong Zeng

As data volumes continue to grow, the labelling process increasingly becomes a bottleneck, creating demand for methods that leverage information from unlabelled data. Impressive results have been achieved in semi-supervised learning (SSL)…

Machine Learning · Computer Science 2020-07-07 Ivana Balažević , Carl Allen , Timothy Hospedales

In the era of widespread social networks, the rapid dissemination of fake news has emerged as a significant threat, inflicting detrimental consequences across various dimensions of people's lives. Machine learning and deep learning…

Machine Learning · Computer Science 2024-02-14 Batool Lakzaei , Mostafa Haghir Chehreghani , Alireza Bagheri

Given a small set of labeled data and a large set of unlabeled data, semi-supervised learning (SSL) attempts to leverage the location of the unlabeled datapoints in order to create a better classifier than could be obtained from supervised…

Machine Learning · Computer Science 2022-05-25 Michael C. Burkhart , Kyle Shan

Node classification and graph classification are two graph learning problems that predict the class label of a node and the class label of a graph respectively. A node of a graph usually represents a real-world entity, e.g., a user in a…

Social and Information Networks · Computer Science 2022-09-07 Jia Li , Yongfeng Huang , Heng Chang , Yu Rong

In graph signal processing, learning the weighted connections between nodes from a set of sample signals is a fundamental task when the underlying relationships are not known a priori. This task is typically addressed by finding a graph…

Machine Learning · Computer Science 2025-06-30 Benjamin T. Brown , Haoxiang Zhang , Daniel L. Lau , Gonzalo R. Arce