中文
相关论文

相关论文: Regularizing Semi-supervised Graph Convolutional N…

200 篇论文

Semi-supervised learning (SSL) over graph-structured data emerges in many network science applications. To efficiently manage learning over graphs, variants of graph neural networks (GNNs) have been developed recently. By succinctly…

机器学习 · 计算机科学 2021-10-22 Alireza Sadeghi , Meng Ma , Bingcong Li , Georgios B. Giannakis

Geometric data analysis relies on graphs that are either given as input or inferred from data. These graphs are often treated as "correct" when solving downstream tasks such as graph signal denoising. But real-world graphs are known to…

信号处理 · 电气工程与系统科学 2023-10-17 Valentin Debarnot , Vinith Kishore , Cheng Shi , Ivan Dokmanić

Proper regularization is critical for speeding up training, improving generalization performance, and learning compact models that are cost efficient. We propose and analyze regularized gradient descent algorithms for learning shallow…

机器学习 · 计算机科学 2018-06-08 Samet Oymak

Manifold regularization is a commonly used technique in semi-supervised learning. It enforces the classification rule to be smooth with respect to the data-manifold. Here, we derive sample complexity bounds based on pseudo-dimension for…

机器学习 · 计算机科学 2020-07-31 Alexander Mey , Tom Viering , Marco Loog

A common issue in graph learning under the semi-supervised setting is referred to as gradient scarcity. That is, learning graphs by minimizing a loss on a subset of nodes causes edges between unlabelled nodes that are far from labelled ones…

机器学习 · 计算机科学 2023-03-27 Hashem Ghanem , Samuel Vaiter , Nicolas Keriven

Oversmoothing has been assumed to be the major cause of performance drop in deep graph convolutional networks (GCNs). In this paper, we propose a new view that deep GCNs can actually learn to anti-oversmooth during training. This work…

机器学习 · 计算机科学 2020-06-19 Chaoqi Yang , Ruijie Wang , Shuochao Yao , Shengzhong Liu , Tarek Abdelzaher

Graph-based methods play an important role in unsupervised and semi-supervised learning tasks by taking into account the underlying geometry of the data set. In this paper, we consider a statistical setting for semi-supervised learning and…

机器学习 · 计算机科学 2015-02-17 Aamir Anis , Aly El Gamal , A. Salman Avestimehr , Antonio Ortega

The common graph Laplacian regularizer is well-established in semi-supervised learning and spectral dimensionality reduction. However, as a first-order regularizer, it can lead to degenerate functions in high-dimensional manifolds. The…

计算机视觉与模式识别 · 计算机科学 2016-02-12 Kwang In Kim , James Tompkin , Hanspeter Pfister , Christian Theobalt

Minimization of regularized losses is a principled approach to weak supervision well-established in deep learning, in general. However, it is largely overlooked in semantic segmentation currently dominated by methods mimicking full…

计算机视觉与模式识别 · 计算机科学 2018-04-12 Meng Tang , Federico Perazzi , Abdelaziz Djelouah , Ismail Ben Ayed , Christopher Schroers , Yuri Boykov

Graph-based semi-supervised learning is one of the most popular methods in machine learning. Some of its theoretical properties such as bounds for the generalization error and the convergence of the graph Laplacian regularizer have been…

机器学习 · 统计学 2019-04-12 Chengan Du , Yunpeng Zhao , Feng Wang

Inspired by the extensive success of deep learning, graph neural networks (GNNs) have been proposed to learn expressive node representations and demonstrated promising performance in various graph learning tasks. However, existing endeavors…

机器学习 · 计算机科学 2022-04-05 Kaize Ding , Jianling Wang , James Caverlee , Huan Liu

Convolutional neural network training can suffer from diverse issues like exploding or vanishing gradients, scaling-based weight space symmetry and covariant-shift. In order to address these issues, researchers develop weight regularization…

计算机视觉与模式识别 · 计算机科学 2021-03-12 Theodoros Georgiou , Sebastian Schmitt , Thomas Bäck , Wei Chen , Michael Lew

This paper proposes a novel algorithm for semisupervised learning. This algorithm learns graph cuts that maximize the margin with respect to the labels induced by the harmonic function solution. We motivate the approach, compare it to…

机器学习 · 计算机科学 2026-04-30 Branislav Kveton , Michal Valko , Ali Rahimi , Ling Huang

Graph condensation aims to reduce the size of a large-scale graph dataset by synthesizing a compact counterpart without sacrificing the performance of Graph Neural Networks (GNNs) trained on it, which has shed light on reducing the…

机器学习 · 计算机科学 2024-06-19 Yuchen Zhang , Tianle Zhang , Kai Wang , Ziyao Guo , Yuxuan Liang , Xavier Bresson , Wei Jin , Yang You

There has been a surge of recent interest in learning representations for graph-structured data. Graph representation learning methods have generally fallen into three main categories, based on the availability of labeled data. The first,…

机器学习 · 计算机科学 2022-04-13 Ines Chami , Sami Abu-El-Haija , Bryan Perozzi , Christopher Ré , Kevin Murphy

Unsupervised/self-supervised pre-training methods for graph representation learning have recently attracted increasing research interests, and they are shown to be able to generalize to various downstream applications. Yet, the adversarial…

机器学习 · 计算机科学 2021-05-31 Jiarong Xu , Yang Yang , Junru Chen , Chunping Wang , Xin Jiang , Jiangang Lu , Yizhou Sun

Recommendation models utilizing Graph Convolutional Networks (GCNs) have achieved state-of-the-art performance, as they can integrate both the node information and the topological structure of the user-item interaction graph. However, these…

信息检索 · 计算机科学 2022-11-28 Xin Zhou , Donghui Lin , Yong Liu , Chunyan Miao

We study the task of semi-supervised learning on multilayer graphs by taking into account both labeled and unlabeled observations together with the information encoded by each individual graph layer. We propose a regularizer based on the…

机器学习 · 计算机科学 2019-10-31 Pedro Mercado , Francesco Tudisco , Matthias Hein

The recent promising achievements of deep learning rely on the large amount of labeled data. Considering the abundance of data on the web, most of them do not have labels at all. Therefore, it is important to improve generalization…

神经与进化计算 · 计算机科学 2016-01-20 Sheng-Yi Bai , Sebastian Agethen , Ting-Hsuan Chao , Winston Hsu

Graph convolutional networks (GCNs) have shown promising results in processing graph data by extracting structure-aware features. This gave rise to extensive work in geometric deep learning, focusing on designing network architectures that…

机器学习 · 计算机科学 2022-01-20 Yimeng Min , Frederik Wenkel , Guy Wolf