English
Related papers

Related papers: Hcore-Init: Neural Network Initialization based on…

200 papers

In the brain, the structure of a network of neurons defines how these neurons implement the computations that underlie the mind and the behavior of animals and humans. Provided that we can describe the network of neurons as a graph, we can…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Gustavo Borges Moreno e Mello , Vibeke Devold Valderhaug , Sidney Pontes-Filho , Evi Zouganeli , Ioanna Sandvig , Stefano Nichele

Graph neural networks (GNNs) have shown advantages in graph-based analysis tasks. However, most existing methods have the homogeneity assumption and show poor performance on heterophilic graphs, where the linked nodes have dissimilar…

Machine Learning · Computer Science 2024-04-16 Tianhao Peng , Wenjun Wu , Haitao Yuan , Zhifeng Bao , Zhao Pengrui , Xin Yu , Xuetao Lin , Yu Liang , Yanjun Pu

Standard deep learning architectures used for classification generate label predictions with a projection head and softmax activation function. Although successful, these methods fail to leverage the relational information between samples…

Machine Learning · Computer Science 2025-12-10 Jason Brown , Bohan Chen , Harris Hardiman-Mostow , Jeff Calder , Andrea L. Bertozzi

Graph Neural Networks (GNNs) are popular machine learning methods for modeling graph data. A lot of GNNs perform well on homophily graphs while having unsatisfactory performance on heterophily graphs. Recently, some researchers turn their…

Machine Learning · Computer Science 2022-09-20 Wendong Bi , Lun Du , Qiang Fu , Yanlin Wang , Shi Han , Dongmei Zhang

Heterogeneous graphs generally refers to graphs with different types of nodes and edges. A common approach for extracting useful information from heterogeneous graphs is to use meta-graphs, which can be seen as a special kind of directed…

Machine Learning · Computer Science 2023-09-04 Hansi Yang , Peiyu Zhang , Quanming Yao

Graph neural networks (GNNs) are a popular class of machine learning models whose major advantage is their ability to incorporate a sparse and discrete dependency structure between data points. Unfortunately, GNNs can only be used when such…

Machine Learning · Computer Science 2020-06-22 Luca Franceschi , Mathias Niepert , Massimiliano Pontil , Xiao He

Recent work on Graph Neural Networks has demonstrated that self-supervised pretraining can further enhance performance on downstream graph, link, and node classification tasks. However, the efficacy of pretraining tasks has not been fully…

Machine Learning · Computer Science 2023-03-28 Jonathan Pilault , Michael Galkin , Bahare Fatemi , Perouz Taslakian , David Vasquez , Christopher Pal

This paper presents a general graph representation learning framework called DeepGL for learning deep node and edge representations from large (attributed) graphs. In particular, DeepGL begins by deriving a set of base features (e.g.,…

Machine Learning · Statistics 2017-10-17 Ryan A. Rossi , Rong Zhou , Nesreen K. Ahmed

Data augmentation has been widely used to improve generalizability of machine learning models. However, comparatively little work studies data augmentation for graphs. This is largely due to the complex, non-Euclidean structure of graphs,…

Machine Learning · Computer Science 2020-12-03 Tong Zhao , Yozen Liu , Leonardo Neves , Oliver Woodford , Meng Jiang , Neil Shah

The employment of convolutional neural networks has achieved unprecedented performance in the task of image restoration for a variety of degradation factors. However, high-performance networks have been specifically designed for a single…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Xing Liu , Masanori Suganuma , Xiyang Luo , Takayuki Okatani

In this paper, we propose a method, based on graph signal processing, to optimize the choice of $k$ in $k$-nearest neighbor graphs ($k$NNGs). $k$NN is one of the most popular approaches and is widely used in machine learning and signal…

Machine Learning · Computer Science 2024-01-17 Asuka Tamaru , Junya Hara , Hiroshi Higashi , Yuichi Tanaka , Antonio Ortega

deepstruct connects deep learning models and graph theory such that different graph structures can be imposed on neural networks or graph structures can be extracted from trained neural network models. For this, deepstruct provides deep…

Machine Learning · Computer Science 2021-12-15 Julian Stier , Michael Granitzer

This paper presents a graph signal processing algorithm to uncover the intrinsic low-rank components and the underlying graph of a high-dimensional, graph-smooth and grossly-corrupted dataset. In our problem formulation, we assume that the…

Image and Video Processing · Electrical Eng. & Systems 2018-01-09 Rui Liu , Hossein Nejati , Ngai-Man Cheung

Graph representation learning (a.k.a. network embedding) is a significant topic of network analysis, due to its effectiveness to support various graph inference tasks. In this paper, we study the representation learning with multiple…

Social and Information Networks · Computer Science 2023-05-17 Meng Qin

Optimization problems over dynamic networks have been extensively studied and widely used in the past decades to formulate numerous real-world problems. However, (1) traditional optimization-based approaches do not scale to large networks,…

Machine Learning · Computer Science 2023-05-17 Daniele Gammelli , James Harrison , Kaidi Yang , Marco Pavone , Filipe Rodrigues , Francisco C. Pereira

Mining dense subgraphs where vertices connect closely with each other is a common task when analyzing graphs. A very popular notion in subgraph analysis is core decomposition. Recently, Esfahani et al. presented a probabilistic core…

Machine Learning · Statistics 2023-03-29 Yang Guo , Xuekui Zhang , Fatemeh Esfahani , Venkatesh Srinivasan , Alex Thomo , Li Xing

Graph Neural Networks (GNNs) draw their strength from explicitly modeling the topological information of structured data. However, existing GNNs suffer from limited capability in capturing the hierarchical graph representation which plays…

Machine Learning · Computer Science 2021-03-30 Jinyu Yang , Peilin Zhao , Yu Rong , Chaochao Yan , Chunyuan Li , Hehuan Ma , Junzhou Huang

Hypergraphs, increasingly utilised to model complex and diverse relationships in modern networks, have gained significant attention for representing intricate higher-order interactions. Among various challenges, cohesive subgraph discovery…

Social and Information Networks · Computer Science 2025-07-14 Dahee Kim , Hyewon Kim , Song Kim , Minseok Kim , Junghoon Kim , Yeon-Chang Lee , Sungsu Lim

We study the problem of graph structure identification, i.e., of recovering the graph of dependencies among time series. We model these time series data as components of the state of linear stochastic networked dynamical systems. We assume…

Machine Learning · Computer Science 2023-06-29 Sérgio Machado , Anirudh Sridhar , Paulo Gil , Jorge Henriques , José M. F. Moura , Augusto Santos

A popular model to measure network stability is the $k$-core, that is the maximal induced subgraph in which every vertex has degree at least $k$. For example, $k$-cores are commonly used to model the unraveling phenomena in social networks.…

Data Structures and Algorithms · Computer Science 2020-07-08 Fedor V. Fomin , Danil Sagunov , Kirill Simonov