English
Related papers

Related papers: Improved large-scale graph learning through ridge …

200 papers

In this paper we introduce a notion of spectral approximation for directed graphs. While there are many potential ways one might define approximation for directed graphs, most of them are too strong to allow sparse approximations in…

Data Structures and Algorithms · Computer Science 2016-11-03 Michael B. Cohen , Jonathan Kelner , John Peebles , Richard Peng , Anup Rao , Aaron Sidford , Adrian Vladu

Graphs are naturally sparse objects that are used to study many problems involving networks, for example, distributed learning and graph signal processing. In some cases, the graph is not given, but must be learned from the problem and…

Machine Learning · Statistics 2017-08-31 Martin Sundin , Arun Venkitaraman , Magnus Jansson , Saikat Chatterjee

Let \phi(G) be the minimum conductance of an undirected graph G, and let 0=\lambda_1 <= \lambda_2 <=... <= \lambda_n <= 2 be the eigenvalues of the normalized Laplacian matrix of G. We prove that for any graph G and any k >= 2, \phi(G) =…

Data Structures and Algorithms · Computer Science 2013-01-24 Tsz Chiu Kwok , Lap Chi Lau , Yin Tat Lee , Shayan Oveis Gharan , Luca Trevisan

We consider the change-point detection problem of deciding, based on noisy measurements, whether an unknown signal over a given graph is constant or is instead piecewise constant over two connected induced subgraphs of relatively low cut…

Statistics Theory · Mathematics 2012-06-06 James Sharpnack , Alessandro Rinaldo , Aarti Singh

The attention mechanism has demonstrated superior performance for inference over nodes in graph neural networks (GNNs), however, they result in a high computational burden during both training and inference. We propose FastGAT, a method to…

Machine Learning · Computer Science 2020-10-06 Rakshith S Srinivasa , Cao Xiao , Lucas Glass , Justin Romberg , Jimeng Sun

Signal-processing on graphs has developed into a very active field of research during the last decade. In particular, the number of applications using frames constructed from graphs, like wavelets on graphs, has substantially increased. To…

Numerical Analysis · Mathematics 2015-09-24 Ana Susnjara , Nathanael Perraudin , Daniel Kressner , Pierre Vandergheynst

Spectral graph convolutional networks are generalizations of standard convolutional networks for graph-structured data using the Laplacian operator. A common misconception is the instability of spectral filters, i.e. the impossibility to…

Machine Learning · Computer Science 2020-12-21 Axel Nilsson , Xavier Bresson

Graph neural networks (GNNs) have become the standard learning architectures for graphs. GNNs have been applied to numerous domains ranging from quantum chemistry, recommender systems to knowledge graphs and natural language processing. A…

Machine Learning · Computer Science 2022-02-11 Vijay Prakash Dwivedi , Anh Tuan Luu , Thomas Laurent , Yoshua Bengio , Xavier Bresson

The graph Laplacian regularization term is usually used in semi-supervised representation learning to provide graph structure information for a model $f(X)$. However, with the recent popularity of graph neural networks (GNNs), directly…

Machine Learning · Computer Science 2020-12-22 Han Yang , Kaili Ma , James Cheng

We present the first single pass algorithm for computing spectral sparsifiers of graphs in the dynamic semi-streaming model. Given a single pass over a stream containing insertions and deletions of edges to a graph G, our algorithm…

Data Structures and Algorithms · Computer Science 2015-04-17 Michael Kapralov , Yin Tat Lee , Cameron Musco , Christopher Musco , Aaron Sidford

This paper presents our solution for optimization task of the 3rd ACM-China IPCC. By the complexity analysis, we identified three time-consuming subroutines of original algorithm: marking edges, computing pseudo inverse and sorting edges.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-15 Yuxuan Chen , Jiyan Qiu , Zidong Han , Chenhan Bai

Graph comparison is a fundamental operation in data mining and information retrieval. Due to the combinatorial nature of graphs, it is hard to balance the expressiveness of the similarity measure and its scalability. Spectral analysis…

Social and Information Networks · Computer Science 2020-03-04 Anton Tsitsulin , Marina Munkhoeva , Bryan Perozzi

Spectral clustering is one of the most popular methods for community detection in graphs. A key step in spectral clustering algorithms is the eigen decomposition of the $n{\times}n$ graph Laplacian matrix to extract its $k$ leading…

Machine Learning · Statistics 2018-09-10 Muni Sreenivas Pydi , Ambedkar Dukkipati

Laplacian Eigenvectors of the graph constructed from a data set are used in many spectral manifold learning algorithms such as diffusion maps and spectral clustering. Given a graph constructed from a random sample of a $d$-dimensional…

Machine Learning · Statistics 2015-10-29 Xu Wang

Graphs play a central role in modeling complex relationships in data, yet most graph learning methods falter when faced with cold-start nodes--new nodes lacking initial connections--due to their reliance on adjacency information. To tackle…

Machine Learning · Computer Science 2025-02-19 Yahel Jacobs , Reut Dayan , Uri Shaham

Generative graph models struggle to scale due to the need to predict the existence or type of edges between all node pairs. To address the resulting quadratic complexity, existing scalable models often impose restrictive assumptions such as…

Machine Learning · Computer Science 2024-05-24 Yiming Qin , Clement Vignac , Pascal Frossard

In this paper, we consider a ${\rm U}(1)$-connection graph, that is, a graph where each oriented edge is endowed with a unit modulus complex number that is conjugated under orientation flip. A natural replacement for the combinatorial…

Social and Information Networks · Computer Science 2024-03-21 Michaël Fanuel , Rémi Bardenet

This paper presents an approach to semi-supervised learning for the classification of data using the Lipschitz Learning on graphs. We develop a graph-based semi-supervised learning framework that leverages the properties of the infinity…

Machine Learning · Computer Science 2024-11-06 Farid Bozorgnia , Yassine Belkheiri , Abderrahim Elmoataz

Error accumulation is effective for gradient sparsification in distributed settings: initially-unselected gradient entries are eventually selected as their accumulated error exceeds a certain level. The accumulation essentially behaves as a…

Machine Learning · Computer Science 2026-02-17 Ali Bereyhi , Ben Liang , Gary Boudreau , Ali Afana

We consider the minimum-cut partitioning of a graph into more than two parts using spectral methods. While there exist well-established spectral algorithms for this problem that give good results, they have traditionally not been well…

Data Structures and Algorithms · Computer Science 2014-08-04 Maria A. Riolo , M. E. J. Newman