English
Related papers

Related papers: Consistent nonparametric estimation for heavy-tail…

200 papers

We consider tensor factorizations based on sparse measurements of the components of relatively high rank tensors. The measurements are designed in a way that the underlying graph of interactions is a random graph. The setup will be useful…

Machine Learning · Statistics 2026-04-15 Angelo Giorgio Cavaliere , Riki Nagasawa , Shuta Yokoi , Tomoyuki Obuchi , Hajime Yoshino

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

Machine Learning · Computer Science 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

The popular Lasso approach for sparse estimation can be derived via marginalization of a joint density associated with a particular stochastic model. A different marginalization of the same probabilistic model leads to a different…

Machine Learning · Statistics 2013-02-28 Aleksandr Y. Aravkin , James V. Burke , Alessandro Chiuso , Gianluigi Pillonetto

Graph sparsification is a well-established technique for accelerating graph-based learning algorithms, which uses edge sampling to approximate dense graphs with sparse ones. Because the sparsification error is random and unknown, users must…

Machine Learning · Computer Science 2025-03-12 Siyao Wang , Miles E. Lopes

Graphons are general and powerful models for generating graphs of varying size. In this paper, we propose to directly model graphons using neural networks, obtaining Implicit Graphon Neural Representation (IGNR). Existing work in modeling…

Machine Learning · Computer Science 2023-04-03 Xinyue Xia , Gal Mishne , Yusu Wang

In this paper, we propose a general framework for constructing tight framelet systems on graphs with localized supports based on partition trees. Our construction of framelets provides a simple and efficient way to obtain the orthogonality…

Signal Processing · Electrical Eng. & Systems 2025-09-09 Ruigang Zheng , Xiaosheng Zhuang

This article studies the asymptotic properties of Bayesian or frequentist estimators of a vector of parameters related to structural properties of sequences of graphs. The estimators studied originate from a particular class of graphex…

Statistics Theory · Mathematics 2025-02-06 Zacharie Naulet , Judith Rousseau , François Caron

In an earlier paper the authors proved that limits of convergent graph sequences can be described by various structures, including certain 2-variable real functions called graphons, random graph models satisfying certain consistency…

Combinatorics · Mathematics 2009-02-10 László Lovász , Balázs Szegedy

We present the first linear time complexity randomized algorithms for unbiased approximation of the celebrated family of general random walk kernels (RWKs) for sparse graphs. This includes both labelled and unlabelled instances. The…

Machine Learning · Computer Science 2024-10-16 Krzysztof Choromanski , Isaac Reid , Arijit Sehanobish , Avinava Dubey

Graphical modelling techniques based on sparse selection have been applied to infer complex networks in many fields, including biology and medicine, engineering, finance, and social sciences. One structural feature of some of the networks…

Statistics Theory · Mathematics 2020-03-03 Annaliza McGillivray , Abbas Khalili , David A. Stephens

Neural networks are usually not the tool of choice for nonparametric high-dimensional problems where the number of input features is much larger than the number of observations. Though neural networks can approximate complex multivariate…

Methodology · Statistics 2019-06-25 Jean Feng , Noah Simon

Graph convolutional networks (GCNs) have well-documented performance in various graph learning tasks, but their analysis is still at its infancy. Graph scattering transforms (GSTs) offer training-free deep GCN models that extract features…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Vassilis N. Ioannidis , Siheng Chen , Georgios B. Giannakis

This paper proposes a new distributed algorithm for solving linear systems associated with a sparse graph under a generalised diagonal dominance assumption. The algorithm runs iteratively on each node of the graph, with low complexities on…

Signal Processing · Electrical Eng. & Systems 2019-04-30 Qianqian Cai , Zhaorong Zhang , Minyue Fu

We consider the question of averaging on a graph that has one sparse cut separating two subgraphs that are internally well connected. While there has been a large body of work devoted to algorithms for distributed averaging, nearly all…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-05-01 Hariharan Narayanan

We present a polynomial-time $(\alpha_{GW} + \varepsilon)$-approximation algorithm for the Maximum Cut problem on interval graphs and split graphs, where $\alpha_{GW} \approx 0.878$ is the approximation guarantee of the Goemans-Williamson…

Data Structures and Algorithms · Computer Science 2025-07-15 Jungho Ahn , Ian DeHaan , Eun Jung Kim , Euiwoong Lee

Graph Neural Networks (GNNs) have proved to be an effective representation learning framework for graph-structured data, and have achieved state-of-the-art performance on many practical predictive tasks, such as node classification, link…

Machine Learning · Computer Science 2021-04-13 Yang Ye , Shihao Ji

Graph pooling compresses graph information into a compact representation. State-of-the-art graph pooling methods follow a hierarchical approach, which reduces the graph size step-by-step. These methods must balance memory efficiency with…

Machine Learning · Computer Science 2024-02-23 Yunchong Song , Siyuan Huang , Xinbing Wang , Chenghu Zhou , Zhouhan Lin

We study sparse linear regression over a network of agents, modeled as an undirected graph and no server node. The estimation of the $s$-sparse parameter is formulated as a constrained LASSO problem wherein each agent owns a subset of the…

Machine Learning · Computer Science 2024-12-30 Marie Maros , Gesualdo Scutari , Ying Sun , Guang Cheng

Recent research has shown growing interest in modeling hypergraphs, which capture polyadic interactions among entities beyond traditional dyadic relations. However, most existing methodologies for hypergraphs face significant limitations,…

Methodology · Statistics 2025-11-04 Shihao Wu , Gongjun Xu , Ji Zhu

As real-world graphs expand in size, larger GNN models with billions of parameters are deployed. High parameter count in such models makes training and inference on graphs expensive and challenging. To reduce the computational and memory…

Machine Learning · Computer Science 2023-02-27 Hongwu Peng , Deniz Gurevin , Shaoyi Huang , Tong Geng , Weiwen Jiang , Omer Khan , Caiwen Ding