English
Related papers

Related papers: Evaluating Parameter Transfer in FALQON Across Gra…

200 papers

Graph neural networks (GNNs) have recently achieved state-of-the-art performance in many graph-based applications. Despite the high expressive power, they typically need to perform an expensive recursive neighborhood expansion in multiple…

Machine Learning · Computer Science 2022-06-10 Wentao Zhang , Ziqi Yin , Zeang Sheng , Wen Ouyang , Xiaosen Li , Yangyu Tao , Zhi Yang , Bin Cui

In this paper we consider the problem of transmission across a graph and how to effectively control/restrict it with limited resources. Transmission can represent information transfer across a social network, spread of a malicious virus…

Social and Information Networks · Computer Science 2020-10-13 Leiming Zhang , Brian M. Sadler , Rick S. Blum , Subhrajit Bhattacharya

In this work, we propose a novel decoding algorithm for short block codes based on an edge-weighted graph neural network (EW-GNN). The EW-GNN decoder operates on the Tanner graph with an iterative message-passing structure, which…

Information Theory · Computer Science 2022-11-15 Kou Tian , Chentao Yue , Changyang She , Yonghui Li , Branka Vucetic

A graphical model is a structured representation of locally dependent random variables. A traditional method to reason over these random variables is to perform inference using belief propagation. When provided with the true data generating…

Machine Learning · Computer Science 2021-03-17 Victor Garcia Satorras , Max Welling

Many modern learning tasks require models that can take inputs of varying sizes. Consequently, dimension-independent architectures have been proposed for domains where the inputs are graphs, sets, and point clouds. Recent work on graph…

Machine Learning · Computer Science 2026-02-12 Eitan Levin , Yuxin Ma , Mateo Díaz , Soledad Villar

We consider parameter estimation in distributed networks, where each sensor in the network observes an independent sample from an underlying distribution and has $k$ bits to communicate its sample to a centralized processor which computes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-23 Yanjun Han , Ayfer Özgür , Tsachy Weissman

Graphons are limit objects of sequences of graphs and are used to analyze the behavior of large graphs. Recently, graphon signal processing has been developed to study signal processing on large graphs. A major limitation of this approach…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Feng Ji , Xingchao Jian , Wee Peng Tay

Graph neural networks have been extensively studied for learning with inter-connected data. Despite this, recent evidence has revealed GNNs' deficiencies related to over-squashing, heterophily, handling long-range dependencies, edge…

Machine Learning · Computer Science 2023-06-16 Qitian Wu , Wentao Zhao , Zenan Li , David Wipf , Junchi Yan

Fine-tuning of self-supervised models is a powerful transfer learning method in a variety of fields, including speech processing, since it can utilize generic feature representations obtained from large amounts of unlabeled data.…

Multimedia · Computer Science 2022-12-07 Shinta Otake , Rei Kawakami , Nakamasa Inoue

Transformers, adapted from natural language processing, are emerging as a leading approach for graph representation learning. Contemporary graph transformers often treat nodes or edges as separate tokens. This approach leads to…

Machine Learning · Computer Science 2023-10-04 Zihan Pengmei , Zimu Li , Chih-chan Tien , Risi Kondor , Aaron R. Dinner

Intermediate-task transfer can benefit a wide range of NLP tasks with properly selected source datasets. However, it is computationally infeasible to experiment with all intermediate transfer combinations, making choosing a useful source…

Computation and Language · Computer Science 2022-10-24 Wangchunshu Zhou , Canwen Xu , Julian McAuley

Transfer learning is a powerful tool enabling model training with limited amounts of data. This technique is particularly useful in real-world problems where data availability is often a serious limitation. The simplest transfer learning…

Machine Learning · Computer Science 2023-03-03 Federica Gerace , Diego Doimo , Stefano Sarao Mannelli , Luca Saglietti , Alessandro Laio

Experiments with superconducting circuits require careful calibration of the applied pulses and fields over a large frequency range. This remains an ongoing challenge as commercial semiconductor electronics are not able to probe signals…

Graph Transformer is a new architecture that surpasses GNNs in graph learning. While there emerge inspiring algorithm advancements, their practical adoption is still limited, particularly on real-world graphs involving up to millions of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-22 Meng Zhang , Jie Sun , Qinghao Hu , Peng Sun , Zeke Wang , Yonggang Wen , Tianwei Zhang

The dominant graph-to-sequence transduction models employ graph neural networks for graph representation learning, where the structural information is reflected by the receptive field of neurons. Unlike graph neural networks that restrict…

Computation and Language · Computer Science 2019-12-03 Deng Cai , Wai Lam

Graph Neural Networks (GNNs) have become popular across a diverse set of tasks in exploring structural relationships between entities. However, due to the highly connected structure of the datasets, distributed training of GNNs on…

Machine Learning · Computer Science 2025-09-08 Arefin Niam , Tevfik Kosar , M S Q Zulkar Nine

We consider the problem of energy-efficient broadcasting on dense ad-hoc networks. Ad-hoc networks are generally modeled using random geometric graphs (RGGs). Here, nodes are deployed uniformly in a square area around the origin, and any…

Information Theory · Computer Science 2022-01-19 B. R. Vinay Kumar , Navin Kashyap , D. Yogeshwaran

Graph Neural Networks (GNNs) are eminently suitable for wireless resource management, thanks to their scalability, but they still face computational challenges in large-scale, dense networks in classical computers. The integration of…

Information Theory · Computer Science 2026-01-27 Le Tung Giang , Nguyen Xuan Tung , Trinh Van Chien , Lajos Hanzo , Won-Joo Hwang

We demonstrate high resolution scanning fluorescence resonance energy transfer 10 microscopy between a single nitrogen-vacancy center as donor and graphene as acceptor. 11 Images with few nanometer resolution of single and multilayer…

Mesoscale and Nanoscale Physics · Physics 2015-06-12 J. Tisler , T. Oeckinghaus , R. Stöhr , R. Kolesov , F. Reinhard , J. Wrachtrup

Graph neural networks operate on graph-structured data via exchanging messages along edges. One limitation of this message passing paradigm is the over-squashing problem. Over-squashing occurs when messages from a node's expanded receptive…

Machine Learning · Computer Science 2023-11-15 Thomas Christie , Yu He