中文
相关论文

相关论文: Efficient Mixed Precision Quantization in Graph Ne…

200 篇论文

We introduce a method to train Quantized Neural Networks (QNNs) --- neural networks with extremely low precision (e.g., 1-bit) weights and activations, at run-time. At train-time the quantized weights and activations are used for computing…

神经与进化计算 · 计算机科学 2016-09-23 Itay Hubara , Matthieu Courbariaux , Daniel Soudry , Ran El-Yaniv , Yoshua Bengio

Graph Neural Networks (GNNs) have emerged as powerful tools for learning representations of graph-structured data. In addition to real-valued GNNs, quaternion GNNs also perform well on tasks on graph-structured data. With the aim of…

机器学习 · 计算机科学 2025-03-03 Rucha Bhalchandra Joshi , Sagar Prakash Barad , Nidhi Tiwari , Subhankar Mishra

Subgraph isomorphism counting is an important problem on graphs, as many graph-based tasks exploit recurring subgraph patterns. Classical methods usually boil down to a backtracking framework that needs to navigate a huge search space with…

机器学习 · 计算机科学 2024-01-25 Xingtong Yu , Zemin Liu , Yuan Fang , Xinming Zhang

Edge intelligence has arisen as a promising computing paradigm for supporting miscellaneous smart applications that rely on machine learning techniques. While the community has extensively investigated multi-tier edge deployment for…

分布式、并行与集群计算 · 计算机科学 2022-11-01 Liekang Zeng , Chongyu Yang , Peng Huang , Zhi Zhou , Shuai Yu , Xu Chen

While kernel methods and Graph Neural Networks offer complementary strengths, integrating the two has posed challenges in efficiency and scalability. The Graph Neural Tangent Kernel provides a theoretical bridge by interpreting GNNs through…

机器学习 · 计算机科学 2025-07-17 Lin Wang , Shijie Wang , Sirui Huang , Qing Li

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

机器学习 · 计算机科学 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin

Mixed-precision Deep Neural Networks achieve the energy efficiency and throughput needed for hardware deployment, particularly when the resources are limited, without sacrificing accuracy. However, the optimal per-layer bit precision that…

机器学习 · 计算机科学 2022-08-15 Mariam Rakka , Mohammed E. Fouda , Pramod Khargonekar , Fadi Kurdahi

In recent studies, neural message passing has proved to be an effective way to design graph neural networks (GNNs), which have achieved state-of-the-art performance in many graph-based tasks. However, current neural-message passing…

机器学习 · 计算机科学 2021-04-21 Wentao Zhang , Yu Shen , Zheyu Lin , Yang Li , Xiaosen Li , Wen Ouyang , Yangyu Tao , Zhi Yang , Bin Cui

This paper presents a novel end-to-end methodology for enabling the deployment of low-error deep networks on microcontrollers. To fit the memory and computational limitations of resource-constrained edge-devices, we exploit mixed…

机器学习 · 计算机科学 2019-05-31 Manuele Rusci , Alessandro Capotondi , Luca Benini

Recently, efforts have been made in the community to design new Graph Neural Networks (GNN), as limitations of Message Passing Neural Networks became more apparent. This led to the appearance of Graph Transformers using global graph…

量子物理 · 物理学 2022-10-20 Slimane Thabet , Romain Fouilland , Loic Henriet

Deep Neural Networks (DNNs) have achieved extraordinary performance in various application domains. To support diverse DNN models, efficient implementations of DNN inference on edge-computing platforms, e.g., ASICs, FPGAs, and embedded…

机器学习 · 计算机科学 2020-12-15 Sung-En Chang , Yanyu Li , Mengshu Sun , Runbin Shi , Hayden K. -H. So , Xuehai Qian , Yanzhi Wang , Xue Lin

Graph neural networks (GNNs) have achieved tremendous success on multiple graph-based learning tasks by fusing network structure and node features. Modern GNN models are built upon iterative aggregation of neighbor's/proximity features by…

机器学习 · 计算机科学 2021-06-15 Susheel Suresh , Vinith Budde , Jennifer Neville , Pan Li , Jianzhu Ma

Networks are ubiquitous in the real world. Link prediction, as one of the key problems for network-structured data, aims to predict whether there exists a link between two nodes. The traditional approaches are based on the explicit…

机器学习 · 计算机科学 2021-06-01 Wei Wu , Bin Li , Chuan Luo , Wolfgang Nejdl

Convolutional Neural Networks (CNNs) have proven to be a powerful state-of-the-art method for image classification tasks. One drawback however is the high computational complexity and high memory consumption of CNNs which makes them…

计算机视觉与模式识别 · 计算机科学 2021-02-04 Rishabh Goyal , Joaquin Vanschoren , Victor van Acht , Stephan Nijssen

Graph neural networks (GNN) are deep learning architectures for graphs. Essentially, a GNN is a distributed message passing algorithm, which is controlled by parameters learned from data. It operates on the vertices of a graph: in each…

计算机科学中的逻辑 · 计算机科学 2024-05-21 Martin Grohe , Eran Rosenbluth

Until recently, researchers used machine learning methods to compensate for hardware imperfections at the symbol level, indicating that optimum radio-frequency transceiver performance is possible. Nevertheless, such approaches neglect the…

By conceiving physical systems as 3D many-body point clouds, geometric graph neural networks (GNNs), such as SE(3)/E(3) equivalent GNNs, have showcased promising performance. In particular, their effective message-passing mechanics make…

机器学习 · 计算机科学 2024-01-30 Weitao Du , Shengchao Liu , Xuecang Zhang

Deep neural networks (NNs) are considered a powerful tool for balancing the performance and complexity of multiple-input multiple-output (MIMO) receivers due to their accurate feature extraction, high parallelism, and excellent inference…

信息论 · 计算机科学 2024-10-28 Xingyu Zhou , Jing Zhang , Chao-Kai Wen , Shi Jin , Shuangfeng Han

Hypergraph, an expressive structure with flexibility to model the higher-order correlations among entities, has recently attracted increasing attention from various research domains. Despite the success of Graph Neural Networks (GNNs) for…

机器学习 · 计算机科学 2021-05-04 Jing Huang , Jie Yang

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

机器学习 · 计算机科学 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister