English
Related papers

Related papers: SGQuant: Squeezing the Last Bit on Graph Neural Ne…

200 papers

Graph Convolutional Networks (GCNs) achieve an impressive performance due to the remarkable representation ability in learning the graph information. However, GCNs, when implemented on a deep network, require expensive computation power,…

Machine Learning · Computer Science 2022-08-03 Zulun Zhu , Jiaying Peng , Jintang Li , Liang Chen , Qi Yu , Siqiang Luo

The advent of Graph Neural Networks (GNNs) has revolutionized the field of machine learning, offering a novel paradigm for learning on graph-structured data. Unlike traditional neural networks, GNNs are capable of capturing complex…

Hardware Architecture · Computer Science 2024-06-26 Kaustubh Shivdikar

Graph Neural Networks (GNN) have demonstrated state-of-the-art performance in numerous scientific and high-performance computing (HPC) applications. Recent work suggests that "souping" (combining) individually trained GNNs into a single…

Machine Learning · Computer Science 2025-03-17 Joseph Zuber , Aishwarya Sarkar , Joseph Jennings , Ali Jannesari

In the low-bit quantization field, training Binary Neural Networks (BNNs) is the extreme solution to ease the deployment of deep models on resource-constrained devices, having the lowest storage cost and significantly cheaper bit-wise…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yikai Wang , Yi Yang , Fuchun Sun , Anbang Yao

Deep neural networks (DNNs) have demonstrated their great potential in recent years, exceeding the per-formance of human experts in a wide range of applications. Due to their large sizes, however, compressiontechniques such as weight…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Wentao Chen , Hailong Qiu , Jian Zhuang , Chutong Zhang , Yu Hu , Qing Lu , Tianchen Wang , Yiyu Shi , Meiping Huang , Xiaowe Xu

The exponential increase in Internet of Things (IoT) devices coupled with 6G pushing towards higher data rates and connected devices has sparked a surge in data. Consequently, harnessing the full potential of data-driven machine learning…

Machine Learning · Computer Science 2025-10-23 Sabarish Krishna Moorthy , Jithin Jagannath

Effective employment of deep neural networks (DNNs) in mobile devices and embedded systems is hampered by requirements for memory and computational power. This paper presents a non-uniform quantization approach which allows for dynamic…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-05 Niccoló Nicodemo , Gaurav Naithani , Konstantinos Drossos , Tuomas Virtanen , Roberto Saletti

Quantization is a technique for creating efficient Deep Neural Networks (DNNs), which involves performing computations and storing tensors at lower bit-widths than f32 floating point precision. Quantization reduces model size and inference…

Machine Learning · Computer Science 2023-10-02 Eliska Kloberdanz , Wei Le

Quantum neural networks (QNNs), an interdisciplinary field of quantum computing and machine learning, have attracted tremendous research interests due to the specific quantum advantages. Despite lots of efforts developed in computer vision…

Quantum Physics · Physics 2022-11-15 Kaixiong Zhou , Zhenyu Zhang , Shengyuan Chen , Tianlong Chen , Xiao Huang , Zhangyang Wang , Xia Hu

The intensive computation and memory requirements of generative adversarial neural networks (GANs) hinder its real-world deployment on edge devices such as smartphones. Despite the success in model reduction of CNNs, neural network…

Neural and Evolutionary Computing · Computer Science 2019-01-25 Peiqi Wang , Dongsheng Wang , Yu Ji , Xinfeng Xie , Haoxuan Song , XuXin Liu , Yongqiang Lyu , Yuan Xie

Quantization of weights and activations in Deep Neural Networks (DNNs) is a powerful technique for network compression, and has enjoyed significant attention and success. However, much of the inference-time benefit of quantization is…

Performance · Computer Science 2019-12-13 Andrew Anderson , David Gregg

Graph Neural Networks (GNNs) bring the power of deep representation learning to graph and relational data and achieve state-of-the-art performance in many applications. GNNs compute node representations by taking into account the topology…

Machine Learning · Computer Science 2021-09-10 Maria Kalantzi , George Karypis

The attention mechanism has demonstrated superior performance for inference over nodes in graph neural networks (GNNs), however, they result in a high computational burden during both training and inference. We propose FastGAT, a method to…

Machine Learning · Computer Science 2020-10-06 Rakshith S Srinivasa , Cao Xiao , Lucas Glass , Justin Romberg , Jimeng Sun

Graph neural networks (GNNs) have shown significant accuracy improvements in a variety of graph learning domains, sparking considerable research interest. To translate these accuracy improvements into practical applications, it is essential…

Hardware Architecture · Computer Science 2023-08-17 Shuwen Lu , Zhihui Zhang , Cong Guo , Jingwen Leng , Yangjie Zhou , Minyi Guo

Graph Neural Network (GNN) ushered in a new era of machine learning with interconnected datasets. While traditional neural networks can only be trained on independent samples, GNN allows for the inclusion of inter-sample interactions in the…

Machine Learning · Computer Science 2023-12-29 Christopher Adnel , Islem Rekik

Graph similarity search is among the most important graph-based applications, e.g. finding the chemical compounds that are most similar to a query compound. Graph similarity computation, such as Graph Edit Distance (GED) and Maximum Common…

Machine Learning · Computer Science 2020-03-03 Yunsheng Bai , Hao Ding , Song Bian , Ting Chen , Yizhou Sun , Wei Wang

Graph Neural Networks (GNNs) have emerged as powerful tools for supervised machine learning over graph-structured data, while sampling-based node representation learning is widely utilized in unsupervised learning. However, scalability…

Machine Learning · Computer Science 2024-07-23 Vipul Gupta , Xin Chen , Ruoyun Huang , Fanlong Meng , Jianjun Chen , Yujun Yan

Graph Convolutional Networks (GCNs) are widely used in graph-based applications, such as social networks and recommendation systems. Nevertheless, large-scale graphs or deep aggregation layers in full-batch GCNs consume significant GPU…

Machine Learning · Computer Science 2024-10-15 Shengwei Ji , Yujie Tian , Fei Liu , Xinlu Li , Le Wu

Graph Neural Networks (GNNs) have emerged as a powerful framework for modeling complex interconnected systems, hence making them particularly well-suited to address the growing challenges of next-generation Internet of Things (NG-IoT)…

Information Theory · Computer Science 2025-09-18 Nguyen Xuan Tung , Le Tung Giang , Bui Duc Son , Seon Geun Jeong , Trinh Van Chien , Won Joo Hwang , Lajos Hanzo

Edge intelligence has arisen as a promising computing paradigm for supporting miscellaneous smart applications that rely on machine learning techniques. While the community has extensively investigated multi-tier edge deployment for…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Liekang Zeng , Chongyu Yang , Peng Huang , Zhi Zhou , Shuai Yu , Xu Chen