English
Related papers

Related papers: One-Shot Multi-Rate Pruning of Graph Convolutional…

200 papers

Multi-view data containing complementary and consensus information can facilitate representation learning by exploiting the intact integration of multi-view features. Because most objects in real world often have underlying connections,…

Machine Learning · Computer Science 2023-08-15 Zhaoliang Chen , Lele Fu , Shunxin Xiao , Shiping Wang , Claudia Plant , Wenzhong Guo

The evolving capabilities of large language models are accompanied by growing sizes and deployment costs, necessitating effective inference optimisation techniques. We propose a novel pruning method utilising centrality measures from graph…

Machine Learning · Computer Science 2024-12-02 David Hoffmann , Kailash Budhathoki , Matthaeus Kleindessner

Though network pruning receives popularity in reducing the complexity of convolutional neural networks (CNNs), it remains an open issue to concurrently maintain model accuracy as well as achieve significant speedups on general CPUs. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Mingbao Lin , Yuxin Zhang , Yuchao Li , Bohong Chen , Fei Chao , Mengdi Wang , Shen Li , Yonghong Tian , Rongrong Ji

Convolutional Neural Network (CNN) has demonstrated impressive ability to represent hyperspectral images and to achieve promising results in hyperspectral image classification. However, traditional CNN models can only operate convolution on…

Image and Video Processing · Electrical Eng. & Systems 2019-05-16 Sheng Wan , Chen Gong , Ping Zhong , Bo Du , Lefei Zhang , Jian Yang

Convolutional neural networks (CNN) play a major role in image processing tasks like image classification, object detection, semantic segmentation. Very often CNN networks have from several to hundred stacked layers with several megabytes…

Machine Learning · Computer Science 2020-02-18 Marcin Pietron , Maciej Wielgosz

Recently, graph convolutional networks (GCNs) have shown great potential for the task of graph matching. It can integrate graph node feature embedding, node-wise affinity learning and matching optimization together in a unified end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Bo Jiang , Pengfei Sun , Jin Tang , Bin Luo

Machine learning techniques for road networks hold the potential to facilitate many important transportation applications. Graph Convolutional Networks (GCNs) are neural networks that are capable of leveraging the structure of a road…

Machine Learning · Computer Science 2020-07-23 Tobias Skovgaard Jepsen , Christian S. Jensen , Thomas Dyhre Nielsen

Neural networks efficiently encode learned information within their parameters. Consequently, many tasks can be unified by treating neural networks themselves as input data. When doing so, recent studies demonstrated the importance of…

Machine Learning · Computer Science 2024-01-02 Derek Lim , Haggai Maron , Marc T. Law , Jonathan Lorraine , James Lucas

Weight pruning is a technique to make Deep Neural Network (DNN) inference more computationally efficient by reducing the number of model parameters over the course of training. However, most weight pruning techniques generally does not…

Machine Learning · Computer Science 2022-02-03 Bradley McDanel , Helia Dinh , John Magallanes

Graph Convolutional Networks (GCNs) have shown very powerful for graph data representation and learning tasks. Existing GCNs usually conduct feature aggregation on a fixed neighborhood graph in which each node computes its representation by…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Bo Jiang , Beibei Wang , Jin Tang , Bin Luo

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

Machine Learning · Computer Science 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

Neural network pruning is an important step in design process of efficient neural networks for edge devices with limited computational power. Pruning is a form of knowledge transfer from the weights of the original network to a smaller…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Alexey Kruglov

A dynamic graph (DG) is frequently encountered in numerous real-world scenarios. Consequently, A dynamic graph convolutional network (DGCN) has been successfully applied to perform precise representation learning on a DG. However,…

Machine Learning · Computer Science 2025-04-23 Minglian Han

Graph Neural Networks (GNNs) tend to suffer from high computation costs due to the exponentially increasing scale of graph data and the number of model parameters, which restricts their utility in practical applications. To this end, some…

Machine Learning · Computer Science 2022-07-20 Chuang Liu , Xueqi Ma , Yibing Zhan , Liang Ding , Dapeng Tao , Bo Du , Wenbin Hu , Danilo Mandic

Magnitude Pruning is a staple lightweight network design method which seeks to remove connections with the smallest magnitude. This process is either achieved in a structured or unstructured manner. While structured pruning allows reaching…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Hichem Sahbi

The first provably efficient algorithm for learning graph neural networks (GNNs) with one hidden layer for node information convolution is provided in this paper. Two types of GNNs are investigated, depending on whether labels are attached…

Machine Learning · Computer Science 2020-12-08 Qunwei Li , Shaofeng Zou , Wenliang Zhong

In this paper, we design lightweight graph convolutional networks (GCNs) using a particular class of regularizers, dubbed as phase-field models (PFMs). PFMs exhibit a bi-phase behavior using a particular ultra-local term that allows…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Hichem Sahbi

Neural network pruning techniques reduce the number of parameters without compromising predicting ability of a network. Many algorithms have been developed for pruning both over-parameterized fully-connected networks (FCNs) and…

Machine Learning · Computer Science 2021-05-24 Xin Qian , Diego Klabjan

Graph Convolutional Networks (GCNs) are widely used in graph-based applications, such as social networks and recommendation systems. Nevertheless, large-scale graphs or deep aggregation layers in full-batch GCNs consume significant GPU…

Machine Learning · Computer Science 2024-10-15 Shengwei Ji , Yujie Tian , Fei Liu , Xinlu Li , Le Wu

This paper investigates the feasibility of using Graph Neural Networks (GNNs) for classical motion planning problems. We propose guiding both continuous and discrete planning algorithms using GNNs' ability to robustly encode the topology of…

Robotics · Computer Science 2020-12-15 Arbaaz Khan , Alejandro Ribeiro , Vijay Kumar , Anthony G. Francis