English
Related papers

Related papers: Filter Grafting for Deep Neural Networks: Reason, …

200 papers

Graph Convolution Network (GCN) has become new state-of-the-art for collaborative filtering. Nevertheless, the reasons of its effectiveness for recommendation are not well understood. Existing work that adapts GCN to recommendation lacks…

Information Retrieval · Computer Science 2020-07-08 Xiangnan He , Kuan Deng , Xiang Wang , Yan Li , Yongdong Zhang , Meng Wang

Modern deep neural networks require a significant amount of computing time and power to train and deploy, which limits their usage on edge devices. Inspired by the iterative weight pruning in the Lottery Ticket Hypothesis, we propose…

Machine Learning · Computer Science 2022-07-15 John Tan Chong Min , Mehul Motani

\textbf{G}raph \textbf{C}onvolutional \textbf{N}etwork (\textbf{GCN}) is widely used in graph data learning tasks such as recommendation. However, when facing a large graph, the graph convolution is very computationally expensive thus is…

Machine Learning · Computer Science 2021-01-19 Wenhui Yu , Zheng Qin

We present an analysis into the inner workings of Convolutional Neural Networks (CNNs) for processing text. CNNs used for computer vision can be interpreted by projecting filters into image space, but for discrete sequence inputs CNNs…

Computation and Language · Computer Science 2020-04-29 Alon Jacovi , Oren Sar Shalom , Yoav Goldberg

Graph convolutional networks (GCNs) have recently enabled a popular class of algorithms for collaborative filtering (CF). Nevertheless, the theoretical underpinnings of their empirical successes remain elusive. In this paper, we endeavor to…

Information Retrieval · Computer Science 2021-08-18 Yifei Shen , Yongji Wu , Yao Zhang , Caihua Shan , Jun Zhang , Khaled B. Letaief , Dongsheng Li

Many convolutional neural networks (CNNs) rely on progressive downsampling of their feature maps to increase the network's receptive field and decrease computational cost. However, this comes at the price of losing granularity in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Robin Hesse , Simone Schaub-Meyer , Stefan Roth

Convolutional Neural Networks (CNNs) have emerged as highly successful tools for image generation, recovery, and restoration. A major contributing factor to this success is that convolutional networks impose strong prior assumptions about…

Machine Learning · Computer Science 2020-02-25 Reinhard Heckel , Mahdi Soltanolkotabi

A number of problems can be formulated as prediction on graph-structured data. In this work, we generalize the convolution operator from regular grids to arbitrary graphs while avoiding the spectral domain, which allows us to handle graphs…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Martin Simonovsky , Nikos Komodakis

This paper focuses on filter-level network pruning. A novel pruning method, termed CLR-RNF, is proposed. We first reveal a "long-tail" long-tail pruning problem in magnitude-based weight pruning methods, and then propose a computation-aware…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Mingbao Lin , Liujuan Cao , Yuxin Zhang , Ling Shao , Chia-Wen Lin , Rongrong Ji

In recent years, the widespread use of deep neural networks (DNNs) has facilitated great improvements in performance for computer vision tasks like image classification and object recognition. In most realistic computer vision applications,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Tejas Borkar , Lina Karam

Channel (or 3D filter) pruning serves as an effective way to accelerate the inference of neural networks. There has been a flurry of algorithms that try to solve this practical problem, each being claimed effective in some ways. Yet, a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Yawei Li , Kamil Adamczewski , Wen Li , Shuhang Gu , Radu Timofte , Luc Van Gool

Graph neural networks (GNNs) are a class of neural networks that allow to efficiently perform inference on data that is associated to a graph structure, such as, e.g., citation networks or knowledge graphs. While several variants of GNNs…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Simone Scardapane , Steven Van Vaerenbergh , Danilo Comminiello , Aurelio Uncini

Graph learning is currently dominated by graph kernels, which, while powerful, suffer some significant limitations. Convolutional Neural Networks (CNNs) offer a very appealing alternative, but processing graphs with CNNs is not trivial. To…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Antoine Jean-Pierre Tixier , Giannis Nikolentzos , Polykarpos Meladianos , Michalis Vazirgiannis

Graph Convolution Network (GCN) has attracted significant attention and become the most popular method for learning graph representations. In recent years, many efforts have been focused on integrating GCN into the recommender tasks and…

Machine Learning · Computer Science 2020-07-14 Kang Liu , Feng Xue , Richang Hong

Structured pruning of filters or neurons has received increased focus for compressing convolutional neural networks. Most existing methods rely on multi-stage optimizations in a layer-wise manner for iteratively pruning and retraining which…

Computer Vision and Pattern Recognition · Computer Science 2019-03-25 Shaohui Lin , Rongrong Ji , Chenqian Yan , Baochang Zhang , Liujuan Cao , Qixiang Ye , Feiyue Huang , David Doermann

CNNs have excelled at performing place recognition over time, particularly when the neural network is optimized for localization in the current environmental conditions. In this paper we investigate the concept of feature map filtering,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Stephen Hausler , Adam Jacobson , Michael Milford

This paper aims to simultaneously accelerate and compress off-the-shelf CNN models via filter pruning strategy. The importance of each filter is evaluated by the proposed entropy-based method first. Then several unimportant filters are…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Jian-Hao Luo , Jianxin Wu

Building discriminative representations for 3D data has been an important task in computer graphics and computer vision research. Convolutional Neural Networks (CNNs) have shown to operate on 2D images with great success for a variety of…

Computer Vision and Pattern Recognition · Computer Science 2016-10-26 Yangyan Li , Soeren Pirk , Hao Su , Charles R. Qi , Leonidas J. Guibas

Graph Neural Networks have recently become a prevailing paradigm for various high-impact graph analytical problems. Existing efforts can be mainly categorized as spectral-based and spatial-based methods. The major challenge for the former…

Machine Learning · Computer Science 2022-02-22 Yushun Dong , Kaize Ding , Brian Jalaian , Shuiwang Ji , Jundong Li

We propose a novel method that trains a conditional Generative Adversarial Network (GAN) to generate visual interpretations of a Convolutional Neural Network (CNN). To comprehend a CNN, the GAN is trained with information on how the CNN…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 R T Akash Guna , Raul Benitez , O K Sikha