中文
相关论文

相关论文: Filter Grafting for Deep Neural Networks: Reason, …

200 篇论文

Graph Convolution Network (GCN) has become new state-of-the-art for collaborative filtering. Nevertheless, the reasons of its effectiveness for recommendation are not well understood. Existing work that adapts GCN to recommendation lacks…

信息检索 · 计算机科学 2020-07-08 Xiangnan He , Kuan Deng , Xiang Wang , Yan Li , Yongdong Zhang , Meng Wang

Modern deep neural networks require a significant amount of computing time and power to train and deploy, which limits their usage on edge devices. Inspired by the iterative weight pruning in the Lottery Ticket Hypothesis, we propose…

机器学习 · 计算机科学 2022-07-15 John Tan Chong Min , Mehul Motani

\textbf{G}raph \textbf{C}onvolutional \textbf{N}etwork (\textbf{GCN}) is widely used in graph data learning tasks such as recommendation. However, when facing a large graph, the graph convolution is very computationally expensive thus is…

机器学习 · 计算机科学 2021-01-19 Wenhui Yu , Zheng Qin

We present an analysis into the inner workings of Convolutional Neural Networks (CNNs) for processing text. CNNs used for computer vision can be interpreted by projecting filters into image space, but for discrete sequence inputs CNNs…

计算与语言 · 计算机科学 2020-04-29 Alon Jacovi , Oren Sar Shalom , Yoav Goldberg

Graph convolutional networks (GCNs) have recently enabled a popular class of algorithms for collaborative filtering (CF). Nevertheless, the theoretical underpinnings of their empirical successes remain elusive. In this paper, we endeavor to…

信息检索 · 计算机科学 2021-08-18 Yifei Shen , Yongji Wu , Yao Zhang , Caihua Shan , Jun Zhang , Khaled B. Letaief , Dongsheng Li

Many convolutional neural networks (CNNs) rely on progressive downsampling of their feature maps to increase the network's receptive field and decrease computational cost. However, this comes at the price of losing granularity in the…

计算机视觉与模式识别 · 计算机科学 2023-05-17 Robin Hesse , Simone Schaub-Meyer , Stefan Roth

Convolutional Neural Networks (CNNs) have emerged as highly successful tools for image generation, recovery, and restoration. A major contributing factor to this success is that convolutional networks impose strong prior assumptions about…

机器学习 · 计算机科学 2020-02-25 Reinhard Heckel , Mahdi Soltanolkotabi

A number of problems can be formulated as prediction on graph-structured data. In this work, we generalize the convolution operator from regular grids to arbitrary graphs while avoiding the spectral domain, which allows us to handle graphs…

计算机视觉与模式识别 · 计算机科学 2017-08-09 Martin Simonovsky , Nikos Komodakis

This paper focuses on filter-level network pruning. A novel pruning method, termed CLR-RNF, is proposed. We first reveal a "long-tail" long-tail pruning problem in magnitude-based weight pruning methods, and then propose a computation-aware…

计算机视觉与模式识别 · 计算机科学 2022-02-16 Mingbao Lin , Liujuan Cao , Yuxin Zhang , Ling Shao , Chia-Wen Lin , Rongrong Ji

In recent years, the widespread use of deep neural networks (DNNs) has facilitated great improvements in performance for computer vision tasks like image classification and object recognition. In most realistic computer vision applications,…

计算机视觉与模式识别 · 计算机科学 2019-08-27 Tejas Borkar , Lina Karam

Channel (or 3D filter) pruning serves as an effective way to accelerate the inference of neural networks. There has been a flurry of algorithms that try to solve this practical problem, each being claimed effective in some ways. Yet, a…

计算机视觉与模式识别 · 计算机科学 2022-05-12 Yawei Li , Kamil Adamczewski , Wen Li , Shuhang Gu , Radu Timofte , Luc Van Gool

Graph neural networks (GNNs) are a class of neural networks that allow to efficiently perform inference on data that is associated to a graph structure, such as, e.g., citation networks or knowledge graphs. While several variants of GNNs…

神经与进化计算 · 计算机科学 2018-02-27 Simone Scardapane , Steven Van Vaerenbergh , Danilo Comminiello , Aurelio Uncini

Graph learning is currently dominated by graph kernels, which, while powerful, suffer some significant limitations. Convolutional Neural Networks (CNNs) offer a very appealing alternative, but processing graphs with CNNs is not trivial. To…

计算机视觉与模式识别 · 计算机科学 2019-09-04 Antoine Jean-Pierre Tixier , Giannis Nikolentzos , Polykarpos Meladianos , Michalis Vazirgiannis

Graph Convolution Network (GCN) has attracted significant attention and become the most popular method for learning graph representations. In recent years, many efforts have been focused on integrating GCN into the recommender tasks and…

机器学习 · 计算机科学 2020-07-14 Kang Liu , Feng Xue , Richang Hong

Structured pruning of filters or neurons has received increased focus for compressing convolutional neural networks. Most existing methods rely on multi-stage optimizations in a layer-wise manner for iteratively pruning and retraining which…

计算机视觉与模式识别 · 计算机科学 2019-03-25 Shaohui Lin , Rongrong Ji , Chenqian Yan , Baochang Zhang , Liujuan Cao , Qixiang Ye , Feiyue Huang , David Doermann

CNNs have excelled at performing place recognition over time, particularly when the neural network is optimized for localization in the current environmental conditions. In this paper we investigate the concept of feature map filtering,…

计算机视觉与模式识别 · 计算机科学 2020-03-03 Stephen Hausler , Adam Jacobson , Michael Milford

This paper aims to simultaneously accelerate and compress off-the-shelf CNN models via filter pruning strategy. The importance of each filter is evaluated by the proposed entropy-based method first. Then several unimportant filters are…

计算机视觉与模式识别 · 计算机科学 2017-06-20 Jian-Hao Luo , Jianxin Wu

Building discriminative representations for 3D data has been an important task in computer graphics and computer vision research. Convolutional Neural Networks (CNNs) have shown to operate on 2D images with great success for a variety of…

计算机视觉与模式识别 · 计算机科学 2016-10-26 Yangyan Li , Soeren Pirk , Hao Su , Charles R. Qi , Leonidas J. Guibas

Graph Neural Networks have recently become a prevailing paradigm for various high-impact graph analytical problems. Existing efforts can be mainly categorized as spectral-based and spatial-based methods. The major challenge for the former…

机器学习 · 计算机科学 2022-02-22 Yushun Dong , Kaize Ding , Brian Jalaian , Shuiwang Ji , Jundong Li

We propose a novel method that trains a conditional Generative Adversarial Network (GAN) to generate visual interpretations of a Convolutional Neural Network (CNN). To comprehend a CNN, the GAN is trained with information on how the CNN…

计算机视觉与模式识别 · 计算机科学 2023-11-10 R T Akash Guna , Raul Benitez , O K Sikha