English
Related papers

Related papers: Deep CNNs Meet Global Covariance Pooling: Better R…

200 papers

Connectivity robustness, a crucial aspect for understanding, optimizing, and repairing complex networks, has traditionally been evaluated through time-consuming and often impractical simulations. Fortunately, machine learning provides a new…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Wenjun Jiang , Tianlong Fan , Changhao Li , Chuanfu Zhang , Tao Zhang , Zong-fu Luo

Graph neural networks, which generalize deep neural network models to graph structured data, have attracted increasing attention in recent years. They usually learn node representations by transforming, propagating and aggregating node…

Machine Learning · Computer Science 2019-05-21 Yao Ma , Suhang Wang , Charu C. Aggarwal , Jiliang Tang

With the development of graph convolutional networks (GCN), deep learning methods have started to be used on graph data. In additional to convolutional layers, pooling layers are another important components of deep learning. However, no…

Artificial Intelligence · Computer Science 2019-03-12 Hongyang Gao , Yongjun Chen , Shuiwang Ji

Designing effective graph neural networks (GNNs) with message passing has two fundamental challenges, i.e., determining optimal message-passing pathways and designing local aggregators. Previous methods of designing optimal pathways are…

Machine Learning · Computer Science 2024-11-01 Junshu Sun , Shuhui Wang , Chenxue Yang , Qingming Huang

The benefit of localized features within the regular domain has given rise to the use of Convolutional Neural Networks (CNNs) in machine learning, with great proficiency in the image classification. The use of CNNs becomes problematic…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Michael Edwards , Xianghua Xie

Global covariance pooling in convolutional neural networks has achieved impressive improvement over the classical first-order pooling. Recent works have shown matrix square root normalization plays a central role in achieving…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Peihua Li , Jiangtao Xie , Qilong Wang , Zilin Gao

Deep convolutional neural networks provide a powerful feature learning capability for image classification. The deep image features can be utilized to deal with many image understanding tasks like image classification and object…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Shaoning Zeng , Bob Zhang , Yanghao Zhang , Jianping Gou

With the impressive capability to capture visual content, deep convolutional neural networks (CNN) have demon- strated promising performance in various vision-based ap- plications, such as classification, recognition, and objec- t…

Computer Vision and Pattern Recognition · Computer Science 2015-09-16 Zhen Liu

Deep neural networks with alternating convolutional, max-pooling and decimation layers are widely used in state of the art architectures for computer vision. Max-pooling purposefully discards precise spatial information in order to create…

Computer Vision and Pattern Recognition · Computer Science 2016-04-19 Sina Honari , Jason Yosinski , Pascal Vincent , Christopher Pal

Convolutional Neural Networks (CNNs) are artificial learning systems typically based on two operations: convolution, which implements feature extraction through filtering, and pooling, which implements dimensionality reduction. The impact…

Machine Learning · Computer Science 2022-02-18 Dimitrios E. Diamantis , Dimitris K. Iakovidis

Convolutional neural networks (CNNs) provide flexible function approximations for a wide variety of applications when the input variables are in the form of images or spatial data. Although CNNs often outperform traditional statistical…

Methodology · Statistics 2024-05-24 Yeseul Jeon , Won Chang , Seonghyun Jeong , Sanghoon Han , Jaewoo Park

Covariance pooling is a feature pooling method with good classification accuracy. Because covariance features consist of second-order statistics, the scale of the feature elements are varied. Therefore, normalizing covariance features using…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Yusuke Mukuta , Tatsuaki Machida , Tatsuya Harada

Convolutional neural networks (CNNs) leverage the great power in representation learning on regular grid data such as image and video. Recently, increasing attention has been paid on generalizing CNNs to graph or network data which is…

Social and Information Networks · Computer Science 2018-08-21 Yao Ma , Suhang Wang , Charu C. Aggarwal , Dawei Yin , Jiliang Tang

Max-Pooling operations are a core component of deep learning architectures. In particular, they are part of most convolutional architectures used in machine vision, since pooling is a natural approach to pattern detection problems. However,…

Machine Learning · Computer Science 2021-03-05 Alon Brutzkus , Amir Globerson

Convolutional neural networks (CNNs) are being applied to an increasing number of problems and fields due to their superior performance in classification and regression tasks. Since two of the key operations that CNNs implement are…

Machine Learning · Computer Science 2018-02-27 Fernando Gama , Geert Leus , Antonio G. Marques , Alejandro Ribeiro

Graph neural networks (GNNs) extends the functionality of traditional neural networks to graph-structured data. Similar to CNNs, an optimized design of graph convolution and pooling is key to success. Borrowing ideas from physics, we…

Machine Learning · Computer Science 2022-01-12 Zheng Ma , Junyu Xuan , Yu Guang Wang , Ming Li , Pietro Lio

Graph neural networks (GNN) extends deep learning to graph-structure dataset. Similar to Convolutional Neural Networks (CNN) using on image prediction, convolutional and pooling layers are the foundation to success for GNN on graph…

Machine Learning · Computer Science 2023-02-28 Lingjie Kong , Yun Liao

Convolutional neural networks (CNNs) with convolutional and pooling operations along the frequency axis have been proposed to attain invariance to frequency shifts of features. However, this is inappropriate with regard to the fact that…

Computation and Language · Computer Science 2016-08-24 Hwaran Lee , Geonmin Kim , Ho-Gyeong Kim , Sang-Hoon Oh , Soo-Young Lee

The Fine-Grained Visual Categorization (FGVC) is challenging because the subtle inter-class variations are difficult to be captured. One notable research line uses the Global Covariance Pooling (GCP) layer to learn powerful representations…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Yue Song , Nicu Sebe , Wei Wang

Graph neural networks (GNN) has been demonstrated to be effective in classifying graph structures. To further improve the graph representation learning ability, hierarchical GNN has been explored. It leverages the differentiable pooling to…

Social and Information Networks · Computer Science 2019-12-19 Kaixiong Zhou , Qingquan Song , Xiao Huang , Daochen Zha , Na Zou , Xia Hu