English
Related papers

Related papers: MorphPool: Efficient Non-linear Pooling & Unpoolin…

200 papers

Most modern convolutional neural networks (CNNs) used for object recognition are built using the same principles: Alternating convolution and max-pooling layers followed by a small number of fully connected layers. We re-evaluate the state…

Machine Learning · Computer Science 2015-04-14 Jost Tobias Springenberg , Alexey Dosovitskiy , Thomas Brox , Martin Riedmiller

Convolutional neural networks (CNNs), in a few decades, have outperformed the existing state of the art methods in classification context. However, in the way they were formalised, CNNs are bound to operate on euclidean spaces. Indeed,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Chloé Martineau , Romain Raveaux , Donatello Conte , Gilles Venturini

Graph Neural Networks achieve state-of-the-art performance on a plethora of graph classification tasks, especially due to pooling operators, which aggregate learned node embeddings hierarchically into a final graph representation. However,…

Machine Learning · Computer Science 2022-09-09 Alexandre Duval , Fragkiskos Malliaros

Pooling layers are essential building blocks of convolutional neural networks (CNNs), to reduce computational overhead and increase the receptive fields of proceeding convolutional operations. Their goal is to produce downsampled volumes…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Alexandros Stergiou , Ronald Poppe

In convolutional neural network-based character recognition, pooling layers play an important role in dimensionality reduction and deformation compensation. However, their kernel shapes and pooling operations are empirically predetermined;…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Takato Otsuzuki , Heon Song , Seiichi Uchida , Hideaki Hayashi

How to utilize deep learning methods for graph classification tasks has attracted considerable research attention in the past few years. Regarding graph classification tasks, the graphs to be classified may have various graph sizes (i.e.,…

Machine Learning · Computer Science 2020-04-16 Yanyan Liang , Yanfeng Zhang , Dechao Gao , Qian Xu

Graph neural networks have emerged as a leading architecture for many graph-level tasks, such as graph classification and graph generation. As an essential component of the architecture, graph pooling is indispensable for obtaining a…

Machine Learning · Computer Science 2023-06-23 Chuang Liu , Yibing Zhan , Jia Wu , Chang Li , Bo Du , Wenbin Hu , Tongliang Liu , Dacheng Tao

Global pooling layers are an essential part of Convolutional Neural Networks (CNN). They are used to aggregate activations of spatial locations to produce a fixed-size vector in several state-of-the-art CNNs. Global average pooling or…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Vincent Christlein , Lukas Spranger , Mathias Seuret , Anguelos Nicolaou , Pavel Král , Andreas Maier

In the framework of convolutional neural networks, downsampling is often performed with an average-pooling, where all the activations are treated equally, or with a max-pooling operation that only retains an element with maximum activation…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Adrien Deliège , Maxime Istasse , Ashwani Kumar , Christophe De Vleeschouwer , Marc Van Droogenbroeck

Inspired by the conventional pooling layers in convolutional neural networks, many recent works in the field of graph machine learning have introduced pooling operators to reduce the size of graphs. The great variety in the literature stems…

Machine Learning · Computer Science 2024-03-26 Daniele Grattarola , Daniele Zambon , Filippo Maria Bianchi , Cesare Alippi

Graph convolutional neural networks (GCNNs) are a powerful extension of deep learning techniques to graph-structured data problems. We empirically evaluate several pooling methods for GCNNs, and combinations of those graph pooling methods…

Signal Processing · Electrical Eng. & Systems 2020-04-08 Mark Cheung , John Shi , Lavender Yao Jiang , Oren Wright , José M. F. Moura

We propose a novel approach to compute the MAXCUT in attributed graphs, i.e., graphs with features associated with nodes and edges. Our approach works well on any kind of graph topology and can find solutions that jointly optimize the…

Machine Learning · Computer Science 2025-02-03 Carlo Abate , Filippo Maria Bianchi

Deep neural networks with alternating convolutional, max-pooling and decimation layers are widely used in state of the art architectures for computer vision. Max-pooling purposefully discards precise spatial information in order to create…

Computer Vision and Pattern Recognition · Computer Science 2016-04-19 Sina Honari , Jason Yosinski , Pascal Vincent , Christopher Pal

Convolutional networks almost always incorporate some form of spatial pooling, and very often it is alpha times alpha max-pooling with alpha=2. Max-pooling act on the hidden layers of the network, reducing their size by an integer…

Computer Vision and Pattern Recognition · Computer Science 2015-05-13 Benjamin Graham

Recent studies have shown that a Deep Convolutional Neural Network (DCNN) pretrained on a large image dataset can be used as a universal image descriptor, and that doing so leads to impressive performance for a variety of image…

Computer Vision and Pattern Recognition · Computer Science 2016-12-23 Lingqiao Liu , Chunhua Shen , Anton van den Hengel

Mathematical morphology is a theory and technique to collect features like geometric and topological structures in digital images. Given a target image, determining suitable morphological operations and structuring elements is a cumbersome…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Yucong Shen , Xin Zhong , Frank Y. Shih

Standard Convolutional Neural Networks (CNNs) designed for computer vision tasks tend to have large intermediate activation maps. These require large working memory and are thus unsuitable for deployment on resource-constrained devices…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Oindrila Saha , Aditya Kusupati , Harsha Vardhan Simhadri , Manik Varma , Prateek Jain

In the framework of convolutional neural networks that lie at the heart of deep learning, downsampling is often performed with a max-pooling operation that only retains the element with maximum activation, while completely discarding the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Ashwani Kumar

Scattering network is a convolutional network, consisting of cascading convolutions using pre-defined wavelets followed by the modulus operator. Since its introduction in 2012, the scattering network is used as one of few mathematical tools…

Numerical Analysis · Mathematics 2022-08-11 Taekyung Ki , Youngmi Hur

Graph pooling is a family of operations which take graphs as input and produce shrinked graphs as output. Modern graph pooling methods are trainable and, in general inserted in Graph Neural Networks (GNNs) architectures as graph shrinking…

Machine Learning · Computer Science 2024-12-05 Yizhu Chen