English
Related papers

Related papers: Parameter-Efficient Architectural Modifications fo…

200 papers

Convolutional Neural Networks (CNN) are becoming a common presence in many applications and services, due to their superior recognition accuracy. They are increasingly being used on mobile devices, many times just by porting large models…

Machine Learning · Computer Science 2020-02-21 Valentin Radu , Kuba Kaszyk , Yuan Wen , Jack Turner , Jose Cano , Elliot J. Crowley , Bjorn Franke , Amos Storkey , Michael O'Boyle

This paper focuses on improving the mathematical interpretability of convolutional neural networks (CNNs) in the context of image classification. Specifically, we tackle the instability issue arising in their first layer, which tends to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Hubert Leterme , Kévin Polisano , Valérie Perrier , Karteek Alahari

Graph neural networks (GNN) extends deep learning to graph-structure dataset. Similar to Convolutional Neural Networks (CNN) using on image prediction, convolutional and pooling layers are the foundation to success for GNN on graph…

Machine Learning · Computer Science 2023-02-28 Lingjie Kong , Yun Liao

Stress prediction in porous materials and structures is challenging due to the high computational cost associated with direct numerical simulations. Convolutional Neural Network (CNN) based architectures have recently been proposed as…

Computational Engineering, Finance, and Science · Computer Science 2023-11-07 Vasilis Krokos , Stéphane P. A. Bordas , Pierre Kerfriden

Convolutional Neural Networks (CNNs) have proven to be extremely accurate for image recognition, even outperforming human recognition capability. When deployed on battery-powered mobile devices, efficient computer architectures are required…

Hardware Architecture · Computer Science 2020-10-05 Mehdi Ahmadi , Shervin Vakili , J. M. Pierre Langlois

The paper presents a Graph Attention Convolutional Network (GACN) for flow reconstruction from very sparse data in time-varying geometries. The model incorporates a feature propagation algorithm as a preprocessing step to handle extremely…

Machine Learning · Computer Science 2024-11-14 Bogdan A. Danciu , Vito A. Pagone , Benjamin Böhm , Marius Schmidt , Christos E. Frouzakis

Deep neural networks have achieved great success in the last decade. When designing neural networks to handle the ubiquitous geometric data such as point clouds and graphs, it is critical that the model can maintain invariance towards…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Ziwei Zhang , Xin Wang , Zeyang Zhang , Peng Cui , Wenwu Zhu

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

Global average pooling (GAP) allows to localize discriminative information for recognition [40]. While GAP helps the convolution neural network to attend to the most discriminative features of an object, it may suffer if that information is…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Haoran Wang , Yue Fan , Zexin Wang , Licheng Jiao , Bernt Schiele

We address the problem that state-of-the-art Convolution Neural Networks (CNN) classifiers are not invariant to small shifts. The problem can be solved by the removal of sub-sampling operations such as stride and max pooling, but at a cost…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Ganesh Sundaramoorthi , Timothy E. Wang

Graph Neural Networks (GNNs) have shown significant success for graph-based tasks. Motivated by the prevalence of large datasets in real-world applications, pooling layers are crucial components of GNNs. By reducing the size of input…

Machine Learning · Computer Science 2026-01-13 Katharina Limbeck , Lydia Mezrag , Guy Wolf , Bastian Rieck

Convolutional Neural Networks (CNNs) dominate various computer vision tasks since Alex Krizhevsky showed that they can be trained effectively and reduced the top-5 error from 26.2 % to 15.3 % on the ImageNet large scale visual recognition…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Martin Thoma

Deep convolutional neural networks (CNN) brought revolution without any doubt to various challenging tasks, mainly in computer vision. However, their model designing still requires attention to reduce number of learnable parameters, with no…

Computer Vision and Pattern Recognition · Computer Science 2016-08-16 Ihsan Ullah , Alfredo Petrosino

Recent studies have put into question the commonly assumed shift invariance property of convolutional networks, showing that small shifts in the input can affect the output predictions substantially. In this paper, we analyze the benefits…

Sound · Computer Science 2021-07-23 Eduardo Fonseca , Andres Ferraro , Xavier Serra

Joint image filters are used to transfer structural details from a guidance picture used as a prior to a target image, in tasks such as enhancing spatial resolution and suppressing noise. Previous methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Beomjun Kim , Jean Ponce , Bumsub Ham

Neural Architecture Search (NAS) methods have shown to output networks that largely outperform human-designed networks. However, conventional NAS methods have mostly tackled the single dataset scenario, incuring in a large computational…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Sofia Casarin , Oswald Lanz , Sergio Escalera

Convolutional neural networks (CNNs) with convolutional and pooling operations along the frequency axis have been proposed to attain invariance to frequency shifts of features. However, this is inappropriate with regard to the fact that…

Computation and Language · Computer Science 2016-08-24 Hwaran Lee , Geonmin Kim , Ho-Gyeong Kim , Sang-Hoon Oh , Soo-Young Lee

Convolutional Neural Networks (CNNs) have achieved great success due to the powerful feature learning ability of convolution layers. Specifically, the standard convolution traverses the input images/features using a sliding window scheme to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Yong Guo , Yaofo Chen , Mingkui Tan , Kui Jia , Jian Chen , Jingdong Wang

There are many award-winning pre-trained Convolutional Neural Network (CNN), which have a common phenomenon of increasing depth in convolutional layers. However, I inspect on VGG network, which is one of the famous model submitted to…

Machine Learning · Computer Science 2019-11-21 Syeda Noor Jaha Azim , Md. Aminur Rab Ratul

Most modern convolutional neural networks (CNNs) used for object recognition are built using the same principles: Alternating convolution and max-pooling layers followed by a small number of fully connected layers. We re-evaluate the state…

Machine Learning · Computer Science 2015-04-14 Jost Tobias Springenberg , Alexey Dosovitskiy , Thomas Brox , Martin Riedmiller