English
Related papers

Related papers: Comparison of Neural Network Architectures for Spe…

200 papers

In this article, we look into some essential aspects of convolutional neural networks (CNNs) with the focus on medical image segmentation. First, we discuss the CNN architecture, thereby highlighting the spatial origin of the data,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Jeroen Bertels , David Robben , Robin Lemmens , Dirk Vandermeulen

It is widely believed that the practical success of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) owes to the fact that CNNs and RNNs use a more compact parametric representation than their Fully-Connected Neural…

Machine Learning · Statistics 2019-07-02 Simon S. Du , Yining Wang , Xiyu Zhai , Sivaraman Balakrishnan , Ruslan Salakhutdinov , Aarti Singh

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters…

Signal Processing · Electrical Eng. & Systems 2019-01-30 Fernando Gama , Antonio G. Marques , Geert Leus , Alejandro Ribeiro

We introduce a class of convolutional neural networks (CNNs) that utilize recurrent neural networks (RNNs) as convolution filters. A convolution filter is typically implemented as a linear affine transformation followed by a non-linear…

Computation and Language · Computer Science 2018-08-29 Yi Yang

Convolutional Neural Networks (CNNs) have demonstrated remarkable success in image classification tasks; however, the choice between designing a custom CNN from scratch and employing established pre-trained architectures remains an…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Mohammed Sami Khan , Fabiha Muniat , Rowzatul Zannat

Convolutional neural network (CNN) and recurrent neural network (RNN) are two popular architectures used in text classification. Traditional methods to combine the strengths of the two networks rely on streamlining them or concatenating…

Computation and Language · Computer Science 2020-06-30 Shengfei Lyu , Jiaqi Liu

In the last two years, convolutional neural networks (CNNs) have achieved an impressive suite of results on standard recognition datasets and tasks. CNN-based features seem poised to quickly replace engineered representations, such as SIFT…

Computer Vision and Pattern Recognition · Computer Science 2014-09-23 Pulkit Agrawal , Ross Girshick , Jitendra Malik

This review aims to conduct a comparative analysis of liquid neural networks (LNNs) and traditional recurrent neural networks (RNNs) and their variants, such as long short-term memory networks (LSTMs) and gated recurrent units (GRUs). The…

Machine Learning · Computer Science 2025-10-10 Shilong Zong , Alex Bierly , Almuatazbellah Boker , Hoda Eldardiry

In the past few years, convolutional neural nets (CNN) have shown incredible promise for learning visual representations. In this paper, we use CNNs for the task of predicting surface normals from a single image. But what is the right…

Computer Vision and Pattern Recognition · Computer Science 2014-11-19 Xiaolong Wang , David F. Fouhey , Abhinav Gupta

In machine learning for fluid mechanics, fully-connected neural network (FNN) only uses the local features for modelling, while the convolutional neural network (CNN) cannot be applied to data on structured/unstructured mesh. In order to…

Fluid Dynamics · Physics 2021-01-14 Mengfei Xu , Shufang Song , Xuxiang Sun , Weiwei Zhang

Graph Neural Networks (GNNs) are information processing architectures for signals supported on graphs. They are presented here as generalizations of convolutional neural networks (CNNs) in which individual layers contain banks of graph…

Machine Learning · Computer Science 2021-02-01 Luana Ruiz , Fernando Gama , Alejandro Ribeiro

Many semantic video analysis tasks can benefit from multiple, heterogenous signals. For example, in addition to the original RGB input sequences, sequences of optical flow are usually used to boost the performance of human action…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Lin Sun , Kui Jia , Yuejia Shen , Silvio Savarese , Dit Yan Yeung , Bertram E. Shi

While convolutional neural networks (CNNs) have recently made great strides in supervised classification of data structured on a grid (e.g. images composed of pixel grids), in several interesting datasets, the relations between features can…

Machine Learning · Computer Science 2018-11-02 Shrey Gadiya , Deepak Anand , Amit Sethi

Speech enhancement has benefited from the success of deep learning in terms of intelligibility and perceptual quality. Conventional time-frequency (TF) domain methods focus on predicting TF-masks or speech spectrum, via a naive convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-24 Yanxin Hu , Yun Liu , Shubo Lv , Mengtao Xing , Shimin Zhang , Yihui Fu , Jian Wu , Bihong Zhang , Lei Xie

Graph learning is currently dominated by graph kernels, which, while powerful, suffer some significant limitations. Convolutional Neural Networks (CNNs) offer a very appealing alternative, but processing graphs with CNNs is not trivial. To…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Antoine Jean-Pierre Tixier , Giannis Nikolentzos , Polykarpos Meladianos , Michalis Vazirgiannis

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

Convolutional Neural Network (CNN) image classifiers are traditionally designed to have sequential convolutional layers with a single output layer. This is based on the assumption that all target classes should be treated equally and…

Computer Vision and Pattern Recognition · Computer Science 2017-10-06 Xinqi Zhu , Michael Bain

Neural networks (NN) can be divided into two broad categories, recurrent and non-recurrent. Both types of neural networks are popular and extensively studied, but they are often treated as distinct families of machine learning algorithms.…

Machine Learning · Computer Science 2024-04-02 Quincy Hershey , Randy Paffenroth , Harsh Pathak , Simon Tavener

We contrasted the performance of deep neural networks - Convolutional Neural Network (CNN) and Graph Neural Network (GNN) - to current state of the art energy regression methods in a finely 3D-segmented calorimeter simulated by GEANT4. This…

Instrumentation and Detectors · Physics 2022-01-05 N. Akchurin , C. Cowden , J. Damgov , A. Hussain , S. Kunori