English
Related papers

Related papers: Modelling Long Range Dependencies in $N$D: From Ta…

200 papers

We present a novel class of convolutional neural networks (CNNs) for set functions, i.e., data indexed with the powerset of a finite set. The convolutions are derived as linear, shift-equivariant functions for various notions of shifts on…

Machine Learning · Computer Science 2024-06-21 Chris Wendler , Dan Alistarh , Markus Püschel

Deep learning based on deep neural networks has been very successful in many practical applications, but it lacks enough theoretical understanding due to the network architectures and structures. In this paper we establish some analysis for…

Machine Learning · Computer Science 2024-01-03 Jianfei Li , Han Feng , Ding-Xuan Zhou

Traditional Feed-Forward Neural Networks (FFNN) and one-dimensional Convolutional Neural Networks (1D CNN) often encounter difficulties when dealing with long, columnar datasets that contain numerous features. The challenge arises from two…

Machine Learning · Computer Science 2024-11-12 Ayoub Jadouli , Chaker El Amrani

Convolutional neural networks (CNNs) have been extensively applied for image recognition problems giving state-of-the-art results on recognition, detection, segmentation and retrieval. In this work we propose and evaluate several deep…

Computer Vision and Pattern Recognition · Computer Science 2015-04-14 Joe Yue-Hei Ng , Matthew Hausknecht , Sudheendra Vijayanarasimhan , Oriol Vinyals , Rajat Monga , George Toderici

In this tutorial, we present a compact and holistic discussion of Deep Learning with a focus on Convolutional Neural Networks (CNNs) and supervised regression. While there are numerous books and articles on the individual topics we cover,…

Artificial Intelligence · Computer Science 2024-12-09 Yansel Gonzalez Tejeda , Helmut A. Mayer

A novel convolution neural network model, abbreviated NL-CNN is proposed, where nonlinear convolution is emulated in a cascade of convolution + nonlinearity layers. The code for its implementation and some trained models are made publicly…

Machine Learning · Computer Science 2021-02-03 Radu Dogaru , Ioana Dogaru

Convolutional neural networks (CNNs) are one of the most successful computer vision systems to solve object recognition. Furthermore, CNNs have major applications in understanding the nature of visual representations in the human brain. Yet…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Amr Farahat , Felix Effenberger , Martin Vinck

The convolution operation is a central building block of neural network architectures widely used in computer vision. The size of the convolution kernels determines both the expressiveness of convolutional neural networks (CNN), as well as…

Image and Video Processing · Electrical Eng. & Systems 2022-10-10 Tianyu Ma , Adrian V. Dalca , Mert R. Sabuncu

Convoulutional Neural Networks (CNNs) exhibit extraordinary performance on a variety of machine learning tasks. However, their mathematical properties and behavior are quite poorly understood. There is some work, in the form of a framework,…

Other Statistics · Statistics 2016-10-30 Jayanth Koushik

Convolutional Neural Networks (CNNs) have achieved great success due to the powerful feature learning ability of convolution layers. Specifically, the standard convolution traverses the input images/features using a sliding window scheme to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Yong Guo , Yaofo Chen , Mingkui Tan , Kui Jia , Jian Chen , Jingdong Wang

In this article, we look into some essential aspects of convolutional neural networks (CNNs) with the focus on medical image segmentation. First, we discuss the CNN architecture, thereby highlighting the spatial origin of the data,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Jeroen Bertels , David Robben , Robin Lemmens , Dirk Vandermeulen

Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters…

Signal Processing · Electrical Eng. & Systems 2019-01-30 Fernando Gama , Antonio G. Marques , Geert Leus , Alejandro Ribeiro

Deep learning has gained much success in sentence-level relation classification. For example, convolutional neural networks (CNN) have delivered competitive performance without much effort on feature engineering as the conventional…

Computation and Language · Computer Science 2015-12-29 Dongxu Zhang , Dong Wang

We represent 3D shape by structured 2D representations of fixed length making it feasible to apply well investigated 2D convolutional neural networks (CNN) for both discriminative and geometric tasks on 3D shapes. We first provide a general…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Kripasindhu Sarkar , Elizabeth Mathews , Didier Stricker

Deep learning became the method of choice in recent year for solving a wide variety of predictive analytics tasks. For sequence prediction, recurrent neural networks (RNN) are often the go-to architecture for exploiting sequential…

Machine Learning · Computer Science 2016-11-09 Kin Gwn Lore , Daniel Stoecklein , Michael Davies , Baskar Ganapathysubramanian , Soumik Sarkar

Convolutional neural networks (CNNs) are a popular choice of model for tasks in computer vision. When CNNs are made with many layers, resulting in a deep neural network, skip connections may be added to create an easier gradient…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Johnny Joyce , Jan Verschelde

The segmentation of medical images is important for the improvement and creation of healthcare systems, particularly for early disease detection and treatment planning. In recent years, the use of convolutional neural networks (CNNs) and…

Image and Video Processing · Electrical Eng. & Systems 2024-01-12 Siddharth Tiwari

Convolutional neural networks (CNNs) have rapidly risen in popularity for many machine learning applications, particularly in the field of image recognition. Much of the benefit generated from these networks comes from their ability to…

Quantum Physics · Physics 2019-04-10 Maxwell Henderson , Samriddhi Shakya , Shashindra Pradhan , Tristan Cook

Convolutional Neural Network (CNNs) are typically associated with Computer Vision. CNNs are responsible for major breakthroughs in Image Classification and are the core of most Computer Vision systems today. More recently CNNs have been…

Computation and Language · Computer Science 2017-03-10 Marc Moreno Lopez , Jugal Kalita

In machine learning for fluid mechanics, fully-connected neural network (FNN) only uses the local features for modelling, while the convolutional neural network (CNN) cannot be applied to data on structured/unstructured mesh. In order to…

Fluid Dynamics · Physics 2021-01-14 Mengfei Xu , Shufang Song , Xuxiang Sun , Weiwei Zhang