English
Related papers

Related papers: Two-Dimensional Deep ReLU CNN Approximation for Ko…

200 papers

In recent years, the research community has discovered that deep neural networks (DNNs) and convolutional neural networks (CNNs) can yield higher accuracy than all previous solutions to a broad array of machine learning problems. To our…

Computer Vision and Pattern Recognition · Computer Science 2016-12-21 Forrest Iandola

Depthwise separable convolution has shown great efficiency in network design, but requires time-consuming training procedure with full training-set available. This paper first analyzes the mathematical relationship between regular…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Jianbo Guo , Yuxi Li , Weiyao Lin , Yurong Chen , Jianguo Li

Until recently, applications of neural networks in machine learning have almost exclusively relied on real-valued networks. It was recently observed, however, that complex-valued neural networks (CVNNs) exhibit superior performance in…

Functional Analysis · Mathematics 2021-12-06 A. Caragea , D. G. Lee , J. Maly , G. Pfander , F. Voigtlaender

In recent years, convolutional neural networks (CNNs) have shown great performance in various fields such as image classification, pattern recognition, and multi-media compression. Two of the feature properties, local connectivity and…

Machine Learning · Computer Science 2018-07-24 Qianru Zhang , Meng Zhang , Tinghuan Chen , Zhifei Sun , Yuzhe Ma , Bei Yu

We present a cosmic density field reconstruction method that augments the traditional reconstruction algorithms with a convolutional neural network (CNN). Following Shallue $\&$ Eisenstein (2022), the key component of our method is to use…

Cosmology and Nongalactic Astrophysics · Physics 2023-07-05 Xinyi Chen , Fangzhou Zhu , Sasha Gaines , Nikhil Padmanabhan

We discuss approximation of functions using deep neural nets. Given a function $f$ on a $d$-dimensional manifold $\Gamma \subset \mathbb{R}^m$, we construct a sparsely-connected depth-4 neural network and bound its error in approximating…

Machine Learning · Statistics 2017-04-24 Uri Shaham , Alexander Cloninger , Ronald R. Coifman

This research embarked on a comparative exploration of the holistic segmentation capabilities of Convolutional Neural Networks (CNNs) in both 2D and 3D formats, focusing on cystic fibrosis (CF) lesions. The study utilized data from two CF…

Image and Video Processing · Electrical Eng. & Systems 2024-08-13 Amel Imene Hadj Bouzid , Baudouin Denis de Senneville , Fabien Baldacci , Pascal Desbarats , Patrick Berger , Ilyes Benlala , Gaël Dournes

Recently, much attention has been devoted to finding highly efficient and powerful activation functions for CNN layers. Because activation functions inject different nonlinearities between layers that affect performance, varying them is one…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Loris Nanni , Gianluca Maguolo , Sheryl Brahnam , Michelangelo Paci

We present a novel spatial hashing based data structure to facilitate 3D shape analysis using convolutional neural networks (CNNs). Our method well utilizes the sparse occupancy of 3D shape boundary and builds hierarchical hash tables for…

Graphics · Computer Science 2019-04-19 Tianjia Shao , Yin Yang , Yanlin Weng , Qiming Hou , Kun Zhou

Convolutional Neural Networks (CNNs) have proven to be a powerful state-of-the-art method for image classification tasks. One drawback however is the high computational complexity and high memory consumption of CNNs which makes them…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Rishabh Goyal , Joaquin Vanschoren , Victor van Acht , Stephan Nijssen

We study the power of deep neural networks (DNNs) with sigmoid activation function. Recently, it was shown that DNNs approximate any $d$-dimensional, smooth function on a compact set with a rate of order $W^{-p/d}$, where $W$ is the number…

Machine Learning · Computer Science 2020-10-12 Sophie Langer

Convolutional Neural Networks (CNNs) have become indispensable for solving machine learning tasks in speech recognition, computer vision, and other areas that involve high-dimensional data. A CNN filters the input feature using a network…

Machine Learning · Computer Science 2020-02-13 Jonathan Ephrath , Moshe Eliasof , Lars Ruthotto , Eldad Haber , Eran Treister

Convolutional neural networks (CNN) are limited by the lack of capability to handle geometric information due to the fixed grid kernel structure. The availability of depth data enables progress in RGB-D semantic segmentation with CNNs.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Weiyue Wang , Ulrich Neumann

We study the computation complexity of deep ReLU (Rectified Linear Unit) neural networks for the approximation of functions from the H\"older-Zygmund space of mixed smoothness defined on the $d$-dimensional unit cube when the dimension $d$…

Numerical Analysis · Mathematics 2021-07-26 Dinh Dũng , Van Kien Nguyen

2D convolution (Conv2d), which is responsible for extracting features from the input image, is one of the key modules of a convolutional neural network (CNN). However, Conv2d is vulnerable to image corruptions and adversarial samples. It is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Lida Li , Shuai Li , Kun Wang , Xiangchu Feng , Lei Zhang

The study objective was to investigate the performance of a dedicated convolutional neural network (CNN) optimized for wrist cartilage segmentation from 2D MR images. CNN utilized a planar architecture and patch-based (PB) training approach…

In this paper we propose a deep learning approach for segmenting sub-cortical structures of the human brain in Magnetic Resonance (MR) image data. We draw inspiration from a state-of-the-art Fully-Convolutional Neural Network (F-CNN)…

Computer Vision and Pattern Recognition · Computer Science 2016-02-08 Mahsa Shakeri , Stavros Tsogkas , Enzo Ferrante , Sarah Lippe , Samuel Kadoury , Nikos Paragios , Iasonas Kokkinos

Designing of a cranial implant needs a 3D understanding of the complete skull shape. Thus, taking a 2D approach is sub-optimal, since a 2D model lacks a holistic 3D view of both the defective and healthy skulls. Further, loading the whole…

Image and Video Processing · Electrical Eng. & Systems 2020-09-29 Amirhossein Bayat , Suprosanna Shit , Adrian Kilian , Jürgen T. Liechtenstein , Jan S. Kirschke , Bjoern H. Menze

This research project studies the impact of convolutional neural networks (CNN) in image classification tasks. We explore different architectures and training configurations with the use of ReLUs, Nesterov's accelerated gradient, dropout…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Anderson de Andrade

Deep learning-based super-resolution (SR) techniques have generally achieved excellent performance in the computer vision field. Recently, it has been proven that three-dimensional (3D) SR for medical volumetric data delivers better visual…

Image and Video Processing · Electrical Eng. & Systems 2021-05-19 Yinhao Li , Yutaro Iwamoto , Lanfen Lin , Rui Xu , Yen-Wei Chen