English
Related papers

Related papers: Dynamical Isometry and a Mean Field Theory of CNNs…

200 papers

Convolutional neural network (CNN) is a class of artificial neural networks widely used in computer vision tasks. Most CNNs achieve excellent performance by stacking certain types of basic units. In addition to increasing the depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Junyi An , Fengshan Liu , Jian Zhao , Furao Shen

Convolutional Neural Network (CNN) is one of the most important architectures in deep learning. The fundamental building block of a CNN is a trainable filter, represented as a discrete grid, used to perform convolution on discrete input…

Machine Learning · Computer Science 2023-05-26 Dario Coscia , Laura Meneghetti , Nicola Demo , Giovanni Stabile , Gianluigi Rozza

We show that deep convolutional neural networks (CNN) can massively outperform traditional densely-connected neural networks (both deep or shallow) in predicting eigenvalue problems in mechanics. In this sense, we strike out in a new…

Computational Physics · Physics 2018-07-19 David Finol , Yan Lu , Vijay Mahadevan , Ankit Srivastava

The use of Convolutional Neural Networks (CNNs) is widespread in Deep Learning due to a range of desirable model properties which result in an efficient and effective machine learning framework. However, performant CNN architectures must be…

Very deep convolutional networks with hundreds of layers have led to significant reductions in error on competitive benchmarks. Although the unmatched expressiveness of the many layers can be highly desirable at test time, training very…

Machine Learning · Computer Science 2016-08-01 Gao Huang , Yu Sun , Zhuang Liu , Daniel Sedra , Kilian Weinberger

Training deep Convolutional Neural Networks (CNN) is a time consuming task that may take weeks to complete. In this article we propose a novel, theoretically founded method for reducing CNN training time without incurring any loss in…

Computer Vision and Pattern Recognition · Computer Science 2016-10-13 Pedro Porto Buarque de Gusmão , Gianluca Francini , Skjalg Lepsøy , Enrico Magli

Typical convolutional neural networks (CNNs) have several millions of parameters and require a large amount of annotated data to train them. In medical applications where training data is hard to come by, these sophisticated machine…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Rahul Venkataramani , Sheshadri Thiruvenkadam , Prasad Sudhakar , Hariharan Ravishankar , Vivek Vaidya

Title: Comparison between layer-to-layer network training and conventional network training using Deep Convolutional Neural Networks Abstract: Convolutional neural networks (CNNs) are widely used in various applications due to their…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Kiran Kumar Ashish Bhyravabhottla , WonSook Lee

Within the world of machine learning there exists a wide range of different methods with respective advantages and applications. This paper seeks to present and discuss one such method, namely Convolutional Neural Networks (CNNs). CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Lars Lien Ankile , Morgan Feet Heggland , Kjartan Krange

Deep convolutional neural networks (CNNs) have been shown to be very successful in a wide range of image processing applications. However, due to their increasing number of model parameters and an increasing availability of large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Axel Klawonn , Martin Lanser , Janine Weber

Previous research has shown that fully-connected networks with small initialization and gradient-based training methods exhibit a phenomenon known as condensation during training. This phenomenon refers to the input weights of hidden…

Machine Learning · Computer Science 2023-05-18 Zhangchen Zhou , Hanxu Zhou , Yuqing Li , Zhi-Qin John Xu

In this paper, we present a novel method for dynamically expanding Convolutional Neural Networks (CNNs) during training, aimed at meeting the increasing demand for efficient and sustainable deep learning models. Our approach, drawing from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Blaise Appolinary , Alex Deaconu , Sophia Yang , Qingze , Li

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

Remarkable progress has been made in image recognition, primarily due to the availability of large-scale annotated datasets and the revival of deep CNN. CNNs enable learning data-driven, highly representative, layered hierarchical image…

Computer Vision and Pattern Recognition · Computer Science 2016-02-11 Hoo-Chang Shin , Holger R. Roth , Mingchen Gao , Le Lu , Ziyue Xu , Isabella Nogues , Jianhua Yao , Daniel Mollura , Ronald M. Summers

Geometric deep learning has attracted significant attention in recent years, in part due to the availability of exotic data types for which traditional neural network architectures are not well suited. Our goal in this paper is to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-09 Jose J. Bouza , Chun-Hao Yang , David Vaillancourt , Baba C. Vemuri

Deep convolutional neural networks (CNN) have achieved the unwavering confidence in its performance on image processing tasks. The CNN architecture constitutes a variety of different types of layers including the convolution layer and the…

Machine Learning · Computer Science 2020-09-01 Takahiko Henmi , Esmeraldo Ronnie Rey Zara , Yoshihiro Hirohashi , Tsuyoshi Kato

Depthwise separable convolution has shown great efficiency in network design, but requires time-consuming training procedure with full training-set available. This paper first analyzes the mathematical relationship between regular…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Jianbo Guo , Yuxi Li , Weiyao Lin , Yurong Chen , Jianguo Li

Convolutional Neural Networks (CNNs) are a class of artificial neural networks whose computational blocks use convolution, together with other linear and non-linear operations, to perform classification or regression. This paper explores…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Victor Stamatescu , Mark D. McDonnell

This paper proposes a deep Convolutional Neural Network(CNN) with strong generalization ability for structural topology optimization. The architecture of the neural network is made up of encoding and decoding parts, which provide down- and…

Machine Learning · Computer Science 2020-04-01 Yiquan Zhang , Bo Peng , Xiaoyi Zhou , Cheng Xiang , Dalei Wang

In today's digital age, Convolutional Neural Networks (CNNs), a subset of Deep Learning (DL), are widely used for various computer vision tasks such as image classification, object detection, and image segmentation. There are numerous types…

Machine Learning · Computer Science 2024-02-29 Abolfazl Younesi , Mohsen Ansari , MohammadAmin Fazli , Alireza Ejlali , Muhammad Shafique , Jörg Henkel