English
Related papers

Related papers: Training convolutional neural networks with megapi…

200 papers

Deep neural networks have dramatically advanced the state of the art for many areas of machine learning. Recently they have been shown to have a remarkable ability to generate highly complex visual artifacts such as images and text rather…

Computer Vision and Pattern Recognition · Computer Science 2016-07-08 Andrey Zhmoginov , Mark Sandler

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

Convolutional Neural Networks (CNNs) have demonstrated outstanding performance in computer vision tasks such as image classification, detection, segmentation, and medical image analysis. In general, an arbitrary number of epochs is used to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Sahan Ahmad , Gabriel Trahan , Aminul Islam

We present a fast algorithm for training MaxPooling Convolutional Networks to segment images. This type of network yields record-breaking performance in a variety of tasks, but is normally trained on a computationally expensive…

Computer Vision and Pattern Recognition · Computer Science 2013-02-08 Jonathan Masci , Alessandro Giusti , Dan Cireşan , Gabriel Fricout , Jürgen Schmidhuber

Deep learning has shown promising results in medical image analysis, however, the lack of very large annotated datasets confines its full potential. Although transfer learning with ImageNet pre-trained classification models can alleviate…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Ken C. L. Wong , Tanveer Syeda-Mahmood , Mehdi Moradi

When training deep neural networks, keeping all tensors in high precision (e.g., 32-bit or even 16-bit floats) is often wasteful. However, keeping all tensors in low precision (e.g., 8-bit floats) can lead to unacceptable accuracy loss.…

Machine Learning · Computer Science 2023-06-26 Wonyeol Lee , Rahul Sharma , Alex Aiken

This paper addresses the problem of estimating the depth map of a scene given a single RGB image. We propose a fully convolutional architecture, encompassing residual learning, to model the ambiguous mapping between monocular images and…

Computer Vision and Pattern Recognition · Computer Science 2016-09-20 Iro Laina , Christian Rupprecht , Vasileios Belagiannis , Federico Tombari , Nassir Navab

Convolutional neural networks require significant memory bandwidth and storage for intermediate computations, apart from substantial computing resources. Neural network quantization has significant benefits in reducing the amount of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Ron Banner , Yury Nahshan , Elad Hoffer , Daniel Soudry

Deep convolutional neural networks have shown high efficiency in computer visions and other applications. However, with the increase in the depth of the networks, the computational complexity is growing exponentially. In this paper, we…

Machine Learning · Computer Science 2021-01-08 Ali Mirzaeian , Sai Manoj , Ashkan Vakil , Houman Homayoun , Avesta Sasan

While machine learning approaches to image restoration offer great promise, current methods risk training models fixated on performing well only for image corruption of a particular level of difficulty---such as a certain level of noise or…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Ruohan Gao , Kristen Grauman

Deep convolutional neural networks (ConvNets) of 3-dimensional kernels allow joint modeling of spatiotemporal features. These networks have improved performance of video and volumetric image analysis, but have been limited in size due to…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 David Budden , Alexander Matveev , Shibani Santurkar , Shraman Ray Chaudhuri , Nir Shavit

Convolution neural network (CNN), as one of the most powerful and popular technologies, has achieved remarkable progress for image and video classification since its invention in 1989. However, with the high definition video-data explosion,…

Emerging Technologies · Computer Science 2021-08-04 Yue Jiang , Wenjia Zhang , Fan Yang , Zuyuan He

Accurate depth estimation from images is a fundamental task in many applications including scene understanding and reconstruction. Existing solutions for depth estimation often produce blurry approximations of low resolution. This paper…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Ibraheem Alhashim , Peter Wonka

Automatic segmentation in MR brain images is important for quantitative analysis in large-scale studies with images acquired at all ages. This paper presents a method for the automatic segmentation of MR brain images into a number of tissue…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Pim Moeskops , Max A. Viergever , Adriënne M. Mendrik , Linda S. de Vries , Manon J. N. L. Benders , Ivana Išgum

The increasing complexity of deep learning architectures is resulting in training time requiring weeks or even months. This slow training is due in part to vanishing gradients, in which the gradients used by back-propagation are extremely…

Computer Vision and Pattern Recognition · Computer Science 2015-10-16 Bharat Singh , Soham De , Yangmuzi Zhang , Thomas Goldstein , Gavin Taylor

We investigate the problem of training neural networks from incomplete images without replacing missing values. For this purpose, we first represent an image as a graph, in which missing pixels are entirely ignored. The graph image…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Tomasz Danel , Marek Śmieja , Łukasz Struski , Przemysław Spurek , Łukasz Maziarka

We propose a novel technique for faster deep neural network training which systematically applies sample-based approximation to the constituent tensor operations, i.e., matrix multiplications and convolutions. We introduce new sampling…

Machine Learning · Computer Science 2021-10-27 Menachem Adelman , Kfir Y. Levy , Ido Hakimi , Mark Silberstein

Deep learning-based applications have seen a lot of success in recent years. Text, audio, image, and video have all been explored with great success using deep learning approaches. The use of convolutional neural networks (CNN) in computer…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Nosseiba Ben Salem , Younes Bennani , Joseph Karkazan , Abir Barbara , Charles Dacheux , Thomas Gregory

We have developed convolutional neural networks (CNN) for a facial expression recognition task. The goal is to classify each facial image into one of the seven facial emotion categories considered in this study. We trained CNN models with…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Shima Alizadeh , Azar Fazel

Deep learning based models, generally, require a large number of samples for appropriate training, a requirement that is difficult to satisfy in the medical field. This issue can usually be avoided with a proper initialization of the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Taibou Birgui Sekou , Moncef Hidane , Julien Olivier , Hubert Cardot