English
Related papers

Related papers: Deep Big Simple Neural Nets Excel on Handwritten D…

200 papers

Training deep neural networks with the error backpropagation algorithm is considered implausible from a biological perspective. Numerous recent publications suggest elaborate models for biologically plausible variants of deep learning,…

Neural and Evolutionary Computing · Computer Science 2019-07-16 Bernd Illing , Wulfram Gerstner , Johanni Brea

We report that a very high accuracy on the MNIST test set can be achieved by using simple convolutional neural network (CNN) models. We use three different models with 3x3, 5x5, and 7x7 kernel size in the convolution layers. Each model…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Sanghyeon An , Minjun Lee , Sanglee Park , Heerin Yang , Jungmin So

Deep learning methods have shown great promise in many practical applications, ranging from speech recognition, visual object recognition, to text processing. However, most of the current deep learning methods suffer from scalability…

Machine Learning · Statistics 2015-08-31 Yanping Huang , Sai Zhang

We use Deep Neural Networks (DNNs) to classify and reconstruct a large database of handwritten digits from the intensity of the speckle patterns that result after the images propagated through multimode fibers (MMF). Images transmitted…

Optics · Physics 2018-08-21 Navid Borhani , Eirini Kakkava , Christophe Moser , Demetri Psaltis

Binary Neural Networks (BNNs) show promising progress in reducing computational and memory costs but suffer from substantial accuracy degradation compared to their real-valued counterparts on large-scale datasets, e.g., ImageNet. Previous…

Machine Learning · Computer Science 2019-06-21 Joseph Bethge , Haojin Yang , Marvin Bornstein , Christoph Meinel

We describe a novel spiking neural network (SNN) for automated, real-time handwritten digit classification and its implementation on a GP-GPU platform. Information processing within the network, from feature extraction to classification is…

Machine Learning · Statistics 2017-11-13 Shruti R. Kulkarni , John M. Alexiades , Bipin Rajendran

In recent days, Artificial Neural Network (ANN) can be applied to a vast majority of fields including business, medicine, engineering, etc. The most popular areas where ANN is employed nowadays are pattern and sequence recognition, novelty…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Md. Abu Bakr Siddique , Mohammad Mahmudur Rahman Khan , Rezoana Bente Arif , Zahidun Ashrafi

We present a ghost handwritten digit recognition method for the unknown handwritten digits based on ghost imaging (GI) with deep neural network, where a few detection signals from the bucket detector, generated by the Cosine Transform…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Xing He , Shengmei Zhao , Le Wang

Binary neural networks provide a promising solution for low-power, high-speed inference by replacing expensive floating-point operations with bitwise logic. This makes them well-suited for deployment on resource-constrained platforms such…

Hardware Architecture · Computer Science 2025-12-23 Emir Devlet Ertörer , Cem Ünsalan

Neural networks have shown great potential in many applications like speech recognition, drug discovery, image classification, and object detection. Neural network models are inspired by biological neural networks, but they are optimized to…

Neural and Evolutionary Computing · Computer Science 2018-03-23 Yuan Zeng , Kevin Devincentis , Yao Xiao , Zubayer Ibne Ferdous , Xiaochen Guo , Zhiyuan Yan , Yevgeny Berdichevsky

The reliance of humans over machines has never been so high such that from object classification in photographs to adding sound to silent movies everything can be performed with the help of deep learning and machine learning algorithms.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Samay Pashine , Ritik Dixit , Rishika Kushwah

Artificial neural networks are most commonly trained with the back-propagation algorithm, where the gradient for learning is provided by back-propagating the error, layer by layer, from the output layer to the hidden layers. A recently…

Machine Learning · Statistics 2016-12-22 Arild Nøkland

We revisit the classical Sobel operator to ask a simple question: Are first-order edge maps sufficient to drive an all-dense multilayer perceptron (MLP) for handwritten character recognition (HCR), as an alternative to convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Azam Nouri

For most deep learning algorithms training is notoriously time consuming. Since most of the computation in training neural networks is typically spent on floating point multiplications, we investigate an approach to training that eliminates…

Machine Learning · Computer Science 2016-02-29 Zhouhan Lin , Matthieu Courbariaux , Roland Memisevic , Yoshua Bengio

Developing strong AI signifies the arrival of technological singularity, contributing greatly to advancing human civilization and resolving social issues. Neural networks (NNs) and deep learning, which utilize NNs, are expected to lead to…

Machine Learning · Computer Science 2024-09-09 Kei Itoh

Deep Belief Networks which are hierarchical generative models are effective tools for feature representation and extraction. Furthermore, DBNs can be used in numerous aspects of Machine Learning such as image denoising. In this paper, we…

Machine Learning · Computer Science 2014-01-03 Mohammad Ali Keyvanrad , Mohammad Pezeshki , Mohammad Ali Homayounpour

Although the image recognition has been a research topic for many years, many researchers still have a keen interest in it[1]. In some papers[2][3][4], however, there is a tendency to compare models only on one or two datasets, either…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Feiyang Chen , Nan Chen , Hanyang Mao , Hanlin Hu

Our proposed deeply-supervised nets (DSN) method simultaneously minimizes classification error while making the learning process of hidden layers direct and transparent. We make an attempt to boost the classification performance by studying…

Machine Learning · Statistics 2017-04-26 Chen-Yu Lee , Saining Xie , Patrick Gallagher , Zhengyou Zhang , Zhuowen Tu

Deep neural networks (DNN) are powerful models for many pattern recognition tasks, yet their high computational complexity and memory requirement limit them to applications on high-performance computing platforms. In this paper, we propose…

Machine Learning · Computer Science 2018-10-24 Lukas Mauch , Bin Yang

Deep neural networks (DNNs) have achieved the state of the art performance in numerous fields. However, DNNs need high computation times, and people always expect better performance in a lower computation. Therefore, we study the human…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 H M Dipu Kabir , Moloud Abdar , Seyed Mohammad Jafar Jalali , Abbas Khosravi , Amir F Atiya , Saeid Nahavandi , Dipti Srinivasan