Piecewise Linear Multilayer Perceptrons and Dropout
Machine Learning
2013-01-23 v1 Machine Learning
Authors:
Ian J. Goodfellow
Abstract
We propose a new type of hidden layer for a multilayer perceptron, and demonstrate that it obtains the best reported performance for an MLP on the MNIST dataset.
Cite
@article{arxiv.1301.5088,
title = {Piecewise Linear Multilayer Perceptrons and Dropout},
author = {Ian J. Goodfellow},
journal= {arXiv preprint arXiv:1301.5088},
year = {2013}
}
Related papers
View all related →
Neural and Evolutionary Computing · Computer Science
Deepest Neural Networks
Raul Rojas
2017-07-11
Machine Learning · Computer Science
MLPs to Find Extrema of Functionals
Tao Liu
2020-07-03
Neural and Evolutionary Computing · Computer Science
Understanding Dropout: Training Multi-Layer Perceptrons with Auxiliary Independent Stochastic Neurons
Kyunghyun Cho
2013-08-20
Machine Learning · Computer Science
T-MLP: Tailed Multi-Layer Perceptron for Level-of-Detail Signal Representation
Chuanxiang Yang, Yuanfeng Zhou, Guangshun Wei, Siyu Ren +3
2025-09-30
Audio and Speech Processing · Electrical Eng. & Systems
Deep Multilayer Perceptrons for Dimensional Speech Emotion Recognition
Bagus Tris Atmaja, Masato Akagi
2022-09-28
Machine Learning · Computer Science
Generalizing MLPs With Dropouts, Batch Normalization, and Skip Connections
Taewoon Kim
2021-08-24
Machine Learning · Computer Science
Constructing Multilayer Perceptrons as Piecewise Low-Order Polynomial Approximators: A Signal Processing Approach
Ruiyuan Lin, Suya You, Raghuveer Rao, C. -C. Jay Kuo
2020-10-16
Machine Learning · Computer Science
Understanding MLP-Mixer as a Wide and Sparse MLP
Tomohiro Hayase, Ryo Karakida
2024-05-08
Machine Learning · Computer Science
Scaling MLPs: A Tale of Inductive Bias
Gregor Bachmann, Sotiris Anagnostidis, Thomas Hofmann
2023-10-04
Statistics Theory · Mathematics
Estimation consistante de l'architecture des perceptrons multicouches
Joseph Rynkiewicz
2008-02-22
Computer Vision and Pattern Recognition · Computer Science
Image denoising with multi-layer perceptrons, part 1: comparison with existing algorithms and with bounds
Harold Christopher Burger, Christian J. Schuler, Stefan Harmeling
2012-11-12
Computer Vision and Pattern Recognition · Computer Science
Neural Reflectance for Shape Recovery with Shadow Handling
Junxuan Li, Hongdong Li
2022-03-25
Machine Learning · Computer Science
Multi-Head ReLU Implicit Neural Representation Networks
Arya Aftab, Alireza Morsali
2022-02-28
Machine Learning · Computer Science
Group-Connected Multilayer Perceptron Networks
Mohammad Kachuee, Sajad Darabi, Shayan Fazeli, Majid Sarrafzadeh
2020-11-26
Machine Learning · Computer Science
From Two-Class Linear Discriminant Analysis to Interpretable Multilayer Perceptron Design
Ruiyuan Lin, Zhiruo Zhou, Suya You, Raghuveer Rao +1
2020-09-10
Machine Learning · Computer Science
A Probabilistic Representation of Deep Learning for Improving The Information Theoretic Interpretability
Xinjie Lan, Kenneth E. Barner
2020-10-28
Computer Vision and Pattern Recognition · Computer Science
BiMLP: Compact Binary Architectures for Vision Multi-Layer Perceptrons
Yixing Xu, Xinghao Chen, Yunhe Wang
2023-01-02
Computer Vision and Pattern Recognition · Computer Science
MM-UNet: A Mixed MLP Architecture for Improved Ophthalmic Image Segmentation
Zunjie Xiao, Xiaoqing Zhang, Risa Higashita, Jiang Liu
2024-08-19
Computer Vision and Pattern Recognition · Computer Science
Revisiting the Transferability of Supervised Pretraining: an MLP Perspective
Yizhou Wang, Shixiang Tang, Feng Zhu, Lei Bai +3
2022-03-29
Graphics · Computer Science
GratNet: A Photorealistic Neural Shader for Diffractive Surfaces
Narayan Kandel, Daljit Singh J. S. Dhillon
2025-07-03
Machine Learning · Statistics
Techniques for Learning Binary Stochastic Feedforward Neural Networks
Tapani Raiko, Mathias Berglund, Guillaume Alain, Laurent Dinh
2015-04-10
Computer Vision and Pattern Recognition · Computer Science
MC-MLP:Multiple Coordinate Frames in all-MLP Architecture for Vision
Zhimin Zhu, Jianguo Zhao, Tong Mu, Yuliang Yang +1
2023-04-11
Statistics Theory · Mathematics
Efficient Estimation of Multidimensional Regression Model with Multilayer Perceptron
Joseph Rynkiewicz
2008-02-22
Machine Learning · Computer Science
A Neural ODE Interpretation of Transformer Layers
Yaofeng Desmond Zhong, Tongtao Zhang, Amit Chakraborty, Biswadip Dey
2022-12-13
Machine Learning · Computer Science
A technical note on bilinear layers for interpretability
Lee Sharkey
2023-05-08