English

Norm-Based Capacity Control in Neural Networks

Machine Learning 2015-04-16 v2 Artificial Intelligence Neural and Evolutionary Computing Machine Learning
Authors: Behnam Neyshabur , Ryota Tomioka , Nathan Srebro
View on arXiv ↗ PDF ↗

Abstract

We investigate the capacity, convexity and characterization of a general family of norm-constrained feed-forward networks.

Keywords

network topology

Cite

@article{arxiv.1503.00036,
  title  = {Norm-Based Capacity Control in Neural Networks},
  author = {Behnam Neyshabur and Ryota Tomioka and Nathan Srebro},
  journal= {arXiv preprint arXiv:1503.00036},
  year   = {2015}
}

Comments

29 pages

Related papers

View all related →
Machine Learning · Computer Science
Bounds on the Approximation Power of Feedforward Neural Networks
Mohammad Mehrabi, Aslan Tchamkerten, Mansoor I. Yousefi
2018-07-02
Machine Learning · Computer Science
Input Convex Neural Networks
Brandon Amos, Lei Xu, J. Zico Kolter
2017-06-15
Machine Learning · Computer Science
The Curious Case of Convex Neural Networks
Sarath Sivaprasad, Ankur Singh, Naresh Manwani, Vineet Gandhi
2021-07-13
Machine Learning · Computer Science
The capacity of feedforward neural networks
Pierre Baldi, Roman Vershynin
2019-03-29
Machine Learning · Computer Science
On Measuring Excess Capacity in Neural Networks
Florian Graf, Sebastian Zeng, Bastian Rieck, Marc Niethammer +1
2023-01-20
Machine Learning · Computer Science
Formalizing Generalization and Robustness of Neural Networks to Weight Perturbations
Yu-Lin Tsai, Chia-Yi Hsu, Chia-Mu Yu, Pin-Yu Chen
2021-12-20
Machine Learning · Computer Science
The Sample Complexity of One-Hidden-Layer Neural Networks
Gal Vardi, Ohad Shamir, Nathan Srebro
2022-09-23
Machine Learning · Statistics
Generalization Bounds for Convolutional Neural Networks
Shan Lin, Jingwei Zhang
2019-10-04
Systems and Control · Electrical Eng. & Systems
Convex neural network synthesis for robustness in the 1-norm
Ross Drummond, Chris Guiver, Matthew C. Turner
2024-05-30
Machine Learning · Computer Science
Neural Network Verification in Control
Michael Everett
2022-02-03
Optimization and Control · Mathematics
Optimal Control Via Neural Networks: A Convex Approach
Yize Chen, Yuanyuan Shi, Baosen Zhang
2019-02-28
Machine Learning · Computer Science
Understanding Weight Normalized Deep Neural Networks with Rectified Linear Units
Yixi Xu, Xiao Wang
2018-11-29
Machine Learning · Computer Science
Learning Neural Networks with Adaptive Regularization
Han Zhao, Yao-Hung Hubert Tsai, Ruslan Salakhutdinov, Geoffrey J. Gordon
2019-10-24
Machine Learning · Computer Science
Convexified Convolutional Neural Networks
Yuchen Zhang, Percy Liang, Martin J. Wainwright
2016-09-06
Neurons and Cognition · Quantitative Biology
Neuronal networks and controlled symmetries, a generic framework
Léonard Gérard, Jean-Jacques Slotine
2008-03-29
Machine Learning · Computer Science
Numerical Approximation Capacity of Neural Networks with Bounded Parameters: Do Limits Exist, and How Can They Be Measured?
Li Liu, Tengchao Yu, Heng Yong
2024-09-26
Machine Learning · Computer Science
A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks
Behnam Neyshabur, Srinadh Bhojanapalli, Nathan Srebro
2018-02-27
Systems and Control · Electrical Eng. & Systems
On Recurrent Neural Networks for learning-based control: recent results and ideas for future developments
Fabio Bonassi, Marcello Farina, Jing Xie, Riccardo Scattolini
2022-05-11
Disordered Systems and Neural Networks · Physics
Pinning-controllability of complex networks
Francesco Sorrentino, Mario di Bernardo, Franco Garofalo, Guanrong Chen
2007-05-23
Systems and Control · Electrical Eng. & Systems
Efficient Reachability Analysis of Closed-Loop Systems with Neural Network Controllers
Michael Everett, Golnaz Habibi, Jonathan P. How
2021-05-26
Machine Learning · Computer Science
Band-limited Training and Inference for Convolutional Neural Networks
Adam Dziedzic, John Paparrizos, Sanjay Krishnan, Aaron Elmore +1
2019-11-22
Computer Vision and Pattern Recognition · Computer Science
Constrained Structured Regression with Convolutional Neural Networks
Deepak Pathak, Philipp Krähenbühl, Stella X. Yu, Trevor Darrell
2015-11-25
Information Theory · Computer Science
Capacity of Non-Separable Networks with Restricted Adversaries
Christopher Hojny, Altan B. Kılıç, Sascha Kurz, Alberto Ravagnani
2026-03-10
Information Theory · Computer Science
Network Decoding
Allison Beemer, Altan Berdan Kilic, Alberto Ravagnani
2022-05-31
Machine Learning · Statistics
The $\varphi$ Curve: The Shape of Generalization through the Lens of Norm-based Capacity Control
Yichen Wang, Yudong Chen, Lorenzo Rosasco, Fanghui Liu
2025-10-22
R2 v1 2026-06-22T08:40:15.812Z