English

How to Train your DNN: The Network Operator Edition

Networking and Internet Architecture 2020-04-23 v1 Distributed, Parallel, and Cluster Computing Machine Learning
Authors: Michael Alan Chang , Domenic Bottini , Lisa Jian , Pranay Kumar , Aurojit Panda , Scott Shenker
View on arXiv ↗ PDF ↗

Abstract

Deep Neural Nets have hit quite a crest, But physical networks are where they must rest, And here we put them all to the test, To see which network optimization is best.

Cite

@article{arxiv.2004.10275,
  title  = {How to Train your DNN: The Network Operator Edition},
  author = {Michael Alan Chang and Domenic Bottini and Lisa Jian and Pranay Kumar and Aurojit Panda and Scott Shenker},
  journal= {arXiv preprint arXiv:2004.10275},
  year   = {2020}
}

Related papers

View all related →
Machine Learning · Computer Science
Distributed Training and Optimization Of Neural Networks
Jean-Roch Vlimant, Junqi Yin
2022-12-20
Neural and Evolutionary Computing · Computer Science
Dynamic Optimization of Neural Network Structures Using Probabilistic Modeling
Shinichi Shirakawa, Yasushi Iwata, Youhei Akimoto
2018-01-24
Machine Learning · Computer Science
Optimization for deep learning: theory and algorithms
Ruoyu Sun
2019-12-21
Information Theory · Computer Science
Online Deep Neural Network for Optimization in Wireless Communications
Jiabao Gao, Caijun Zhong, Geoffrey Ye Li, Zhaoyang Zhang
2022-02-08
Machine Learning · Computer Science
On the Computational Efficiency of Training Neural Networks
Roi Livni, Shai Shalev-Shwartz, Ohad Shamir
2014-10-29
Machine Learning · Computer Science
Learning Gradient Descent: Better Generalization and Longer Horizons
Kaifeng Lv, Shunhua Jiang, Jian Li
2017-06-13
Signal Processing · Electrical Eng. & Systems
Network Optimization -- Using Relays as Neurons
Itsik Bergel
2023-06-27
Machine Learning · Computer Science
Over-Sampling in a Deep Neural Network
Andrew J. R. Simpson
2015-02-13
Machine Learning · Computer Science
Computational complexity reduction of deep neural networks
Mee Seong Im, Venkat R. Dasari
2022-08-01
Machine Learning · Computer Science
Efficiently Finding Adversarial Examples with DNN Preprocessing
Avriti Chauhan, Mohammad Afzal, Hrishikesh Karmarkar, Yizhak Elboher +2
2022-11-17
Machine Learning · Computer Science
Algorithms for Verifying Deep Neural Networks
Changliu Liu, Tomer Arnon, Christopher Lazarus, Christopher Strong +2
2020-12-02
Machine Learning · Computer Science
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis
Tal Ben-Nun, Torsten Hoefler
2018-09-18
Machine Learning · Computer Science
Pruning and Slicing Neural Networks using Formal Verification
Ori Lahav, Guy Katz
2021-08-13
Machine Learning · Computer Science
Survey on Large Scale Neural Network Training
Julia Gusak, Daria Cherniuk, Alena Shilova, Alexander Katrutsa +7
2022-02-22
Signal Processing · Electrical Eng. & Systems
Theoretical Analysis of Deep Neural Networks in Physical Layer Communication
Jun Liu, Haitao Zhao, Dongtang Ma, Kai Mei +1
2022-08-30
Machine Learning · Computer Science
Model Based and Physics Informed Deep Learning Neural Network Structures
Ali Mohammad-Djafari, Ning Chu, Li Wang, Caifang Cai +1
2024-08-15
Applied Physics · Physics
Training of Physical Neural Networks
Ali Momeni, Babak Rahmani, Benjamin Scellier, Logan G. Wright +24
2024-06-06
Machine Learning · Computer Science
Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systems
Logan G. Wright, Tatsuhiro Onodera, Martin M. Stein, Tianyu Wang +3
2022-01-31
Machine Learning · Computer Science
Optimally Deep Networks -- Adapting Model Depth to Datasets for Superior Efficiency
Shaharyar Ahmed Khan Tareen, Filza Khan Tareen
2025-11-26
Machine Learning · Computer Science
A Unified Framework for Training Neural Networks
Hadi Ghauch, Hossein Shokri-Ghadikolaei, Carlo Fischione, Mikael Skoglund
2018-05-24
Neural and Evolutionary Computing · Computer Science
Evaluating Deep Neural Networks in Deployment (A Comparative and Replicability Study)
Eduard Pinconschi, Divya Gopinath, Rui Abreu, Corina S. Pasareanu
2024-07-30
Machine Learning · Computer Science
Designing Interpretable Approximations to Deep Reinforcement Learning
Nathan Dahlin, Krishna Chaitanya Kalagarla, Nikhil Naik, Rahul Jain +1
2021-06-22
Systems and Control · Computer Science
Real-time optimal control via Deep Neural Networks: study on landing problems
Carlos Sánchez-Sánchez, Dario Izzo
2016-10-28
Machine Learning · Computer Science
TRADI: Tracking deep neural network weight distributions for uncertainty estimation
Gianni Franchi, Andrei Bursuc, Emanuel Aldea, Severine Dubuisson +1
2021-03-26
Machine Learning · Computer Science
Deep Neural Networks as Complex Networks
Emanuele La Malfa, Gabriele La Malfa, Claudio Caprioli, Giuseppe Nicosia +1
2022-09-14
R2 v1 2026-06-23T15:00:44.434Z