English
Related papers

Related papers: Training Neural Networks at Any Scale

200 papers

Training and inference in deep neural networks (DNNs) has, due to a steady increase in architectural complexity and data set size, lead to the development of strategies for reducing time and space requirements of DNN training and inference,…

Machine Learning · Computer Science 2021-08-24 Lorenz Kummer

Machine learning models are often tuned by nesting optimization of model weights inside the optimization of hyperparameters. We give a method to collapse this nested optimization into joint stochastic optimization of weights and…

Machine Learning · Computer Science 2018-03-09 Jonathan Lorraine , David Duvenaud

Subspace clustering algorithms are notorious for their scalability issues because building and processing large affinity matrices are demanding. In this paper, we introduce a method that simultaneously learns an embedding space along…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Tong Zhang , Pan Ji , Mehrtash Harandi , Richard Hartley , Ian Reid

In this work, we propose to progressively increase the training difficulty during learning a neural network model via a novel strategy which we call mini-batch trimming. This strategy makes sure that the optimizer puts its focus in the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Hannes Fassold

Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of efficiently…

Machine Learning · Computer Science 2024-10-16 Yuntian Gu , Xuzheng Chen

As deep learning methodologies have developed, it has been generally agreed that increasing neural network size improves model quality. However, this is at the expense of memory and compute requirements, which also need to be increased.…

Machine Learning · Computer Science 2024-08-07 Mitchelle Rasquinha , Gil Tabak

We design algorithms for online linear optimization that have optimal regret and at the same time do not need to know any upper or lower bounds on the norm of the loss vectors. We achieve adaptiveness to norms of loss vectors by scale…

Machine Learning · Computer Science 2015-07-03 Francesco Orabona , David Pal

Training a large multilayer neural network can present many difficulties due to the large number of useless stationary points. These points usually attract the minimization algorithm used during the training phase, which therefore results…

Optimization and Control · Mathematics 2021-06-14 Alberto De Santis , Giampaolo Liuzzi , Stefano Lucidi , Edoardo Maria Tronci

Neural Combinatorial Optimization attempts to learn good heuristics for solving a set of problems using Neural Network models and Reinforcement Learning. Recently, its good performance has encouraged many practitioners to develop neural…

Artificial Intelligence · Computer Science 2022-05-04 Andoni I. Garmendia , Josu Ceberio , Alexander Mendiburu

This paper presents a state-of-the-art overview on how to architect, design, and optimize Deep Neural Networks (DNNs) such that performance is improved and accuracy is preserved. The paper covers a set of optimizations that span the entire…

Machine Learning · Computer Science 2022-08-05 Humberto Carvalho , Pavel Zaykov , Asim Ukaye

This paper explores learned-context neural networks. It is a multi-task learning architecture based on a fully shared neural network and an augmented input vector containing trainable task parameters. The architecture is interesting due to…

Machine Learning · Computer Science 2025-08-07 Anders T. Sandnes , Bjarne Grimstad , Odd Kolbjørnsen

A novel solve-training framework is proposed to train neural network in representing low dimensional solution maps of physical models. Solve-training framework uses the neural network as the ansatz of the solution map and train the network…

Numerical Analysis · Mathematics 2020-10-16 Yingzhou Li , Jianfeng Lu , Anqi Mao

The rapid advances in the field of optimization methods in many pure and applied science pose the difficulty of keeping track of the developments as well as selecting an appropriate technique that best suits the problem in-hand. From a…

Neural and Evolutionary Computing · Computer Science 2011-12-30 Loris Serafino

Many optimizers have been proposed for training deep neural networks, and they often have multiple hyperparameters, which make it tricky to benchmark their performance. In this work, we propose a new benchmarking protocol to evaluate both…

Machine Learning · Computer Science 2020-10-21 Yuanhao Xiong , Xuanqing Liu , Li-Cheng Lan , Yang You , Si Si , Cho-Jui Hsieh

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

The move from hand-designed features to learned features in machine learning has been wildly successful. In spite of this, optimization algorithms are still designed by hand. In this paper we show how the design of an optimization algorithm…

Neural and Evolutionary Computing · Computer Science 2016-12-01 Marcin Andrychowicz , Misha Denil , Sergio Gomez , Matthew W. Hoffman , David Pfau , Tom Schaul , Brendan Shillingford , Nando de Freitas

The era of huge data necessitates highly efficient machine learning algorithms. Many common machine learning algorithms, however, rely on computationally intensive subroutines that are prohibitively expensive on large datasets. Oftentimes,…

Machine Learning · Computer Science 2023-09-26 Mo Tiwari

This paper presents a comparative analysis of distributed training strategies for large-scale neural networks, focusing on data parallelism, model parallelism, and hybrid approaches. We evaluate these strategies on image classification…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-01 Vishnu Vardhan Baligodugula , Fathi Amsaad

Today's most powerful machine learning approaches are typically designed to train stateless architectures with predefined layers and differentiable activation functions. While these approaches have led to unprecedented successes in areas…

Machine Learning · Computer Science 2023-12-25 Alexander Grushin

In the last decade, motivated by the success of Deep Learning, the scientific community proposed several approaches to make the learning procedure of Neural Networks more effective. When focussing on the way in which the training data are…

Machine Learning · Computer Science 2021-06-22 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci