English
Related papers

Related papers: Hyperparameter Optimization through Neural Network…

200 papers

Training of modern large neural networks (NN) requires a combination of parallelization strategies encompassing data, model, or optimizer sharding. When strategies increase in complexity, it becomes necessary for partitioning tools to be 1)…

Distributed training of GNNs enables learning on massive graphs (e.g., social and e-commerce networks) that exceed the storage and computational capacity of a single machine. To reach performance comparable to centralized training,…

Machine Learning · Computer Science 2023-05-18 Jiong Zhu , Aishwarya Reganti , Edward Huang , Charles Dickens , Nikhil Rao , Karthik Subbian , Danai Koutra

This paper surveys studies on the use of neural networks for optimization in the training-data-free setting. Specifically, we examine the dataless application of neural network architectures in optimization by re-parameterizing problems…

Machine Learning · Computer Science 2025-10-31 Alvaro Velasquez , Susmit Jha , Ismail R. Alkhouri

Quantum Machine Learning is an emerging sub-field in machine learning where one of the goals is to perform pattern recognition tasks by encoding data into quantum states. This extension from classical to quantum domain has been made…

Quantum Physics · Physics 2023-04-18 Ankit Kulshrestha , Xiaoyuan Liu , Hayato Ushijima-Mwesigwa , Ilya Safro

In domains such as health care and finance, shortage of labeled data and computational resources is a critical issue while developing machine learning algorithms. To address the issue of labeled data scarcity in training and deployment of…

Machine Learning · Computer Science 2018-10-16 Otkrist Gupta , Ramesh Raskar

Since deep neural networks were developed, they have made huge contributions to everyday lives. Machine learning provides more rational advice than humans are capable of in almost every aspect of daily life. However, despite this…

Machine Learning · Computer Science 2020-03-13 Tong Yu , Hong Zhu

Generalization is a central problem in Machine Learning. Most prediction methods require careful calibration of hyperparameters carried out on a hold-out \textit{validation} dataset to achieve generalization. The main goal of this paper is…

Machine Learning · Computer Science 2020-06-15 Karim Lounici , Katia Meziani , Benjamin Riu

The success of machine learning solutions for reasoning about discrete structures has brought attention to its adoption within combinatorial optimization algorithms. Such approaches generally rely on supervised learning by leveraging…

Machine Learning · Computer Science 2022-03-17 Ismail R. Alkhouri , George K. Atia , Alvaro Velasquez

Data and knowledge representation are fundamental concepts in machine learning. The quality of the representation impacts the performance of the learning model directly. Feature learning transforms or enhances raw data to structures that…

Artificial Intelligence · Computer Science 2021-04-26 Filipe Alves Neto Verri , Renato Tinós , Liang Zhao

Tuning hyperparameters of learning algorithms is hard because gradients are usually unavailable. We compute exact gradients of cross-validation performance with respect to all hyperparameters by chaining derivatives backwards through the…

Machine Learning · Statistics 2015-04-03 Dougal Maclaurin , David Duvenaud , Ryan P. Adams

Feature representations from pre-trained deep neural networks have been known to exhibit excellent generalization and utility across a variety of related tasks. Fine-tuning is by far the simplest and most widely used approach that seeks to…

Computer Vision and Pattern Recognition · Computer Science 2017-10-09 Donghyun Yoo , Haoqi Fan , Vishnu Naresh Boddeti , Kris M. Kitani

It is typical for a machine learning system to have numerous hyperparameters that affect its learning rate and prediction quality. Finding a good combination of the hyperparameters is, however, a challenging job. This is mainly because…

Machine Learning · Computer Science 2019-08-08 Dobromir Marinov , Daniel Karapetyan

Learning processes are useful methodologies able to improve knowledge of real phenomena. These are often dependent on hyperparameters, variables set before the training process and regulating the learning procedure. Hyperparameters…

Optimization and Control · Mathematics 2023-11-10 Flavia Esposito , Laura Selicato , Caterina Sportelli

Overparameterization refers to the important phenomenon where the width of a neural network is chosen such that learning algorithms can provably attain zero loss in nonconvex training. The existing theory establishes such global convergence…

Machine Learning · Computer Science 2021-11-04 Chaehwan Song , Ali Ramezani-Kebrya , Thomas Pethick , Armin Eftekhari , Volkan Cevher

Federated Learning (FL) decouples model training from the need for direct access to the data and allows organizations to collaborate with industry partners to reach a satisfying level of performance without sharing vulnerable business…

Machine Learning · Computer Science 2021-10-22 Stephanie Holly , Thomas Hiessl , Safoura Rezapour Lakani , Daniel Schall , Clemens Heitzinger , Jana Kemnitz

In recent studies, the generalization properties for distributed learning and random features assumed the existence of the target concept over the hypothesis space. However, this strict condition is not applicable to the more common…

Machine Learning · Computer Science 2023-08-30 Jian Li , Yong Liu , Weiping Wang

Hyper-parameter optimization is crucial for pushing the accuracy of a deep learning model to its limits. A hyper-parameter optimization job, referred to as a study, involves numerous trials of training a model using different training…

Machine Learning · Computer Science 2020-06-23 Ahnjae Shin , Do Yoon Kim , Joo Seong Jeong , Byung-Gon Chun

While large training datasets generally offer improvement in model performance, the training process becomes computationally expensive and time consuming. Distributed learning is a common strategy to reduce the overall training time by…

Machine Learning · Statistics 2021-10-22 Nicole Mücke , Enrico Reiss , Jonas Rungenhagen , Markus Klein

Since the deep learning model is highly dependent on hyperparameters, hyperparameter optimization is essential in developing deep learning model-based applications, even if it takes a long time. As service development using deep learning…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Kangil Lee , Junho Yim

Despite the recent success of stochastic gradient descent in deep learning, it is often difficult to train a deep neural network with an inappropriate choice of its initial parameters. Even if training is successful, it has been known that…

Machine Learning · Computer Science 2023-02-10 Cheolhyoung Lee , Kyunghyun Cho