English
Related papers

Related papers: PyTorch Hyperparameter Tuning - A Tutorial for spo…

200 papers

Effective performance profiling and analysis are essential for optimizing training and inference of deep learning models, especially given the growing complexity of heterogeneous computing environments. However, existing tools often lack…

Performance · Computer Science 2024-11-06 Qidong Zhao , Hao Wu , Yuming Hao , Zilingfeng Ye , Jiajia Li , Xu Liu , Keren Zhou

Batch Machine Learning (BML) reaches its limits when dealing with very large amounts of streaming data. This is especially true for available memory, handling drift in data streams, and processing new, unknown data. Online Machine Learning…

Machine Learning · Computer Science 2024-02-20 Thomas Bartz-Beielstein

Large-scale pre-trained transformers have demonstrated remarkable success in various computer vision tasks. However, it is still highly challenging to fully fine-tune these models for downstream tasks due to their high computational and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Zhao Song , Ke Yang , Naiyang Guan , Junjie Zhu , Peng Qiao , Qingyong Hu

DNN learning jobs are common in today's clusters due to the advances in AI driven services such as machine translation and image recognition. The most critical phase of these jobs for model performance and learning cost is the tuning of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-05 Isabelly Rocha , Nathaniel Morris , Lydia Y. Chen , Pascal Felber , Robert Birke , Valerio Schiavoni

Machine learning applications often require hyperparameter tuning. The hyperparameters usually drive both the efficiency of the model training process and the resulting model quality. For hyperparameter tuning, machine learning algorithms…

Machine Learning · Computer Science 2018-08-06 Patrick Koch , Oleg Golovidov , Steven Gardner , Brett Wujek , Joshua Griffin , Yan Xu

Deep learning has significantly improved 2D image recognition. Extending into 3D may advance many new applications including autonomous vehicles, virtual and augmented reality, authoring 3D content, and even improving 2D recognition.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Nikhila Ravi , Jeremy Reizenstein , David Novotny , Taylor Gordon , Wan-Yen Lo , Justin Johnson , Georgia Gkioxari

Deep learning (DL) has been a revolutionary technique in various domains. To facilitate the model development and deployment, many deep learning frameworks are proposed, among which PyTorch is one of the most popular solutions. The…

Machine Learning · Computer Science 2023-06-27 Yueming Hao , Xu Zhao , Bin Bao , David Berard , Will Constable , Adnan Aziz , Xu Liu

Tuning hyperparameters for machine learning algorithms is a tedious task, one that is typically done manually. To enable automated hyperparameter tuning, recent works have started to use techniques based on Bayesian optimization. However,…

Machine Learning · Computer Science 2020-05-26 Sandeep Singh Sandha , Mohit Aggarwal , Igor Fedorov , Mani Srivastava

Deep learning algorithms have made many breakthroughs and have various applications in real life. Computational resources become a bottleneck as the data and complexity of the deep learning pipeline increases. In this paper, we propose…

Machine Learning · Computer Science 2021-05-05 Salman Ahmed , Hammad Naveed

There has been a considerable interest in constrained training of deep neural networks (DNNs) recently for applications such as fairness and safety. Several toolkits have been proposed for this task, yet there is still no industry standard.…

Machine Learning · Computer Science 2025-09-26 Andrii Kliachkin , Jana Lepšová , Gilles Bareilles , Jakub Mareček

Modern deep learning frameworks provide imperative, eager execution programming interfaces embedded in Python to provide a productive development experience. However, deep learning practitioners sometimes need to capture and transform…

Machine Learning · Computer Science 2022-03-08 James K. Reed , Zachary DeVito , Horace He , Ansley Ussery , Jason Ansel

Hyperparameter tuning is the black art of automatically finding a good combination of control parameters for a data miner. While widely applied in empirical Software Engineering, there has not been much discussion on which hyperparameter…

Artificial Intelligence · Computer Science 2018-10-04 Huy Tu , Vivek Nair

This paper introduces HyperNOs, a PyTorch library designed to streamline and automate the process of exploring neural operators, with a special focus on hyperparameter optimization for comprehensive and exhaustive exploration. Indeed,…

Machine Learning · Computer Science 2026-02-09 Massimiliano Ghiotto

Sherpa is a hyperparameter optimization library for machine learning models. It is specifically designed for problems with computationally expensive, iterative function evaluations, such as the hyperparameter tuning of deep neural networks.…

Machine Learning · Computer Science 2020-05-11 Lars Hertel , Julian Collado , Peter Sadowski , Jordan Ott , Pierre Baldi

The rising demand for high-performance computing (HPC) has made full-chip dynamic thermal simulation in many-core GPUs critical for optimizing performance and extending device lifespans. Proper orthogonal decomposition (POD) with Galerkin…

Computational Engineering, Finance, and Science · Computer Science 2024-12-10 Neil He , Ming-Cheng Cheng , Yu Liu

We introduce PyTorch Geometric, a library for deep learning on irregularly structured input data such as graphs, point clouds and manifolds, built upon PyTorch. In addition to general graph data structures and processing methods, it…

Machine Learning · Computer Science 2019-04-26 Matthias Fey , Jan Eric Lenssen

Machine learning algorithms such as random forests or xgboost are gaining more importance and are increasingly incorporated into production processes in order to enable comprehensive digitization and, if possible, automation of processes.…

Machine Learning · Computer Science 2021-07-20 Eva Bartz , Martin Zaefferer , Olaf Mersmann , Thomas Bartz-Beielstein

We present a new open source python package, based on PyLightcurve and PyTorch, tailored for efficient computation and automatic differentiation of exoplanetary transits. The classes and functions implemented are fully vectorised, natively…

Earth and Planetary Astrophysics · Physics 2021-03-24 Mario Morvan , Angelos Tsiaras , Nikolaos Nikolaou , Ingo P. Waldmann

In order to contrast the explosion in size of state-of-the-art machine learning models that can be attributed to the empirical advantages of over-parametrization, and due to the necessity of deploying fast, sustainable, and private…

Machine Learning · Computer Science 2020-04-30 Michela Paganini , Jessica Forde

Deep metric learning algorithms have a wide variety of applications, but implementing these algorithms can be tedious and time consuming. PyTorch Metric Learning is an open source library that aims to remove this barrier for both…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Kevin Musgrave , Serge Belongie , Ser-Nam Lim