中文
相关论文

相关论文: PyTorch Hyperparameter Tuning - A Tutorial for spo…

200 篇论文

We introduce PyTorchVideo, an open-source deep-learning library that provides a rich set of modular, efficient, and reproducible components for a variety of video understanding tasks, including classification, detection, self-supervised…

Evolutionary computation is an important component within various fields such as artificial intelligence research, reinforcement learning, robotics, industrial automation and/or optimization, engineering design, etc. Considering the…

神经与进化计算 · 计算机科学 2023-05-23 Nihat Engin Toklu , Timothy Atkinson , Vojtěch Micka , Paweł Liskowski , Rupesh Kumar Srivastava

This work focuses on the problem of hyper-parameter tuning (HPT) for robust (i.e., adversarially trained) models, shedding light on the new challenges and opportunities arising during the HPT process for robust models. To this end, we…

机器学习 · 计算机科学 2024-06-14 Pedro Mendes , Paolo Romano , David Garlan

In this paper, we introduce MCTensor, a library based on PyTorch for providing general-purpose and high-precision arithmetic for DL training. MCTensor is used in the same way as PyTorch Tensor: we implement multiple basic, matrix-level…

机器学习 · 计算机科学 2022-08-31 Tao Yu , Wentao Guo , Jianan Canal Li , Tiancheng Yuan , Christopher De Sa

HyperDimensional Computing (HDC) as a machine learning paradigm is highly interesting for applications involving continuous, semi-supervised learning for long-term monitoring. However, its accuracy is not yet on par with other Machine…

机器学习 · 计算机科学 2023-12-19 William Andrew Simon , Una Pale , Tomas Teijeiro , David Atienza

There is a need for open-source libraries in emission tomography that (i) use modern and popular backend code to encourage community contributions and (ii) offer support for the multitude of reconstruction techniques available in recent…

Motivated by the growing demand for low-precision arithmetic in computational science, we exploit lower-precision emulation in Python -- widely regarded as the dominant programming language for numerical analysis and machine learning.…

机器学习 · 计算机科学 2026-02-26 Erin Carson , Xinye Chen

Novel technologies in automated machine learning ease the complexity of algorithm selection and hyperparameter optimization. Hyperparameters are important for machine learning models as they significantly influence the performance of…

机器学习 · 计算机科学 2021-08-31 Mohamadjavad Bahmani , Radwa El Shawi , Nshan Potikyan , Sherif Sakr

Three-dimensional (3D) point cloud analysis has become central to applications ranging from autonomous driving and robotics to forestry and ecological monitoring. Although numerous deep learning methods have been proposed for point cloud…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Said Ohamouddou , Hanaa El Afia , Abdellatif El Afia , Raddouane Chiheb

Hyper-parameters optimization (HPO) is vital for machine learning models. Besides model accuracy, other tuning intentions such as model training time and energy consumption are also worthy of attention from data analytic service providers.…

机器学习 · 计算机科学 2023-04-21 Hui Dou , Shanshan Zhu , Yiwen Zhang , Pengfei Chen , Zibin Zheng

Visual prompt tuning (VPT) is a promising solution incorporating learnable prompt tokens to customize pre-trained models for downstream tasks. However, VPT and its variants often encounter challenges like prompt initialization, prompt…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Yuzhu Wang , Lechao Cheng , Chaowei Fang , Dingwen Zhang , Manni Duan , Meng Wang

PySensors is a Python package for selecting and placing a sparse set of sensors for classification and reconstruction tasks. Specifically, PySensors implements algorithms for data-driven sparse sensor placement optimization for…

信号处理 · 电气工程与系统科学 2021-03-01 Brian M. de Silva , Krithika Manohar , Emily Clark , Bingni W. Brunton , Steven L. Brunton , J. Nathan Kutz

PyTorch Adapt is a library for domain adaptation, a type of machine learning algorithm that re-purposes existing models to work in new domains. It is a fully-featured toolkit, allowing users to create a complete train/test pipeline in a few…

机器学习 · 计算机科学 2022-11-30 Kevin Musgrave , Serge Belongie , Ser-Nam Lim

The performance of modern reinforcement learning algorithms critically relies on tuning ever-increasing numbers of hyperparameters. Often, small changes in a hyperparameter can lead to drastic changes in performance, and different…

机器学习 · 计算机科学 2025-02-05 Jacob Adkins , Michael Bowling , Adam White

Accurate hardware performance models are critical to efficient code generation. They can be used by compilers to make heuristic decisions, by superoptimizers as a minimization objective, or by autotuners to find an optimal configuration for…

The impressive performance of deep learning architectures is associated with a massive increase in model complexity. Millions of parameters need to be tuned, with training and inference time scaling accordingly, together with energy…

机器学习 · 计算机科学 2023-11-10 Paolo Didier Alfano , Vito Paolo Pastore , Lorenzo Rosasco , Francesca Odone

Most machine learning algorithms are configured by one or several hyperparameters that must be carefully chosen and often considerably impact performance. To avoid a time consuming and unreproducible manual trial-and-error process to find…

We present AstroPhot, a fast, powerful, and user-friendly Python based astronomical image photometry solver. AstroPhot incorporates automatic differentiation and GPU (or parallel CPU) acceleration, powered by the machine learning library…

Hyper-parameters of time series models play an important role in time series analysis. Slight differences in hyper-parameters might lead to very different forecast results for a given model, and therefore, selecting good hyper-parameter…

机器学习 · 计算机科学 2021-02-12 Peiyi Zhang , Xiaodong Jiang , Ginger M Holt , Nikolay Pavlovich Laptev , Caner Komurlu , Peng Gao , Yang Yu

Nowadays, GPU accelerators are commonly used to speed up general-purpose computing tasks on a variety of hardware. However, due to the diversity of GPU architectures and processed data, optimization of codes for a particular type of…

分布式、并行与集群计算 · 计算机科学 2021-09-20 Jiří Filipovič , Jana Hozzová , Amin Nezarat , Jaroslav Oľha , Filip Petrovič