English
Related papers

Related papers: PHS: A Toolbox for Parallel Hyperparameter Search

200 papers

Hyperparameter tuning is a fundamental aspect of machine learning research. Setting up the infrastructure for systematic optimization of hyperparameters can take a significant amount of time. Here, we present PyHopper, a black-box…

Machine Learning · Computer Science 2022-10-11 Mathias Lechner , Ramin Hasani , Philipp Neubauer , Sophie Neubauer , Daniela Rus

We introduce an improved version of Random Search (RS), used here for hyperparameter optimization of machine learning algorithms. Unlike the standard RS, which generates for each trial new values for all hyperparameters, we generate new…

Machine Learning · Computer Science 2020-04-06 Adrian-Catalin Florea , Razvan Andonie

We present the first general purpose framework for marginal maximum a posteriori estimation of probabilistic program variables. By using a series of code transformations, the evidence of any probabilistic program, and therefore of any…

Machine Learning · Statistics 2017-07-17 Tom Rainforth , Tuan Anh Le , Jan-Willem van de Meent , Michael A. Osborne , Frank Wood

A quantum algorithm for combinatorial search is presented that provides a simple framework for utilizing search heuristics. The algorithm is evaluated in a new case that is an unstructured version of the graph coloring problem. It performs…

Quantum Physics · Physics 2009-10-06 Tad Hogg

Optimization aims at selecting a feasible set of parameters in an attempt to solve a particular problem, being applied in a wide range of applications, such as operations research, machine learning fine-tuning, and control engineering,…

Neural and Evolutionary Computing · Computer Science 2020-12-03 Gustavo H. de Rosa , Douglas Rodrigues , João P. Papa

This paper is concerned with a recently developed paradigm for population-based optimization, termed particle filter optimization (PFO). This paradigm is attractive in terms of coherence in theory and easiness in mathematical analysis and…

Machine Learning · Statistics 2018-11-26 Bin Liu , Yaochu Jin

Large language model (LLM) routing aims to exploit the specialized strengths of different LLMs for diverse tasks. However, existing approaches typically focus on selecting LLM architectures while overlooking parameter settings, which are…

Computation and Language · Computer Science 2026-01-12 Zihang Tian , Rui Li , Jingsen Zhang , Xiaohe Bo , Wei Huo , Xu Chen

Parsl is a parallel programming library for Python that aims to make it easy to specify parallelism in programs and to realize that parallelism on arbitrary parallel and distributed computing systems. Parsl relies on developers annotating…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-05 Kyle Chard , Yadu Babuji , Anna Woodard , Ben Clifford , Zhuozhao Li , Mihael Hategan , Ian Foster , Mike Wilde , Daniel S. Katz

This paper explores the use of foundational large language models (LLMs) in hyperparameter optimization (HPO). Hyperparameters are critical in determining the effectiveness of machine learning models, yet their optimization often relies on…

Machine Learning · Computer Science 2024-11-12 Michael R. Zhang , Nishkrit Desai , Juhan Bae , Jonathan Lorraine , Jimmy Ba

We give a simple, fast algorithm for hyperparameter optimization inspired by techniques from the analysis of Boolean functions. We focus on the high-dimensional regime where the canonical example is training a neural network with a large…

Machine Learning · Computer Science 2018-01-23 Elad Hazan , Adam Klivans , Yang Yuan

Developing efficient parallel applications is critical to advancing scientific development but requires significant performance analysis and optimization. Performance analysis tools help developers manage the increasing complexity and scale…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-25 Onur Cankur , Aditya Tomar , Daniel Nichols , Connor Scully-Allison , Katherine E. Isaacs , Abhinav Bhatele

This article introduces a novel methodology for the massive parallelization of projection-based depths, addressing the computational challenges of data depth in high-dimensional spaces. We propose an algorithmic framework based on Refined…

Computation · Statistics 2025-06-11 Leonardo Leone , Pavlo Mozharovskyi , David Bounie

PySEMTools is a Python-based library for post-processing simulation data produced with high-order hexahedral elements in the context of the spectral element method in computational fluid dynamics. It aims to minimize intermediate steps…

Computational Physics · Physics 2025-04-18 Adalberto Perez , Siavash Toosi , Tim Felle Olsen , Stefano Markidis , Philipp Schlatter

The frequent elements problem, a key component in demanding stream-data analytics, involves selecting elements whose occurrence exceeds a user-specified threshold. Fast, memory-efficient $\epsilon$-approximate synopsis algorithms select all…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-04 Victor Jarlow , Charalampos Stylianopoulos , Marina Papatriantafilou

Background: We describe an informatics framework for researchers and clinical investigators to efficiently perform parameter sensitivity analysis and auto-tuning for algorithms that segment and classify image features in a large dataset of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-13 George Teodoro , Tahsin Kurc , Luis F. R. Taveira , Alba C. M. A. Melo , Jun Kong , Joel Saltz

We study several questions related to diversifying search results. We give improved approximation algorithms in each of the following problems, together with some lower bounds. - We give a polynomial-time approximation scheme (PTAS) for a…

Data Structures and Algorithms · Computer Science 2022-03-04 Amir Abboud , Vincent Cohen-Addad , Euiwoong Lee , Pasin Manurangsi

Most research in Bayesian optimization (BO) has focused on \emph{direct feedback} scenarios, where one has access to exact values of some expensive-to-evaluate objective. This direction has been mainly driven by the use of BO in machine…

Machine Learning · Computer Science 2021-09-02 Eero Siivola , Akash Kumar Dhaka , Michael Riis Andersen , Javier Gonzalez , Pablo Garcia Moreno , Aki Vehtari

It is commonly believed that scaling language models should commit a significant space or time cost, by increasing the parameters (parameter scaling) or output tokens (inference-time scaling). We introduce the third and more…

Machine Learning · Computer Science 2025-05-16 Mouxiang Chen , Binyuan Hui , Zeyu Cui , Jiaxi Yang , Dayiheng Liu , Jianling Sun , Junyang Lin , Zhongxin Liu

Generalization, i.e., the ability of solving problem instances that are not available during the system design and development phase, is a critical goal for intelligent systems. A typical way to achieve good generalization is to learn a…

Neural and Evolutionary Computing · Computer Science 2021-02-24 Ke Tang , Shengcai Liu , Peng Yang , Xin Yao

Finding a \emph{single} best solution is the most common objective in combinatorial optimization problems. However, such a single solution may not be applicable to real-world problems as objective functions and constraints are only…

Data Structures and Algorithms · Computer Science 2022-01-25 Tesshu Hanaka , Masashi Kiyomi , Yasuaki Kobayashi , Yusuke Kobayashi , Kazuhiro Kurita , Yota Otachi