Related papers: Bayesian Optimization of Pythia8 Tunes
Understanding the production of quarks and gluons in high energy collisions and their evolution is a very active area of investigation. Monte carlo event generator PYTHIA8 uses the parton shower model to simulate such collisions and is…
The performance of deep (reinforcement) learning systems crucially depends on the choice of hyperparameters. Their tuning is notoriously expensive, typically requiring an iterative training process to run for numerous steps to convergence.…
We describe the implementation of supersymmetric models in PYTHIA 8, including production and decay of superparticles and allowing for violation of flavour, CP, and R-parity. We also present a framework for importing generic new-physics…
To further improve Lithium-ion batteries (LiBs), a profound understanding of complex battery processes is crucial. Physical models offer understanding but are difficult to validate and parameterize. Therefore, automated machine-learning…
Hadronic interaction models are a core ingredient of simulations of extensive air showers and pose the major source of uncertainties of predictions of air shower observables. Recently, Pythia~8, a hadronic interaction model popular in…
Large Language Models (LLMs) have demonstrated transformative potential in reshaping the world. As these models are pretrained on general corpora, they often require domain-specific fine-tuning to optimize performance in specialized…
It is a common practice in natural language processing to pre-train a single model on a general domain and then fine-tune it for downstream tasks. However, when it comes to Large Language Models, fine-tuning the entire model can be…
Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…
In this short note, I introduce to essential conceptual features and main building blocks of matrix element merging algorithms, operating on fixed order calculations both at leading order and next-to-leading order. The intention is purely…
This paper proposes an automatic controller tuning framework based on linear optimal control combined with Bayesian optimization. With this framework, an initial set of controller gains is automatically improved according to a pre-defined…
In this paper we present a new fast and accurate method for Radial Basis Function (RBF) approximation, including interpolation as a special case, which enables us to effectively find the optimal value of the RBF shape parameter. In…
In experiments to estimate parameters of a parametric model, Bayesian experiment design allows measurement settings to be chosen based on utility, which is the predicted improvement of parameter distributions due to modeled measurement…
Pin fins are imperative in the cooling of turbine blades. The designs of pin fins, therefore, have seen significant research in the past. With the developments in metal additive manufacturing, novel design approaches toward complex…
Bayesian optimisation is a sample-efficient search methodology that holds great promise for accelerating drug and materials discovery programs. A frequently-overlooked modelling consideration in Bayesian optimisation strategies however, is…
The Parton-Shower algorithm implement in the Pythia generator is applied multiple times to the same parton-level configuration to estimate the systematic uncertainty affecting large-radius jet substructure variables associated with the…
Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic…
Bayesian optimization has become widely popular across various experimental sciences due to its favorable attributes: it can handle noisy data, perform well with relatively small datasets, and provide adaptive suggestions for sequential…
We present a new algorithm for an analytic parton shower. While the algorithm for the final-state shower has been known in the literature, the construction of an initial-state shower along these lines is new. The aim is to have a parton…
In this paper, we address the problem of \emph{cost-sensitive} hyperparameter optimization (HPO) built upon freeze-thaw Bayesian optimization (BO). Specifically, we assume a scenario where users want to early-stop the HPO process when the…
Many machine learning models require a training procedure based on running stochastic gradient descent. A key element for the efficiency of those algorithms is the choice of the learning rate schedule. While finding good learning rates…