English
Related papers

Related papers: Spark Parameter Tuning via Trial-and-Error

200 papers

Improving software performance through configuration parameter tuning is a common activity during software maintenance. Beyond traditional performance metrics like latency, mobile app developers are interested in reducing app energy usage.…

Software Engineering · Computer Science 2022-01-19 Qiang Xu , James C. Davis , Y. Charlie Hu , Abhilash Jindal

Adapter Tuning, which freezes the pretrained language models (PLMs) and only fine-tunes a few extra modules, becomes an appealing efficient alternative to the full model fine-tuning. Although computationally efficient, the recent Adapters…

Computation and Language · Computer Science 2022-11-11 Shwai He , Liang Ding , Daize Dong , Miao Zhang , Dacheng Tao

Modern software systems are often equipped with hundreds to thousands of configuration options, many of which greatly affect performance. Unfortunately, properly setting these configurations is challenging for developers due to the complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-23 Shu Wang , Chi Li , William Sentosa , Henry Hoffmann , Shan Lu

Despite the possibility to quickly compute reachable sets of large-scale linear systems, current methods are not yet widely applied by practitioners. The main reason for this is probably that current approaches are not push-button-capable…

Numerical Analysis · Mathematics 2024-02-23 Mark Wetzlinger , Niklas Kochdumper , Matthias Althoff

Big Data Cyber Security Analytics (BDCA) systems use big data technologies (e.g., Apache Spark) to collect, store, and analyze a large volume of security event data for detecting cyber-attacks. The volume of digital data in general and…

Cryptography and Security · Computer Science 2021-12-03 Faheem Ullah , Muhammad Ali Babar

Programs with high levels of complexity often face challenges in adjusting execution parameters, particularly when these parameters vary based on the execution context. These dynamic parameters significantly impact the program's…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-18 Joao B. Fernandes , Felipe H. S. da Silva , Samuel Xavier-de-Souza , Italo A. S. Assis

As dataset sizes increase, data analysis tasks in high performance computing (HPC) are increasingly dependent on sophisticated dataflows and out-of-core methods for efficient system utilization. In addition, as HPC systems grow, memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-01 George K. Thiruvathukal , Cameron Christensen , Xiaoyong Jin , François Tessier , Venkatram Vishwanath

Algorithms often have tunable parameters that impact performance metrics such as runtime and solution quality. For many algorithms used in practice, no parameter settings admit meaningful worst-case bounds, so the parameters are made…

Machine Learning · Computer Science 2021-04-27 Maria-Florina Balcan , Dan DeBlasio , Travis Dick , Carl Kingsford , Tuomas Sandholm , Ellen Vitercik

Efficiency of self-optimizing systems is heavily dependent on their optimization strategies, e.g., choosing exact or approximate solver. A choice of such a strategy, in turn, is influenced by numerous factors, such as re-optimization time,…

Machine Learning · Computer Science 2019-09-10 Dmytro Pukhkaiev , Uwe Aßmann

Novel technologies in automated machine learning ease the complexity of algorithm selection and hyperparameter optimization. Hyperparameters are important for machine learning models as they significantly influence the performance of…

Machine Learning · Computer Science 2021-08-31 Mohamadjavad Bahmani , Radwa El Shawi , Nshan Potikyan , Sherif Sakr

Search-based software testing (SBST) has been studied a lot in the literature, lately. Since, in theory, the performance of meta-heuristic search methods are highly dependent on their parameters, there is a need to study SBST tuning. In…

Software Engineering · Computer Science 2019-06-07 Shayan Zamani , Hadi Hemmati

The performance of modern reinforcement learning algorithms critically relies on tuning ever-increasing numbers of hyperparameters. Often, small changes in a hyperparameter can lead to drastic changes in performance, and different…

Machine Learning · Computer Science 2025-02-05 Jacob Adkins , Michael Bowling , Adam White

The ever-growing demand and complexity of machine learning are putting pressure on hyper-parameter tuning systems: while the evaluation cost of models continues to increase, the scalability of state-of-the-arts starts to become a crucial…

Machine Learning · Computer Science 2022-01-19 Yang Li , Yu Shen , Huaijun Jiang , Wentao Zhang , Jixiang Li , Ji Liu , Ce Zhang , Bin Cui

Finely tuning MPI applications and understanding the influence of keyparameters (number of processes, granularity, collective operationalgorithms, virtual topology, and process placement) is critical toobtain good performance on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-10 Tom Cornebize , Arnaud Legrand

Most evolutionary algorithms have multiple parameters and their values drastically affect the performance. Due to the often complicated interplay of the parameters, setting these values right for a particular problem (parameter tuning) is a…

Neural and Evolutionary Computing · Computer Science 2024-10-08 Denis Antipov , Maxim Buzdalov , Benjamin Doerr

For many machine learning algorithms, predictive performance is critically affected by the hyperparameter values used to train them. However, tuning these hyperparameters can come at a high computational cost, especially on larger datasets,…

Almost all optimization algorithms have algorithm-dependent parameters, and the setting of such parameter values can largely influence the behaviour of the algorithm under consideration. Thus, proper parameter tuning should be carried out…

Artificial Intelligence · Computer Science 2023-08-31 Geethu Joy , Christian Huyck , Xin-She Yang

Parameter-Efficient Tuning (PETuning) methods have been deemed by many as the new paradigm for using pretrained language models (PLMs). By tuning just a fraction amount of parameters comparing to full model finetuning, PETuning methods…

Computation and Language · Computer Science 2022-10-25 Guanzheng Chen , Fangyu Liu , Zaiqiao Meng , Shangsong Liang

Performance benchmarking is a common practice in software engineering, particularly when building large-scale, distributed, and data-intensive systems. While cloud environments offer several advantages for running benchmarks, it is often…

Software Engineering · Computer Science 2025-04-17 Sören Henning , Adriano Vogel , Esteban Perez-Wohlfeil , Otmar Ertl , Rick Rabiser

Parameter control and dynamic algorithm configuration study how to dynamically choose suitable configurations of a parametrized algorithm during the optimization process. Despite being an intensively researched topic in evolutionary…

Neural and Evolutionary Computing · Computer Science 2025-07-14 Gianluca Covini , Denis Antipov , Carola Doerr