中文
相关论文

相关论文: Spark Parameter Tuning via Trial-and-Error

200 篇论文

Improving software performance through configuration parameter tuning is a common activity during software maintenance. Beyond traditional performance metrics like latency, mobile app developers are interested in reducing app energy usage.…

软件工程 · 计算机科学 2022-01-19 Qiang Xu , James C. Davis , Y. Charlie Hu , Abhilash Jindal

Adapter Tuning, which freezes the pretrained language models (PLMs) and only fine-tunes a few extra modules, becomes an appealing efficient alternative to the full model fine-tuning. Although computationally efficient, the recent Adapters…

计算与语言 · 计算机科学 2022-11-11 Shwai He , Liang Ding , Daize Dong , Miao Zhang , Dacheng Tao

Modern software systems are often equipped with hundreds to thousands of configuration options, many of which greatly affect performance. Unfortunately, properly setting these configurations is challenging for developers due to the complex…

分布式、并行与集群计算 · 计算机科学 2017-10-23 Shu Wang , Chi Li , William Sentosa , Henry Hoffmann , Shan Lu

Despite the possibility to quickly compute reachable sets of large-scale linear systems, current methods are not yet widely applied by practitioners. The main reason for this is probably that current approaches are not push-button-capable…

数值分析 · 数学 2024-02-23 Mark Wetzlinger , Niklas Kochdumper , Matthias Althoff

Big Data Cyber Security Analytics (BDCA) systems use big data technologies (e.g., Apache Spark) to collect, store, and analyze a large volume of security event data for detecting cyber-attacks. The volume of digital data in general and…

密码学与安全 · 计算机科学 2021-12-03 Faheem Ullah , Muhammad Ali Babar

Programs with high levels of complexity often face challenges in adjusting execution parameters, particularly when these parameters vary based on the execution context. These dynamic parameters significantly impact the program's…

分布式、并行与集群计算 · 计算机科学 2024-06-18 Joao B. Fernandes , Felipe H. S. da Silva , Samuel Xavier-de-Souza , Italo A. S. Assis

As dataset sizes increase, data analysis tasks in high performance computing (HPC) are increasingly dependent on sophisticated dataflows and out-of-core methods for efficient system utilization. In addition, as HPC systems grow, memory…

分布式、并行与集群计算 · 计算机科学 2019-10-01 George K. Thiruvathukal , Cameron Christensen , Xiaoyong Jin , François Tessier , Venkatram Vishwanath

Algorithms often have tunable parameters that impact performance metrics such as runtime and solution quality. For many algorithms used in practice, no parameter settings admit meaningful worst-case bounds, so the parameters are made…

机器学习 · 计算机科学 2021-04-27 Maria-Florina Balcan , Dan DeBlasio , Travis Dick , Carl Kingsford , Tuomas Sandholm , Ellen Vitercik

Efficiency of self-optimizing systems is heavily dependent on their optimization strategies, e.g., choosing exact or approximate solver. A choice of such a strategy, in turn, is influenced by numerous factors, such as re-optimization time,…

机器学习 · 计算机科学 2019-09-10 Dmytro Pukhkaiev , Uwe Aßmann

Novel technologies in automated machine learning ease the complexity of algorithm selection and hyperparameter optimization. Hyperparameters are important for machine learning models as they significantly influence the performance of…

机器学习 · 计算机科学 2021-08-31 Mohamadjavad Bahmani , Radwa El Shawi , Nshan Potikyan , Sherif Sakr

Search-based software testing (SBST) has been studied a lot in the literature, lately. Since, in theory, the performance of meta-heuristic search methods are highly dependent on their parameters, there is a need to study SBST tuning. In…

软件工程 · 计算机科学 2019-06-07 Shayan Zamani , Hadi Hemmati

The performance of modern reinforcement learning algorithms critically relies on tuning ever-increasing numbers of hyperparameters. Often, small changes in a hyperparameter can lead to drastic changes in performance, and different…

机器学习 · 计算机科学 2025-02-05 Jacob Adkins , Michael Bowling , Adam White

The ever-growing demand and complexity of machine learning are putting pressure on hyper-parameter tuning systems: while the evaluation cost of models continues to increase, the scalability of state-of-the-arts starts to become a crucial…

机器学习 · 计算机科学 2022-01-19 Yang Li , Yu Shen , Huaijun Jiang , Wentao Zhang , Jixiang Li , Ji Liu , Ce Zhang , Bin Cui

Finely tuning MPI applications and understanding the influence of keyparameters (number of processes, granularity, collective operationalgorithms, virtual topology, and process placement) is critical toobtain good performance on…

分布式、并行与集群计算 · 计算机科学 2022-01-10 Tom Cornebize , Arnaud Legrand

Most evolutionary algorithms have multiple parameters and their values drastically affect the performance. Due to the often complicated interplay of the parameters, setting these values right for a particular problem (parameter tuning) is a…

神经与进化计算 · 计算机科学 2024-10-08 Denis Antipov , Maxim Buzdalov , Benjamin Doerr

For many machine learning algorithms, predictive performance is critically affected by the hyperparameter values used to train them. However, tuning these hyperparameters can come at a high computational cost, especially on larger datasets,…

Almost all optimization algorithms have algorithm-dependent parameters, and the setting of such parameter values can largely influence the behaviour of the algorithm under consideration. Thus, proper parameter tuning should be carried out…

人工智能 · 计算机科学 2023-08-31 Geethu Joy , Christian Huyck , Xin-She Yang

Parameter-Efficient Tuning (PETuning) methods have been deemed by many as the new paradigm for using pretrained language models (PLMs). By tuning just a fraction amount of parameters comparing to full model finetuning, PETuning methods…

计算与语言 · 计算机科学 2022-10-25 Guanzheng Chen , Fangyu Liu , Zaiqiao Meng , Shangsong Liang

Performance benchmarking is a common practice in software engineering, particularly when building large-scale, distributed, and data-intensive systems. While cloud environments offer several advantages for running benchmarks, it is often…

软件工程 · 计算机科学 2025-04-17 Sören Henning , Adriano Vogel , Esteban Perez-Wohlfeil , Otmar Ertl , Rick Rabiser

Parameter control and dynamic algorithm configuration study how to dynamically choose suitable configurations of a parametrized algorithm during the optimization process. Despite being an intensively researched topic in evolutionary…

神经与进化计算 · 计算机科学 2025-07-14 Gianluca Covini , Denis Antipov , Carola Doerr