English
Related papers

Related papers: Spark Parameter Tuning via Trial-and-Error

200 papers

Hadoop MapReduce is a framework for distributed storage and processing of large datasets that is quite popular in big data analytics. It has various configuration parameters (knobs) which play an important role in deciding the performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-28 Sandeep Kumar , Sindhu Padakandla , Chandrashekar L , Priyank Parihar , K Gopinath , Shalabh Bhatnagar

Neural scaling laws define a predictable relationship between a model's parameter count and its performance after training in the form of a power law. However, most research to date has not explicitly investigated whether scaling laws can…

Computation and Language · Computer Science 2022-10-19 Maor Ivgi , Yair Carmon , Jonathan Berant

The performance of any algorithm will largely depend on the setting of its algorithm-dependent parameters. The optimal setting should allow the algorithm to achieve the best performance for solving a range of optimization problems. However,…

Optimization and Control · Mathematics 2013-12-20 Xin-She Yang , Suash Deb , M. Loomes , M. Karamanoglu

Advanced driver assistance systems have improved comfort, safety, and efficiency of modern vehicles. However, sensor limitations lead to noisy lane estimates that pose a significant challenge in developing performant control architectures.…

Systems and Control · Electrical Eng. & Systems 2025-09-05 Leon Greiser , Christian Rathgeber , Vladislav Nenchev , Sören Hohmann

Large Language Models (LLMs) have seen great advance in both academia and industry, and their popularity results in numerous open-source frameworks and techniques in accelerating LLM pre-training, fine-tuning, and inference. Training and…

Performance · Computer Science 2023-12-04 Longteng Zhang , Xiang Liu , Zeyu Li , Xinglin Pan , Peijie Dong , Ruibo Fan , Rui Guo , Xin Wang , Qiong Luo , Shaohuai Shi , Xiaowen Chu

Fine-tuning is a promising technique for leveraging Transformer-based language models in downstream tasks. As model sizes continue to grow, updating all model parameters becomes increasingly costly. Parameter-efficient fine-tuning methods…

Computation and Language · Computer Science 2025-06-27 Xiaoshuang Ji , Zhendong Zhao , Xiaojun Chen , Xin Zhao , Zeyao Liu

The performance of software systems remains a persistent concern in the field of software engineering. While traditional metrics like binary size and execution time have long been focal points for developers, the power consumption concern…

Software Engineering · Computer Science 2024-09-26 Edouard Guégain , Alexandre Bonvoisin , Clément Quinton , Mathieu Acher , Romain Rouvoy

For a learning automaton, a proper configuration of its learning parameters, which are crucial for the automaton's performance, is relatively difficult due to the necessity of a manual parameter tuning before real applications. To ensure a…

Machine Learning · Computer Science 2017-11-29 Hao Ge

The rise of transient faults in modern hardware requires system designers to consider errors occurring at runtime. Both hardware- and software-based error handling must be deployed to meet application reliability requirements. The level of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-23 Björn Bönninghoff , Horst Schirmeier

Fine-tuning from pre-trained ImageNet models has become the de-facto standard for various computer vision tasks. Current practices for fine-tuning typically involve selecting an ad-hoc choice of hyperparameters and keeping them fixed to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Hao Li , Pratik Chaudhari , Hao Yang , Michael Lam , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Dynamic Algorithm Configuration (DAC) tackles the question of how to automatically learn policies to control parameters of algorithms in a data-driven fashion. This question has received considerable attention from the evolutionary…

Machine Learning · Computer Science 2023-08-15 Deyao Chen , Maxim Buzdalov , Carola Doerr , Nguyen Dang

Pre-trained models (PTMs) have achieved great success in various Software Engineering (SE) downstream tasks following the ``pre-train then fine-tune'' paradigm. As fully fine-tuning all parameters of PTMs can be computationally expensive, a…

Software Engineering · Computer Science 2023-12-27 Wentao Zou , Qi Li , Jidong Ge , Chuanyi Li , Xiaoyu Shen , Liguo Huang , Bin Luo

Performance variability is an important measure for a reliable high performance computing (HPC) system. Performance variability is affected by complicated interactions between numerous factors, such as CPU frequency, the number of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-16 Li Xu , Thomas Lux , Tyler Chang , Bo Li , Yili Hong , Layne Watson , Ali Butt , Danfeng Yao , Kirk Cameron

Models of parallel processing systems typically assume that one has $l$ workers and jobs are split into an equal number of $k=l$ tasks. Splitting jobs into $k > l$ smaller tasks, i.e. using ``tiny tasks'', can yield performance and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-24 Stefan Bora , Brenton Walker , Markus Fidler

We discuss guidelines for evaluating the performance of parameterized stochastic solvers for optimization problems, with particular attention to systems that employ novel hardware, such as digital quantum processors running variational…

This paper presents a systematic overview of parameter-efficient fine-tuning methods, covering over 50 papers published between early 2019 and mid-2024. These methods aim to address the challenges of fine-tuning large language models by…

Computation and Language · Computer Science 2024-11-25 Vladislav Lialin , Vijeta Deshpande , Xiaowei Yao , Anna Rumshisky

Strong empirical evidence that one machine-learning algorithm A outperforms another one B ideally calls for multiple trials optimizing the learning pipeline over sources of variation such as data sampling, data augmentation, parameter…

The concept of parameter setting is a crucial and significant process in metaheuristics since it can majorly impact their performance. It is a highly complex and challenging procedure since it requires a deep understanding of the…

Optimization and Control · Mathematics 2025-04-08 Vasileios A. Tatsis , Dimos Ioannidis

In modern computing environments, users may have multiple systems accessible to them such as local clusters, private clouds, or public clouds. This abundance of choices makes it difficult for users to select the system and configuration for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-05 Amir Nassereldine , Safaa Diab , Mohammed Baydoun , Kenneth Leach , Maxim Alt , Dejan Milojicic , Izzat El Hajj

Most of the popular Big Data analytics tools evolved to adapt their working environment to extract valuable information from a vast amount of unstructured data. The ability of data mining techniques to filter this helpful information from…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-23 Taha Tekdogan , Ali Cakmak