English
Related papers

Related papers: Performance Tuning of Hadoop MapReduce: A Noisy Gr…

200 papers

Modern database management systems (DBMS) expose hundreds of configurable knobs to control system behaviours. Determining the appropriate values for these knobs to improve DBMS performance is a long-standing problem in the database…

Databases · Computer Science 2024-12-02 Jiale Lao , Yibo Wang , Yufei Li , Jianping Wang , Yunjia Zhang , Zhiyuan Cheng , Wanghu Chen , Mingjie Tang , Jianguo Wang

Fine-tuning large-scale pre-trained models is inherently a resource-intensive task. While it can enhance the capabilities of the model, it also incurs substantial computational costs, posing challenges to the practical application of…

Computation and Language · Computer Science 2024-06-27 Yulong Mao , Kaiyu Huang , Changhao Guan , Ganglin Bao , Fengran Mo , Jinan Xu

In contemporary machine learning workloads, numerous hyper-parameter search algorithms are frequently utilized to efficiently discover high-performing hyper-parameter values, such as learning and regularization rates. As a result, a range…

Machine Learning · Computer Science 2024-04-26 Abhinav Pomalapally , Bassel El Mabsout , Renato Mansuco

There is an increasing need in solving high-dimensional optimization problems under non-deterministic environment. The simultaneous perturbation stochastic approximation (SPSA) algorithm has recently attracted considerable attention for…

Optimization and Control · Mathematics 2020-12-15 Chen Wang

Hyperparameter optimization (HPO) is an important step in machine learning (ML) model development, but common practices are archaic -- primarily relying on manual or grid searches. This is partly because adopting advanced HPO algorithms…

Machine Learning · Computer Science 2024-02-08 Sungduk Yu , Mike Pritchard , Po-Lun Ma , Balwinder Singh , Sam Silva

Current deep learning architectures are growing larger in order to learn from complex datasets. These architectures require giant matrix multiplication operations to train millions of parameters. Conversely, there is another growing trend…

Machine Learning · Statistics 2016-12-06 Ryan Spring , Anshumali Shrivastava

Controller tuning and parameter optimization are crucial in system design to improve both the controller and underlying system performance. Bayesian optimization has been established as an efficient model-free method for controller tuning…

Systems and Control · Electrical Eng. & Systems 2023-06-26 Christopher Koenig , Miks Ozols , Anastasia Makarova , Efe C. Balta , Andreas Krause , Alisa Rupenyan

Approximate dynamic programming (ADP) has proven itself in a wide range of applications spanning large-scale transportation problems, health care, revenue management, and energy systems. The design of effective ADP algorithms has many…

Optimization and Control · Mathematics 2014-07-15 Ilya O. Ryzhov , Peter I. Frazier , Warren B. Powell

Gaussian process (GP) regression provides a strategy for accelerating saddle point searches on high-dimensional energy surfaces by reducing the number of times the energy and its derivatives with respect to atomic coordinates need to be…

Chemical Physics · Physics 2025-12-03 Rohit Goswami , Hannes Jónsson

The SPS-LASSO has recently been introduced as a solution to the problem of regularization parameter selection in the complex-valued LASSO problem. Still, the dependence on the grid size and the polynomial time of performing convex…

Information Theory · Computer Science 2012-07-31 Ashkan Panahi , Mats Viberg

Stochastic Gradient Descent (SGD) is one of the many iterative optimization methods that are widely used in solving machine learning problems. These methods display valuable properties and attract researchers and industrial machine learning…

Machine Learning · Computer Science 2023-10-04 Farshed Abdukhakimov , Chulu Xiang , Dmitry Kamzolov , Martin Takáč

Several challenges make it difficult for sparse neural networks to compete with dense models. First, setting a large fraction of weights to zero impairs forward and gradient signal propagation. Second, sparse studies often need to test…

Machine Learning · Computer Science 2026-02-04 Nolan Dey , Shane Bergsma , Joel Hestness

Noisy marginals are a common form of confidentiality protecting data release and are useful for many downstream tasks such as contingency table analysis, construction of Bayesian networks, and even synthetic data generation. Privacy…

Databases · Computer Science 2026-04-06 Yingtai Xiao , Guanlin He , Levent Toksoz , Zeyu Ding , Danfeng Zhang , Daniel Kifer

Neural Architecture Search (NAS) has recently become a topic of great interest. However, there is a potentially impactful issue within NAS that remains largely unrecognized: noise. Due to stochastic factors in neural network initialization,…

Neural and Evolutionary Computing · Computer Science 2022-05-03 Arkadiy Dushatskiy , Tanja Alderliesten , Peter A. N. Bosman

We develop an iterative subsampling approach to improve the computational efficiency of our previous work on solution path clustering (SPC). The SPC method achieves clustering by concave regularization on the pairwise distances between…

Methodology · Statistics 2016-09-16 Yuliya Marchetti , Qing Zhou

Spark SQL has been widely deployed in industry but it is challenging to tune its performance. Recent studies try to employ machine learning (ML) to solve this problem, but suffer from two drawbacks. First, it takes a long time (high…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-09 Jinhan Xin , Kai Hwang , Zhibin Yu

In addressing the computational and memory demands of fine-tuning Large Language Models(LLMs), we propose LoRA-SP(Streamlined Partial Parameter Adaptation), a novel approach utilizing randomized half-selective parameter freezing within the…

Machine Learning · Computer Science 2024-03-15 Yichao Wu , Yafei Xiang , Shuning Huo , Yulu Gong , Penghao Liang

Tuning the hyperparameters in the differentially private stochastic gradient descent (DPSGD) is a fundamental challenge. Unlike the typical SGD, private datasets cannot be used many times for hyperparameter search in DPSGD; e.g., via a grid…

Machine Learning · Computer Science 2021-08-10 Aman Priyanshu , Rakshit Naidu , Fatemehsadat Mireshghallah , Mohammad Malekzadeh

The stochastic nature of iterative optimization heuristics leads to inherently noisy performance measurements. Since these measurements are often gathered once and then used repeatedly, the number of collected samples will have a…

Neural and Evolutionary Computing · Computer Science 2022-04-25 Diederick Vermetten , Hao Wang , Manuel López-Ibañez , Carola Doerr , Thomas Bäck

Diffusion models have achieved remarkable success in generative tasks but suffer from high computational costs due to their iterative sampling process and quadratic attention costs. Existing training-free acceleration strategies that reduce…

Machine Learning · Computer Science 2025-07-24 Ting Jiang , Yixiao Wang , Hancheng Ye , Zishan Shao , Jingwei Sun , Jingyang Zhang , Zekai Chen , Jianyi Zhang , Yiran Chen , Hai Li