English
Related papers

Related papers: A Spark Optimizer for Adaptive, Fine-Grained Param…

200 papers

Hyperparameter Optimization (HPO) of Deep Learning-based models tends to be a compute resource intensive process as it usually requires to train the target model with many different hyperparameter configurations. We show that integrating…

Machine Learning · Computer Science 2023-11-30 Juan Pablo García Amboage , Eric Wulff , Maria Girone , Tomás F. Pena

As the share of renewable generation in large power systems continues to increase, the operation of power systems becomes increasingly challenging. The constantly shifting mix of renewable and conventional generation leads to largely…

Systems and Control · Electrical Eng. & Systems 2020-05-11 Amer Mešanović , Ulrich Münz , Rolf Findeisen

Pruning is a promising approach to compress deep learning models in order to deploy them on resource-constrained edge devices. However, many existing pruning solutions are based on unstructured pruning, which yields models that cannot…

Machine Learning · Computer Science 2023-03-16 Kaiqi Zhao , Animesh Jain , Ming Zhao

The performance of any Machine Learning (ML) algorithm is impacted by the choice of its hyperparameters. As training and evaluating a ML algorithm is usually expensive, the hyperparameter optimization (HPO) method needs to be…

Machine Learning · Computer Science 2022-09-12 Alejandro Morales-Hernández , Inneke Van Nieuwenhuyse , Gonzalo Nápoles

Parameter tuning is recognized today as a crucial ingredient when tackling an optimization problem. Several meta-optimization methods have been proposed to find the best parameter set for a given optimization algorithm and (set of) problem…

Artificial Intelligence · Computer Science 2013-05-13 Mostepha Redouane Khouadjia , Marc Schoenauer , Vincent Vidal , Johann Dréo , Pierre Savéant

We introduce a sampling framework to support approximate computing with estimated error bounds in Spark. Our framework allows sampling to be performed at the beginning of a sequence of multiple transformations ending in an aggregation…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-07 Guangyan Hu , Desheng Zhang , Sandro Rigo , Thu D. Nguyen

Spark is a new promising platform for scalable data-parallel computation. It provides several high-level application programming interfaces (APIs) to perform parallel data aggregation. Since execution of parallel aggregation in Spark is…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-09 Yu-Fang Chen , Chih-Duo Hong , Ondřej Lengál , Shin-Cheng Mu , Nishant Sinha , Bow-Yaw Wang

This paper presents a multi-objective stochastic optimization method for tuning of the controller parameters of Refrigeration Systems based on Vapour Compression. Stochastic Multi Parameter Divergence Optimization (SMDO) algorithm is…

Systems and Control · Computer Science 2018-06-05 Abdullah Ates , Jie Yuan , Sina Dehghan , Yang Zhao , Celaleddin Yeroglu , YangQuan Chen

Real-world experiments involve batched & delayed feedback, non-stationarity, multiple objectives & constraints, and (often some) personalization. Tailoring adaptive methods to address these challenges on a per-problem basis is infeasible,…

Machine Learning · Computer Science 2024-11-11 Ethan Che , Daniel R. Jiang , Hongseok Namkoong , Jimmy Wang

In this paper, we introduce a Model-based Algorithm Turning Engine, namely MATE, where the parameters of an algorithm are represented as expressions of the features of a target optimisation problem. In contrast to most static…

Neural and Evolutionary Computing · Computer Science 2021-02-16 Mohamed El Yafrani , Marcella Scoczynski Ribeiro Martins , Inkyung Sung , Markus Wagner , Carola Doerr , Peter Nielsen

In a heterogeneous, dynamic environment, like Grid, post-mortem analysis is of no use and data needs to be collected and analysed in real time. Novel techniques are also required for dynamically tuning the application's performance and…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-05-13 Ajanta De Sarkar , Sarbani Roy , Sudipto Biswas , Nandini Mukherjee

Sequentially solving similar optimization problems under strict runtime constraints is essential for many applications, such as robot control, autonomous driving, and portfolio management. The performance of local optimization methods in…

Machine Learning · Computer Science 2025-02-04 Elad Sharony , Heng Yang , Tong Che , Marco Pavone , Shie Mannor , Peter Karkus

Automatic performance tuning (auto-tuning) is essential for optimizing high-performance applications, where vast and irregular search spaces make manual exploration infeasible. While auto-tuners traditionally rely on classical approaches…

Machine Learning · Computer Science 2026-04-01 Floris-Jan Willemsen , Niki van Stein , Ben van Werkhoven

Controller tuning and parameter optimization are crucial in system design to improve closed-loop system performance. Bayesian optimization has been established as an efficient model-free controller tuning and adaptation method. However,…

Systems and Control · Electrical Eng. & Systems 2024-04-24 Christopher König , Raamadaas Krishnadas , Efe C. Balta , Alisa Rupenyan

Stochastic algorithms are efficient approaches to solving machine learning and optimization problems. In this paper, we propose a general framework called Splash for parallelizing stochastic algorithms on multi-node distributed systems.…

Machine Learning · Computer Science 2015-09-24 Yuchen Zhang , Michael I. Jordan

We present a model-agnostic framework for jointly optimizing the predictive performance and interpretability of supervised machine learning models for tabular data. Interpretability is quantified via three measures: feature sparsity,…

Machine Learning · Computer Science 2023-07-18 Lennart Schneider , Bernd Bischl , Janek Thomas

In this paper, we propose a novel Adaptive Transmission Strategy to improve energy efficiency~(EE) in a wireless point-to-point transmission system with Quality of Service~(QoS) requirement, i.e., delay-outage probability considered. The…

Information Theory · Computer Science 2018-07-24 Linlin Zou , Yanzhao Hou , Xiaofeng Tao , Qimei Cui , Xueqing Huang

Automatic performance tuning, or auto-tuning, accelerates high-performance codes by exploring vast spaces of code variants. However, due to the large number of possible combinations and complex constraints, constructing these search spaces…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-01 Floris-Jan Willemsen , Rob V. van Nieuwpoort , Ben van Werkhoven

Sampling-based Model Predictive Control (MPC) is a flexible control framework that can reason about non-smooth dynamics and cost functions. Recently, significant work has focused on the use of machine learning to improve the performance of…

Robotics · Computer Science 2022-12-07 Jacob Sacks , Byron Boots

The problem of parameterization is often central to the effective deployment of nature-inspired algorithms. However, finding the optimal set of parameter values for a combination of problem instance and solution method is highly…

Neural and Evolutionary Computing · Computer Science 2014-06-26 Matthew Crossley , Andy Nisbet , Martyn Amos