English
Related papers

Related papers: Efficient Online Hyperparameter Optimization for K…

200 papers

The emerging field of learning-augmented online algorithms uses ML techniques to predict future input parameters and thereby improve the performance of online algorithms. Since these parameters are, in general, real-valued functions, a…

Machine Learning · Computer Science 2022-05-26 Keerti Anand , Rong Ge , Amit Kumar , Debmalya Panigrahi

In this paper, we address the problem of reconstructing coverage maps from path-loss measurements in cellular networks. We propose and evaluate two kernel-based adaptive online algorithms as an alternative to typical offline methods. The…

Networking and Internet Architecture · Computer Science 2019-10-11 Martin Kasparick , Renato L. G. Cavalcante , Stefan Valentin , Slawomir Stanczak , Masahiro Yukawa

Network management often relies on machine learning to make predictions about performance and security from network traffic. Often, the representation of the traffic is as important as the choice of the model. The features that the model…

Networking and Internet Architecture · Computer Science 2022-01-25 Francesco Bronzino , Paul Schmitt , Sara Ayoubi , Hyojoon Kim , Renata Teixeira , Nick Feamster

It is typical for a machine learning system to have numerous hyperparameters that affect its learning rate and prediction quality. Finding a good combination of the hyperparameters is, however, a challenging job. This is mainly because…

Machine Learning · Computer Science 2019-08-08 Dobromir Marinov , Daniel Karapetyan

Despite a series of recent successes in reinforcement learning (RL), many RL algorithms remain sensitive to hyperparameters. As such, there has recently been interest in the field of AutoRL, which seeks to automate design decisions to…

Machine Learning · Computer Science 2021-07-01 Jack Parker-Holder , Vu Nguyen , Shaan Desai , Stephen Roberts

Online learning from a stream of data is a defining feature of intelligence, yet modern machine learning systems often struggle in this setting, especially under distributional shift. To understand its basic properties, we study the…

Machine Learning · Statistics 2026-05-11 Ziyan Li , Naoki Hiratani

Machine learning techniques applied to software engineering tasks can be improved by hyperparameter optimization, i.e., automatic tools that find good settings for a learner's control parameters. We show that such hyperparameter…

Software Engineering · Computer Science 2019-12-03 Amritanshu Agrawal , Wei Fu , Di Chen , Xipeng Shen , Tim Menzies

To investigate a dilemma of statistical and computational efficiency faced by long-run variance estimators, we propose a decomposition of kernel weights in a quadratic form and some online inference principles. These proposals allow us to…

Methodology · Statistics 2024-09-10 Man Fung Leung , Kin Wai Chan

Lightweight convolutional and transformer-based networks are increasingly preferred for real-time image classification, especially on resource-constrained devices. This study evaluates the impact of hyperparameter optimization on the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Vineet Kumar Rakesh , Soumya Mazumdar , Tapas Samanta , Hemendra Kumar Pandey , Amitabha Das

Predicting the current backlog, or traffic load, in framed-ALOHA networks enables the optimization of resource allocation, e.g., of the frame size. However, this prediction is made difficult by the lack of information about the cardinality…

Networking and Internet Architecture · Computer Science 2019-07-26 Nan Jiang , Yansha Deng , Osvaldo Simeone , Arumugam Nallanathan

We propose a quantum algorithm based on ridge regression model, which get the optimal fitting parameters w and a regularization hyperparameter {\alpha} by analysing the training dataset. The algorithm consists of two subalgorithms. One is…

Quantum Physics · Physics 2021-04-28 Menghan Chen , Chaohua Yu , Gongde Guo , Song Lin

With the rapid growth of Internet services, recommendation systems play a central role in delivering personalized content. Faced with massive user requests and complex model architectures, the key challenge for real-time recommendation…

Information Retrieval · Computer Science 2025-08-14 Junli Shao , Jing Dong , Dingzhou Wang , Kowei Shih , Dannier Li , Chengrui Zhou

Hyperparameter Optimization (HPO) of Deep Learning-based models tends to be a compute resource intensive process as it usually requires to train the target model with many different hyperparameter configurations. We show that integrating…

Machine Learning · Computer Science 2023-11-30 Juan Pablo García Amboage , Eric Wulff , Maria Girone , Tomás F. Pena

Stochastic gradient descent algorithms for training linear and kernel predictors are gaining more and more importance, thanks to their scalability. While various methods have been proposed to speed up their convergence, the model selection…

Machine Learning · Computer Science 2014-06-17 Francesco Orabona

The performance of reinforcement learning (RL) agents is sensitive to the choice of hyperparameters. In real-world settings like robotics or industrial control systems, however, testing different hyperparameter configurations directly on…

Machine Learning · Computer Science 2022-05-19 Han Wang , Archit Sakhadeo , Adam White , James Bell , Vincent Liu , Xutong Zhao , Puer Liu , Tadashi Kozuno , Alona Fyshe , Martha White

Software analytics has been widely used in software engineering for many tasks such as generating effort estimates for software projects. One of the "black arts" of software analytics is tuning the parameters controlling a data mining…

Software Engineering · Computer Science 2019-02-04 Tianpei Xia , Rahul Krishna , Jianfeng Chen , George Mathew , Xipeng Shen , Tim Menzies

Hyperparameter optimization has remained a central topic within the machine learning community due to its ability to produce state-of-the-art results. With the recent interest growing in the usage of CNNs for time series prediction, we…

Machine Learning · Computer Science 2021-01-20 Taniya Seth , Pranab K. Muhuri

Multivariate time series forecasting poses challenges as the variables are intertwined in time and space, like in the case of traffic signals. Defining signals on graphs relaxes such complexities by representing the evolution of signals…

Machine Learning · Computer Science 2021-10-13 Semin Kwak , Nikolas Geroliminis , Pascal Frossard

Kernel ridge regression (KRR) is a widely used nonparametric method due to its strong theoretical guarantees and computational convenience. However, standard KRR does not distinguish between linear and nonlinear components in the signal,…

Statistics Theory · Mathematics 2026-05-13 Xin Bing , Chao Wang

Kernel ridge regression is used to approximate the kinetic energy of non-interacting fermions in a one-dimensional box as a functional of their density. The properties of different kernels and methods of cross-validation are explored, and…