English
Related papers

Related papers: Lessons learned from hyper-parameter tuning for mi…

200 papers

Microservice applications are created as loosely coupled application components and they leverage cloud elasticity to reduce costs and increase development speed. However, microservice applications exhibit complex interactions among…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-10 Minxian Xu , Junhan Liao , Linfeng Wen , Huaming Wu , Kejiang Ye , Rajkumar Buyya , Chengzhong Xu

Distributed optimization algorithms are widely used in many industrial machine learning applications. However choosing the appropriate algorithm and cluster size is often difficult for users as the performance and convergence rate of…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-21 Xinghao Pan , Shivaram Venkataraman , Zizheng Tai , Joseph Gonzalez

High dimensional parameter space optimization is crucial in many applications. The parameters affecting this performance can be both numerical and categorical in their type. The existing techniques of black-box optimization and visual…

Human-Computer Interaction · Computer Science 2022-05-02 Anjul Tyagi

In recent years, microservice architecture has become a popular architectural style in software engineering, with its natural support for DevOps and continuous delivery, as well as its scalability and extensibility, which drive industry…

Software Engineering · Computer Science 2022-07-12 Zhi Li , Yitao Bo , Hongbin Xiao

Parameter tuning is recognized today as a crucial ingredient when tackling an optimization problem. Several meta-optimization methods have been proposed to find the best parameter set for a given optimization algorithm and (set of) problem…

Artificial Intelligence · Computer Science 2013-05-13 Mostepha Redouane Khouadjia , Marc Schoenauer , Vincent Vidal , Johann Dréo , Pierre Savéant

Hyper-parameters optimization (HPO) is vital for machine learning models. Besides model accuracy, other tuning intentions such as model training time and energy consumption are also worthy of attention from data analytic service providers.…

Machine Learning · Computer Science 2023-04-21 Hui Dou , Shanshan Zhu , Yiwen Zhang , Pengfei Chen , Zibin Zheng

It is well recognized that design patterns improve system development and maintenance in many aspects. While we commonly recognize these patterns in monolithic systems, many patterns emerged for cloud computing, specifically microservices.…

Software Engineering · Computer Science 2022-05-23 Alexander Bakhtin , Abdullah Al Maruf , Tomas Cerny , Davide Taibi

The performance of any algorithm will largely depend on the setting of its algorithm-dependent parameters. The optimal setting should allow the algorithm to achieve the best performance for solving a range of optimization problems. However,…

Optimization and Control · Mathematics 2013-12-20 Xin-She Yang , Suash Deb , M. Loomes , M. Karamanoglu

We assert that it is the ethical duty of software engineers to strive to reduce software discrimination. This paper discusses how that might be done. This is an important topic since machine learning software is increasingly being used to…

Software Engineering · Computer Science 2019-10-31 Joymallya Chakraborty , Tianpei Xia , Fahmid M. Fahid , Tim Menzies

Local Fourier analysis is a useful tool for predicting and analyzing the performance of many efficient algorithms for the solution of discretized PDEs, such as multigrid and domain decomposition methods. The crucial aspect of local Fourier…

Optimization and Control · Mathematics 2020-07-29 Jed Brown , Yunhui He , Scott MacLachlan , Matt Menickelly , Stefan M. Wild

How can we make software analytics simpler and faster? One method is to match the complexity of analysis to the intrinsic complexity of the data being explored. For example, hyperparameter optimizers find the control settings for data…

Software Engineering · Computer Science 2021-04-23 Amritanshu Agrawal , Xueqi Yang , Rishabh Agrawal , Rahul Yedida , Xipeng Shen , Tim Menzies

Cloud services have recently started undergoing a major shift from monolithic applications, to graphs of hundreds of loosely-coupled microservices. Microservices fundamentally change a lot of assumptions current cloud systems are designed…

We first consider the static problem of allocating resources to ( i.e. , scheduling) multiple distributed application framework s, possibly with different priorities and server preferences , in a private cloud with heterogeneous servers.…

Performance · Computer Science 2019-01-01 George Kesidis , Yuquan Shan , Yujia Wang , Bhuvan Urgaonkar , Jalal Khamse-Ashari , Ioanns Lambadaris

Software errors and incidents are inevitable in web based applications. Scalability challenges, increasing demand, and ongoing code changes can contribute to such failures. As software architectures evolve rapidly, understanding how and why…

Software Engineering · Computer Science 2025-05-16 Doğaç Eldenk , H. Alperen Çetin

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

Classification is one of the most important tasks in Machine Learning (ML) and with recent advancements in artificial intelligence (AI) it is important to find efficient ways to implement it. Generally, the choice of classification…

Machine Learning · Computer Science 2023-12-27 Anuja Dixit , Shreya Byreddy , Guanqun Song , Ting Zhu

As an application usage grows, its owner scales up vertically by replacing old machines with more powerful ones. This methodology is expensive and leads to resource waste. In response to the business needs, internet giants have developed…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-07 Yujing Wang , Darrel Ma

Machine learning pipelines often rely on optimization procedures to make discrete decisions (e.g., sorting, picking closest neighbors, or shortest paths). Although these discrete decisions are easily computed, they break the…

Machine Learning · Computer Science 2020-06-11 Quentin Berthet , Mathieu Blondel , Olivier Teboul , Marco Cuturi , Jean-Philippe Vert , Francis Bach

Adequately generating and evaluating prediction models based on supervised machine learning (ML) is often challenging, especially for less experienced users in applied research areas. Special attention is required in settings where the…

A number of companies are trying to migrate large monolithic software systems to Service Oriented Architectures. A common approach to do this is to first identify and describe desired services (i.e., create a model), and then to locate…

Software Engineering · Computer Science 2010-12-21 Hari S. Gupta , Deepak D'Souza , Raghavan Komondoor , Girish M. Rama