English
Related papers

Related papers: Lessons learned from hyper-parameter tuning for mi…

200 papers

Microservices bring various benefits to software systems. They also bring decentralization and lose coupling across self-contained system parts. Since these systems likely evolve in a decentralized manner, they need to be monitored to…

Software Engineering · Computer Science 2022-07-07 Abdullah Al Maruf , Alexander Bakhtin , Tomas Cerny , Davide Taibi

Large Transformer models achieved the state-of-the-art status for Natural Language Understanding tasks and are increasingly becoming the baseline model architecture for modeling source code. Transformers are usually pre-trained on large…

Software Engineering · Computer Science 2022-09-21 Andrei Zlotchevski , Dawn Drain , Alexey Svyatkovskiy , Colin Clement , Neel Sundaresan , Michele Tufano

Microservices is an architectural style that structures an application as a collection of loosely coupled services, making it easy for developers to build and scale their applications. The microservices architecture approach differs from…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-27 Muhammad Ahsan , Sacheendra Talluri , Alexandru Iosup

Well-trained machine-learning models, which leverage large amounts of open-source software data, have now become an interesting approach to automating many software engineering tasks. Several SE tasks have all been subject to this approach,…

Software Engineering · Computer Science 2022-02-04 Toufique Ahmed , Premkumar Devanbu

Algorithms typically come with tunable parameters that have a considerable impact on the computational resources they consume. Too often, practitioners must hand-tune the parameters, a tedious and error-prone task. A recent line of research…

Machine Learning · Computer Science 2020-11-24 Maria-Florina Balcan , Tuomas Sandholm , Ellen Vitercik

As the use of crowdsourcing increases, it is important to think about performance optimization. For this purpose, it is possible to think about each worker as a HPU(Human Processing Unit), and to draw inspiration from performance…

Human-Computer Interaction · Computer Science 2016-10-17 Chen Cao , Zheng Liu , Lei Chen , H. V. Jagadish

Decision making in cloud environments is quite challenging due to the diversity in service offerings and pricing models, especially considering that the cloud market is an incredibly fast moving one. In addition, there are no hard and fast…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Faiza Samreen , Yehia Elkhatib , Matthew Rowe , Gordon S. Blair

Multitask learning and transfer learning have proven to be useful in the field of machine learning when additional knowledge is available to help a prediction task. We aim at deriving methods following these paradigms for use in autotuning,…

Machine Learning · Computer Science 2019-08-19 Wissam M. Sid-Lakhdar , Mohsen Mahmoudi Aznaveh , Xiaoye S. Li , James W. Demmel

Growing heterogeneity and configurability in HPC architectures has made auto-tuning applications and runtime parameters on these systems very complex. Users are presented with a multitude of options to configure parameters. In addition to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-28 Akash Dutta , Jordi Alcaraz , Ali TehraniJamsaz , Eduardo Cesar , Anna Sikora , Ali Jannesari

For deep learning practitioners, hyperparameter tuning for optimizing model performance can be a computationally expensive task. Though visualization can help practitioners relate hyperparameter settings to overall model performance,…

Human-Computer Interaction · Computer Science 2021-05-26 Hyekang Joo , Calvin Bao , Ishan Sen , Furong Huang , Leilani Battle

Many well-known, real-world problems involve dynamic data which describe the relationship among the entities. Hypergraphs are powerful combinatorial structures that are frequently used to model such data. For many of today's data-centric…

Data Structures and Algorithms · Computer Science 2021-03-10 Fatih Taşyaran , Berkay Demireller , Kamer Kaya , Bora Uçar

Cloud platforms are increasingly being used to run HPC workloads. Major cloud providers offer a wide variety of virtual machine (VM) types, enabling users to find the optimal balance between performance and cost. However, this extensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Marco A. S. Netto

Data analytics in the cloud has become an integral part of enterprise businesses. Big data analytics systems, however, still lack the ability to take user performance goals and budgetary constraints for a task, collectively referred to as…

Databases · Computer Science 2020-05-08 Fei Song , Khaled Zaouk , Chenghao Lyu , Arnab Sinha , Qi Fan , Yanlei Diao , Prashant Shenoy

The optimization along the chain processing-structure-properties-performance is one of the core objectives in data-driven materials science. In this sense, processes are supposed to manufacture workpieces with targeted material…

Materials Science · Physics 2022-03-24 Tarek Iraki , Lukas Morand , Johannes Dornheim , Norbert Link , Dirk Helm

This survey article reviews the challenges associated with deploying and optimizing big data applications and machine learning algorithms in cloud data centers and networks. The MapReduce programming model and its widely-used open-source…

Networking and Internet Architecture · Computer Science 2019-10-03 Sanaa Hamid Mohamed , Taisir E. H. El-Gorashi , Jaafar M. H. Elmirghani

In traditional SaaS enterprise applications, microservices are an essential ingredient to deploy machine learning (ML) models successfully. In general, microservices result in efficiencies in software service design, development, and…

Software Engineering · Computer Science 2020-05-05 Venkata Duvvuri

Server consolidation based on virtualization technology simplifies system administration and improves energy efficiency by improving resource utilizations and reducing the physical machine (PM) number in contemporary service-oriented data…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-29 Bo Wang , Ying Song , Yuzhong Sun , Jun Liu

Modern supervised machine learning algorithms involve hyperparameters that have to be set before running them. Options for setting hyperparameters are default values from the software package, manual configuration by the user or configuring…

Machine Learning · Statistics 2018-10-23 Philipp Probst , Bernd Bischl , Anne-Laure Boulesteix

Hybrid cloud provides an attractive solution to microservices for better resource elasticity. A subset of application components can be offloaded from the on-premises cluster to the cloud, where they can readily access additional resources.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-14 Ka-Ho Chow , Umesh Deshpande , Veera Deenadhayalan , Sangeetha Seshadri , Ling Liu

A popular approach in combinatorial optimization is to model problems as integer linear programs. Ideally, the relaxed linear program would have only integer solutions, which happens for instance when the constraint matrix is totally…

Data Structures and Algorithms · Computer Science 2009-09-29 Christoph Durr , Mathilde Hurand