English
Related papers

Related papers: Accurate runtime selection of optimal MPI collecti…

200 papers

Several algorithms have been proposed to compute partitions of networks into communities that score high on a graph clustering index called modularity. While publications on these algorithms typically contain experimental evaluations to…

Data Analysis, Statistics and Probability · Physics 2007-05-23 U. Brandes , D. Delling , M. Gaertler , R. Goerke , M. Hoefer , Z. Nikoloski , D. Wagner

Selecting the right compiler optimisations has a severe impact on programs' performance. Still, the available optimisations keep increasing, and their effect depends on the specific program, making the task human intractable. Researchers…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-12 Stefano Cereda , Gianluca Palermo , Paolo Cremonesi , Stefano Doni

Distributed optimization algorithms are widely used in many industrial machine learning applications. However choosing the appropriate algorithm and cluster size is often difficult for users as the performance and convergence rate of…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-21 Xinghao Pan , Shivaram Venkataraman , Zizheng Tai , Joseph Gonzalez

The collective operations are considered critical for improving the performance of exascale-ready and high-performance computing applications. On this paper we focus on the Message-Passing Interface (MPI) Allgather many to many collective,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-21 Wilton Jaciel Loch , Guilherme Piêgas Koslovski

The selection of the most appropriate algorithm to solve a given problem instance, known as algorithm selection, is driven by the potential to capitalize on the complementary performance of different algorithms across sets of problem…

Machine Learning · Computer Science 2024-06-12 Gjorgjina Cenikj , Ana Nikolikj , Gašper Petelin , Niki van Stein , Carola Doerr , Tome Eftimov

In this paper we explore the performance limits of Apache Spark for machine learning applications. We begin by analyzing the characteristics of a state-of-the-art distributed machine learning algorithm implemented in Spark and compare it to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-21 Celestine Dünner , Thomas Parnell , Kubilay Atasu , Manolis Sifalakis , Haralampos Pozidis

Motion planning for autonomous robots in dynamic environments poses numerous challenges due to uncertainties in the robot's dynamics and interaction with other agents. Sampling-based MPC approaches, such as Model Predictive Path Integral…

Robotics · Computer Science 2024-05-07 Elia Trevisan , Javier Alonso-Mora

In a typical Internet-of-Things setting that involves scientific applications, a target computation can be evaluated in many different ways depending on the split of computations among various devices. On the one hand, different…

Performance · Computer Science 2022-08-09 Aravind Sankaran , Paolo Bientinesi

Inexact methods for model predictive control (MPC), such as real-time iterative schemes or time-distributed optimization, alleviate the computational burden of exact MPC by providing suboptimal solutions. While the asymptotic stability of…

Systems and Control · Electrical Eng. & Systems 2023-11-21 Aren Karapetyan , Efe C. Balta , Andrea Iannelli , John Lygeros

To select the best algorithm for a new problem is an expensive and difficult task. However, there are automatic solutions to address this problem: using Metalearning, which takes advantage of problem characteristics (i.e. metafeatures), one…

Information Retrieval · Computer Science 2018-07-25 Tiago Cunha , Carlos Soares , André C. P. L. F. de Carvalho

In the world of big data, many people find it difficult to access the information they need quickly and accurately. In order to overcome this, research on the system that recommends information accurately to users is continuously conducted.…

Computers and Society · Computer Science 2019-09-19 Keum Gang Cha , Soo-Ryeon Lee , Jung-Woo Lee , Seung Bin Baik

The problem of MPI programs execution time prediction on a certain set of computer installations is considered. This problem emerges with orchestration and provisioning a virtual infrastructure in a cloud computing environment over a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-31 A. Chupakhin , A. Kolosov , R. Smeliansky , V. Antonenko , G. Ishelev

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

Machine Learning · Computer Science 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

The effectiveness of the machine learning methods for real-world tasks depends on the proper structure of the modeling pipeline. The proposed approach is aimed to automate the design of composite machine learning pipelines, which is…

Feedback control synthesis for large-scale particle systems is reviewed in the framework of model predictive control (MPC). The high-dimensional character of collective dynamics hampers the performance of traditional MPC algorithms based on…

Optimization and Control · Mathematics 2024-02-27 Giacomo Albi , Sara Bicego , Michael Herty , Yuyang Huang , Dante Kalise , Chiara Segala

Data-driven algorithmic matching systems promise to help human decision makers make better matching decisions in a wide variety of high-stakes application domains, such as healthcare and social service provision. However, existing systems…

Machine Learning · Computer Science 2025-08-20 Adrian Arnaiz-Rodriguez , Nina Corvelo Benz , Suhas Thejaswi , Nuria Oliver , Manuel Gomez-Rodriguez

With the recent rise of generative Artificial Intelligence (AI), the need of selecting high-quality dataset to improve machine learning models has garnered increasing attention. However, some part of this topic remains underexplored, even…

Machine Learning · Statistics 2025-06-16 Kyung Rok Kim , Yansong Wang , Xiaocheng Li , Guanting Chen

Operations is a key challenge in the domain of machine learning pipeline deployments involving monitoring and management of real-time prediction quality. Typically, metrics like accuracy, RMSE etc., are used to track the performance of…

Many organizations routinely analyze large datasets using systems for distributed data-parallel processing and clusters of commodity resources. Yet, users need to configure adequate resources for their data processing jobs. This requires…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-02 Lauritz Thamsen , Dominik Scheinert , Jonathan Will , Jonathan Bader , Odej Kao

With the increasing number of Quad-Core-based clusters and the introduction of compute nodes designed with large memory capacity shared by multiple cores, new problems related to scalability arise. In this paper, we analyze the overall…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-08-17 Abdelgadir Tageldin Abdelgadir , Al-Sakib Khan Pathan , Mohiuddin Ahmed