English
Related papers

Related papers: Reproducible experiments on dynamic resource alloc…

200 papers

Applications that fuse machine learning and simulation can benefit from the use of multiple computing resources, with, for example, simulation codes running on highly parallel supercomputers and AI training and inference tasks on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-04 Logan Ward , J. Gregory Pauloski , Valerie Hayot-Sasson , Ryan Chard , Yadu Babuji , Ganesh Sivaraman , Sutanay Choudhury , Kyle Chard , Rajeev Thakur , Ian Foster

Performance modeling can help to improve the resource efficiency of clusters and distributed dataflow applications, yet the available modeling data is often limited. Collaborative approaches to performance modeling, characterized by the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-24 Dominik Scheinert , Soeren Becker , Jonathan Will , Luis Englaender , Lauritz Thamsen

Shared e-mobility services have been widely tested and piloted in cities across the globe, and already woven into the fabric of modern urban planning. This paper studies a practical yet important problem in those systems: how to deploy and…

Artificial Intelligence · Computer Science 2021-11-04 Man Luo , Bowen Du , Konstantin Klemmer , Hongming Zhu , Hongkai Wen

We propose a novel approach to allocating resources for expensive simulations of high fidelity models when used in a multifidelity framework. Allocation decisions that distribute computational resources across several simulation models…

Numerical Analysis · Mathematics 2019-01-01 Daniel J. Perry , Robert M. Kirby , Akil Narayan , Ross T. Whitaker

Recent developments in the commercial open source community have catalysed the use of Linux containers for scalable deployment of web-based applications to the cloud. Scientific software can be containerized with dependencies, configuration…

Software Engineering · Computer Science 2015-09-30 Robert Nagler , David Bruhwiler , Paul Moeller , Stephen Webb

CFD users of supercomputers usually resort to rule-of-thumb methods to select the number of subdomains (partitions) when relying on MPI-based parallelization. One common approach is to set a minimum number of elements or cells per…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-30 G. Houzeaux , R. M. Badia , R. Borrell , D. Dosimont , J. Ejarque , M. Garcia-Gasulla , V. López

This letter compares the performance of four different, popular simulation environments for robotics and reinforcement learning (RL) through a series of benchmarks. The benchmarked scenarios are designed carefully with current industrial…

Robotics · Computer Science 2021-03-09 Marian Körber , Johann Lange , Stephan Rediske , Simon Steinmann , Roland Glück

Establishing a docker-based replicability infrastructure offers the community a great opportunity: measuring the run time of information retrieval systems. The time required to present query results to a user is paramount to the users…

Information Retrieval · Computer Science 2019-07-11 Sebastian Hofstätter , Allan Hanbury

Performing efficient resource provisioning is a fundamental aspect for any resource provider. Local Resource Management Systems (LRMS) have been used in data centers for decades in order to obtain the best usage of the resources, providing…

Cloud computing has recently emerged as a major trend in distributed computing. We proposed a platform for selecting and configuring automatically an appropriate cloud environment that meets a set of consumer and provider requirements. It…

Software Engineering · Computer Science 2021-04-05 Asmae Benali , Bouchra El Asri

Recent studies in different fields of science caused emergence of needs for high performance computing systems like Cloud. A critical issue in design and implementation of such systems is resource allocation which is directly affected by…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-05 Masoud Nosrati , Abdolah Chalechale , Ronak Karimi

One of the factors that limits the scale, performance, and sophistication of distributed applications is the difficulty of concurrently executing them on multiple distributed computing resources. In part, this is due to a poor understanding…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-22 Matteo Turilli , Feng Liu , Zhao Zhang , Andre Merzky , Michael Wilde , Jon Weissman , Daniel S. Katz , Shantenu Jha

For large-scale scientific simulations, it is expensive to store raw simulation results to perform post-analysis. To minimize expensive I/O, "in-situ" analysis is often used, where analysis applications are tightly coupled with scientific…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-01 Feng Li , Dali Wang , Feng Yan , Fengguang Song

Different software tools have been developed with the purpose of performing offline evaluations of recommender systems. However, the results obtained with these tools may be not directly comparable because of subtle differences in the…

Information Retrieval · Computer Science 2018-10-12 Diego Monti , Giuseppe Rizzo , Maurizio Morisio

In a cloud computing job with many parallel tasks, the tasks on the slowest machines (straggling tasks) become the bottleneck in the job completion. Computing frameworks such as MapReduce and Spark tackle this by replicating the straggling…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-14 Da Wang , Gauri Joshi , Gregory Wornell

Cloud computing offers an opportunity to run compute-resource intensive climate models at scale by parallelising model runs such that datasets useful to the exoplanet community can be produced efficiently. To better understand the…

Evaluation of large-scale network systems and applications is usually done in one of three ways: simulations, real deployment on Internet, or on an emulated network testbed such as a cluster. Simulations can study very large systems but…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-12-02 Liang Wang , Jussi Kangasharju

Cloud Robotics is helping to create a new generation of robots that leverage the nearly unlimited resources of large data centers (i.e., the cloud), overcoming the limitations imposed by on-board resources. Different processing power,…

Robotics · Computer Science 2024-12-03 Saeid Alirezazadeh , Luís A. Alexandre

Adaptive workloads can change on--the--fly the configuration of their jobs, in terms of number of processes. In order to carry out these job reconfigurations, we have designed a methodology which enables a job to communicate with the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-01 Sergio Iserte , Rafael Mayo , Enrique S. Quintana-Orti , Vicenc Beltran , Antonio J. Peña

In decentralized systems, nodes often need to coordinate to access shared resources in a fair manner. One approach to perform such arbitration is to rely on auction mechanisms. Although there is an extensive literature that studies…

Computer Science and Game Theory · Computer Science 2020-01-20 Amin M. Khan , Xavier Vilaça , Luís Rodrigues , Felix Freitag