English
Related papers

Related papers: Software Scalability Issues in Large Clusters

200 papers

Large-scale computing systems are increasingly using accelerators such as GPUs to enable peta- and exa-scale levels of compute to meet the needs of Machine Learning (ML) and scientific computing applications. Given the widespread and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-20 Rutwik Jain , Brandon Tran , Keting Chen , Matthew D. Sinclair , Shivaram Venkataraman

The efficient exploitation of worldwide distributed storage and computing resources available in the grids require a robust, transparent and fast deployment of experiment specific software. The approach followed by the CMS experiment at…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-15 K. Rabbertz , M. Thomas , S. Ashby , M. Corvo , S. Argirò , N. Darmenov , R. Darwish , D. Evans , B. Holzman , N. Ratnikova , S. Muzaffar , A. Nowack , T. Wildish , B. Kim , J. Weng , V. Büge

Containers as the unit of application delivery are the 'next big thing' in the software development world. They enable developers to create an executable image containing an application bundled with all its dependencies which a user can run…

Software Engineering · Computer Science 2017-02-13 Jonas Weber

The distributed computing is done on many systems to solve a large scale problem. The growing of high-speed broadband networks in developed and developing countries, the continual increase in computing power, and the rapid growth of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-14 Dr. Brijender Kahanwal , Dr. T. P. Singh

When you first heard people speak of Piles of PCs, the first thing that came to mind may have been a cluttered computer room with processors, monitors, and snarls of cables all around. Collections of computers have undoubtedly become more…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Mark Baker , Rajkumar Buyya , Dan Hyde

We analyze a dataset of 51 current (2019-2020) Distributed Systems syllabi from top Computer Science programs, focusing on finding the prevalence and context in which topics related to performance are being taught in these courses. We also…

Computers and Society · Computer Science 2021-03-03 Cristina L. Abad , Alexandru Iosup , Edwin F. Boza , Eduardo Ortiz-Holguin

Performance variability has been acknowledged as a problem for over a decade by cloud practitioners and performance engineers. Yet, our survey of top systems conferences reveals that the research community regularly disregards variability…

Distributed dataflow systems such as Apache Spark or Apache Flink enable parallel, in-memory data processing on large clusters of commodity hardware. Consequently, the appropriate amount of memory to allocate to the cluster is a crucial…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Jonathan Will , Lauritz Thamsen , Dominik Scheinert , Odej Kao

Large swarms of autonomous devices are increasing in size and importance. When it comes to controlling the devices of large-scale swarms there are two main lines of thought. Centralized control, where all decisions - and often compute -…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-07 Justin Hu , Ariana Bruno , Drew Zagieboylo , Mark Zhao , Brian Ritchken , Brendon Jackson , Joo Yeon Chae , Francois Mertil , Mateo Espinosa , Christina Delimitrou

The ever-increasing complexity of HW/SW systems presents a persistent challenge, particularly in safety-critical domains like automotive, where extensive testing is imperative. However, the availability of hardware often lags behind,…

Software Engineering · Computer Science 2025-06-13 Lukas Jünger , Jan Henrik Weinstock , Tim Kraus

Analyzing large datasets with distributed dataflow systems requires the use of clusters. Public cloud providers offer a large variety and quantity of resources that can be used for such clusters. However, picking the appropriate resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-28 Jonathan Will , Jonathan Bader , Lauritz Thamsen

This paper describes a way to improve the scalability of program synthesis by exploiting modularity: larger programs are synthesized from smaller programs. The key issue is to make each "larger-created-from-smaller" synthesis sub-problem be…

Programming Languages · Computer Science 2023-08-15 Kanghee Park , Keith J. C. Johnson , Loris D'Antoni , Thomas Reps

Context: The software industry needs to adapt itself to a rapidly changing market. Continuous practices (Continuous Integration, Continuous Delivery and Continuous Deployment), commonly found in Agile development processes, it is possible…

Software Engineering · Computer Science 2018-12-24 Antoine Proulx , Francis Raymond , Bruno Roy , Fabio Petrillo

The adoption of microservice architecture has seen a considerable upswing in recent years, mainly driven by the need to modernize legacy systems and address their limitations. Legacy systems, typically designed as monolithic applications,…

Context: The efficient processing of Big Data is a challenging task for SQL and NoSQL Databases, where competent software architecture plays a vital role. The SQL Databases are designed for structuring data and supporting vertical…

Databases · Computer Science 2022-09-16 Wisal Khan , Teerath Kumar , Zhang Cheng , Kislay Raj , Arunabha M Roy , Bin Luo

Present day machine learning is computationally intensive and processes large amounts of data. It is implemented in a distributed fashion in order to address these scalability issues. The work is parallelized across a number of computing…

Machine Learning · Computer Science 2017-03-28 Alexander Ulanov , Andrey Simanovsky , Manish Marwah

We analyze a distributed system where n nodes called boxes store a large set of videos and collaborate to serve simultaneously n videos or less. We explore under which conditions such a system can be scalable while serving any sequence of…

Networking and Internet Architecture · Computer Science 2008-12-18 Laurent Viennot , Yacine Boufkhad , Fabien Mathieu , Fabien De Montgolfier , Diego Perino

Dramatic increases in the capabilities of neural network models in recent years are driven by scaling model size, training data, and corresponding computational resources. To develop the exceedingly large networks required in modern…

Machine Learning · Computer Science 2025-04-15 Jared Fernandez , Luca Wehrstedt , Leonid Shamis , Mostafa Elhoushi , Kalyan Saladi , Yonatan Bisk , Emma Strubell , Jacob Kahn

In this computer era of rapid development, software development can be seen everywhere, but a lot of softwares are dead in modern development of software. Just as The Mythical Man-Month said, it exists a problem in the software development,…

Software Engineering · Computer Science 2012-07-24 Gang Liao , Lei Liu , Lian Luo

Different departments of a large organization often run dedicated cluster systems for different computing loads, like HPC (high performance computing) jobs or Web service applications. In this paper, we have designed and implemented a cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-07-20 Jianfeng Zhan , Lei Wang , Bibo Tu , Yong Li , Peng Wang , Wei Zhou , Dan Meng