English
Related papers

Related papers: Scaling a Variant Calling Genomics Pipeline with F…

200 papers

The integration of more renewable energy sources into the power system is presenting system operators with various challenges. At the distribution system level, voltage magnitudes that violate operating limits near large photovoltaic…

Optimization and Control · Mathematics 2022-01-05 Sandro Merkli , Roy S. Smith

Most bioinformatics pipelines consist of software components that are tightly coupled to the logic of the pipeline itself. This limits reusability of the individual components in the pipeline or introduces maintenance overhead when they…

Software Engineering · Computer Science 2021-10-25 Robrecht Cannoodt , Hendrik Cannoodt , Eric Van de Kerckhove , Andy Boschmans , Dries De Maeyer , Toni Verbeiren

Serverless computing along with Function-as-a-Service (FaaS) is forming a new computing paradigm that is anticipated to found the next generation of cloud systems. The popularity of this paradigm is due to offering a highly transparent…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-27 Chavit Denninnart , Thanawat Chanikaphon , Mohsen Amini Salehi

Aggregated HPC resources have rigid allocation systems and programming models which struggle to adapt to diverse and changing workloads. Consequently, HPC systems fail to efficiently use the large pools of unused memory and increase the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-29 Marcin Copik , Marcin Chrapek , Larissa Schmid , Alexandru Calotoiu , Torsten Hoefler

Novel technologies in genomics allow creating data in exascale dimension with relatively minor effort of human and laboratory and thus monetary resources compared to capabilities only a decade ago. While the availability of this data…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-10 Sandra Gesing , Thomas Richard Connor , Ian Taylor

Serverless clouds promise efficient scaling, reduced toil and monetary costs. Yet, serverless-ing a complex, legacy application might require major refactoring and thus is risky. As a case study, we use Airflow, an industry-standard…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-04 Filip Mikina , Pawel Zuk , Krzysztof Rzadca

The increased use of micro-services to build web applications has spurred the rapid growth of Function-as-a-Service (FaaS) or serverless computing platforms. While FaaS simplifies provisioning and scaling for application developers, it…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-25 Arjun Singhvi , Kevin Houck , Arjun Balasubramanian , Mohammed Danish Shaikh , Shivaram Venkataraman , Aditya Akella

Elastic scaling is one of the central benefits provided by serverless platforms, and requires that they scale resource up and down in response to changing workloads. Serverless platforms scale-down resources by terminating previously…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-07 Kalev Alpernas , Aurojit Panda , Mooly Sagiv

Function-as-a-Service (FaaS) is a type of serverless computing that allows developers to write and deploy code as individual functions, which can be triggered by specific events or requests. FaaS platforms automatically manage the…

The development of cloud infrastructures inspires the emergence of cloud-native computing. As the most promising architecture for deploying microservices, serverless computing has recently attracted more and more attention in both industry…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-04 Zijun Li , Linsong Guo , Jiagan Cheng , Quan Chen , Bingsheng He , Minyi Guo

Serverless computing has attracted a broad range of applications due to its ease of use and resource elasticity. However, developing serverless applications often poses a dilemma -- relying on general-purpose serverless platforms can fall…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-17 Minchen Yu , Yinghao Ren , Jiamu Zhao , Jiaqi Li

While the requirements of enterprise and web applications have driven the development of Cloud computing, some of its key features, such as customized environments and rapid elasticity, could also benefit scientific applications. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-23 Álvaro López García , Enol Fernández del Castillo

High-performance computing (HPC) is essential for tackling complex computational problems across various domains. As the scale and complexity of HPC applications continue to grow, the need for scalable systems and software architectures…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-21 Risshab Srinivas Ramesh

The rise of big data systems has created a need for benchmarks to measure and compare the capabilities of these systems. Big data benchmarks present unique scalability challenges. The supercomputing community has wrestled with these…

Performance · Computer Science 2016-12-13 Patrick Dreher , Chansup Byun , Chris Hill , Vijay Gadepally , Bradley Kuszmaul , Jeremy Kepner

GCsnap2 Cluster is a scalable, high performance tool for genomic context analysis, developed to overcome the limitations of its predecessor, GCsnap1 Desktop. Leveraging distributed computing with mpi4py[.]futures, GCsnap2 Cluster achieved a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-26 Reto Krummenacher , Osman Seckin Simsek , Michèle Leemann , Leila T. Alexander , Torsten Schwede , Florina M. Ciorba , Joana Pereira

Adapting the cloud for high-performance computing (HPC) is a challenging task, as software for HPC applications hinges on fast network connections and is sensitive to hardware failures. Using cloud infrastructure to recreate conventional…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Philipp A. Witte , Mathias Louboutin , Henryk Modzelewski , Charles Jones , James Selvage , Felix J. Herrmann

Serverless is an emerging cloud computing paradigm that facilitates developers to focus solely on the application logic rather than provisioning and managing the underlying infrastructure. The inherent characteristics such as scalability,…

Software Engineering · Computer Science 2023-11-23 Muhammad Hamza , Muhammad Azeem Akbar , Kari Smolander

Serverless computing is gaining traction as an attractive model for the deployment of a multitude of workloads in the cloud. Designing and building effective resource management solutions for any computing environment requires extensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-20 Anupama Mampage , Rajkumar Buyya

Fast-evolving artificial intelligence (AI) algorithms such as large language models have been driving the ever-increasing computing demands in today's data centers. Heterogeneous computing with domain-specific architectures (DSAs) brings…

Hardware Architecture · Computer Science 2024-03-06 Zhuoping Yang , Shixin Ji , Xingzhen Chen , Jinming Zhuang , Weifeng Zhang , Dharmesh Jani , Peipei Zhou

Ubiquitous cell-free massive MIMO (multiple-input multiple-output) combines massive MIMO technology and user-centric transmission in a distributed architecture. All the access points (APs) in the network cooperate to jointly and coherently…

Information Theory · Computer Science 2019-09-09 Giovanni Interdonato , Pål Frenger , Erik G. Larsson