English
Related papers

Related papers: Scaling a Variant Calling Genomics Pipeline with F…

200 papers

Serverless computing offers attractive scalability, elasticity and cost-effectiveness. However, constraints on memory, CPU and function runtime have hindered its adoption for data-intensive applications and machine learning (ML) workloads.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-25 Joe Oakley , Hakan Ferhatosmanoglu

Massive exploitation of next-generation sequencing technologies requires dealing with both: huge amounts of data and complex bioinformatics pipelines. Computing architectures have evolved to deal with these problems, enabling approaches…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-07 Aaron Call , Jordà Polo , David Carrera , Francesc Guim , Sujoy Sen

In Function as a Service (FaaS), a serverless computing variant, customers deploy functions instead of complete virtual machines or Linux containers. It is the cloud provider who maintains the runtime environment for these functions. FaaS…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-16 Bartłomiej Przybylski , Paweł Żuk , Krzysztof Rzadca

In recent years, serverless computing, especially Function as a Service (FaaS), is rapidly growing in popularity as a cloud programming model. The serverless computing model provides an intuitive interface for developing cloud-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-10 Aristotelis Peri , Michail Tsenos , Vana Kalogeraki

Cloud elasticity - the ability to use as much resources as needed at any given time - and low cost - a user pays only for the resources it consumes - represent solid incentives for many organizations to migrate some of their computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-07-15 Ashkan Paya , Dan C. Marinescu

The development of composable systems architecture marks a significant shift in resource allocation and utilization within data centers. This paper presents a composable architecture scaling up to 32 GPUs on a single node, addressing the…

Emerging Technologies · Computer Science 2024-04-10 John Ihnotic

Serverless computing is an emerging cloud computing paradigm that has been applied to various domains, including machine learning, scientific computing, video processing, etc. To develop serverless computing-based software applications…

Software Engineering · Computer Science 2022-07-28 Jinfeng Wen , Zhenpeng Chen , Xuanzhe Liu

Variable selection for structured covariates lying on an underlying known graph is a problem motivated by practical applications, and has been a topic of increasing interest. However, most of the existing methods may not be scalable to high…

Methodology · Statistics 2016-04-27 Changgee Chang , Suprateek Kundu , Qi Long

Cloud computing provides a great opportunity for scientists, as it enables large-scale experiments that cannot are too long to run on local desktop machines. Cloud-based computations can be highly parallel, long running and data-intensive,…

Software Engineering · Computer Science 2016-12-07 Maria Spichkova , Heinz W. Schmidt , Ian E. Thomas , Iman I. Yusuf , Steve Androulakis , Grischa R. Meyer

Developing complex biomolecular workflows is not always straightforward. It requires tedious developments to enable the interoperability between the different biomolecular simulation and analysis tools. Moreover, the need to execute the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Jorge Ejarque , Pau Andrio , Adam Hospital , Javier Conejero , Daniele Lezzi , Josep LL. Gelpi , Rosa M. Badia

Operating a modern power grid reliably in case of SCADA/EMS failure or amid difficult times like COVID-19 pandemic is a challenging task for grid operators. In [11], a PMU-based emergency generation dispatch scheme has been proposed to help…

Physics and Society · Physics 2021-08-03 Song Zhang , Xiaochuan Luo , Eugene Litvinov

Experiment-in-the-Loop Computing (EILC) requires support for numerous types of processing and the management of heterogeneous infrastructure over a dynamic range of scales: from the edge to the cloud and HPC, and intermediate resources.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-16 Andre Luckow , Shantenu Jha

HPC and Cloud have evolved independently, specializing their innovations into performance or productivity. Acceleration as a Service (XaaS) is a recipe to empower both fields with a shared execution platform that provides transparent access…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-10 Torsten Hoefler , Marcin Copik , Pete Beckman , Andrew Jones , Ian Foster , Manish Parashar , Daniel Reed , Matthias Troyer , Thomas Schulthess , Dan Ernst , Jack Dongarra

Serverless query processing has become increasingly popular due to its auto-scaling, high elasticity, and pay-as-you-go pricing. It allows cloud data warehouse (or lakehouse) users to focus on data analysis without the burden of managing…

Databases · Computer Science 2024-12-24 Haoqiong Bian , Dongyang Geng , Yunpeng Chai , Anastasia Ailamaki

With their high parallelism and resource needs, many scientific applications benefit from cloud deployments. Today, scientific applications are executed on dedicated pools of VMs, resulting in resource fragmentation: users pay for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-23 Simon Shillaker , Carlos Segarra , Eleftheria Mappoura , Mayeul Fournial , Lluis Vilanova , Peter Pietzuch

The web ecosystem is rapidly evolving with changing business and functional models. Cloud platforms are available in a SaaS, PaaS and IaaS model designed around commoditized Linux based servers. 10 billion users will be online and accessing…

Software Engineering · Computer Science 2018-09-24 Shaun C. D'Souza

Elasticity is one of key features of cloud computing. Elasticity allows Software as a Service (SaaS) applications' provider to reduce cost of running applications. In large SaaS applications that are developed using service-oriented…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-07 Ashraf A. Shahin

Background: With the rapid growth of massively parallel sequencing technologies, still more laboratories are utilizing sequenced DNA fragments for genomic analyses. Interpretation of sequencing data is, however, strongly dependent on…

HPC as a service (HPCaaS) is a new way to expose HPC resources via cloud services. However, continued effort to port large-scale tightly coupled applications with high interprocessor communication to multiple (and many) nodes synchronously,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-04 Yehonatan Fridman , Re'em Harel , Gal Oren

High performance is needed in many computing systems, from batch-managed supercomputers to general-purpose cloud platforms. However, scientific clusters lack elastic parallelism, while clouds cannot offer competitive costs for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-16 Marcin Copik , Konstantin Taranov , Alexandru Calotoiu , Torsten Hoefler