English
Related papers

Related papers: Efficiently Reproducing Distributed Workflows in N…

200 papers

Crowdsourcing is a multidisciplinary research area including disciplines like artificial intelligence, human-computer interaction, database, and social science. To facilitate cooperation across disciplines, reproducibility is a crucial…

Databases · Computer Science 2016-09-06 Ruochen Jiang , Jiannan Wang

Data management systems have traditionally been designed to support either long-running analytics queries or short-lived transactions, but an increasing number of applications need both. For example, online games, socio-mobile apps, and…

Databases · Computer Science 2012-05-31 Benjamin Sowell , Wojciech Golab , Mehul A. Shah

Distributed digital infrastructures for computation and analytics are now evolving towards an interconnected ecosystem allowing complex applications to be executed from IoT Edge devices to the HPC Cloud (aka the Computing Continuum, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-06 Daniel Rosendo , Alexandru Costan , Gabriel Antoniu , Patrick Valduriez

In this short paper, we introduce the Ridgeline model, an extension of the Roofline model [4] for distributed systems. The Roofline model targets shared memory systems, bounding the performance of a kernel based on its operational…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Fabio Checconi , Jesmin Jahan Tithi , Fabrizio Petrini

Workflow management systems allow the users to develop complex applications at a higher level, by orchestrating functional components without handling the implementation details. Although a wide range of workflow engines are developed in…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-10-06 Alexandru Costan , Corina Stratan , Eliana-Dina Tirsa , Mugurel Ionut Andreica , Valentin Cristea

With the rise of neural models across the field of information retrieval, numerous publications have incrementally pushed the envelope of performance for a multitude of IR tasks. However, these networks often sample data in random order,…

Information Retrieval · Computer Science 2018-06-12 Daniel Cohen , Scott M. Jordan , W. Bruce Croft

Recurrent neural networks can be large and compute-intensive, yet many applications that benefit from RNNs run on small devices with very limited compute and storage capabilities while still having run-time constraints. As a result, there…

Machine Learning · Computer Science 2020-08-14 Urmish Thakker , Jesse Beu , Dibakar Gope , Ganesh Dasika , Matthew Mattina

In case of multiple node failures performance becomes very low as compare to single node failure. Failures of nodes in cluster computing can be tolerated by multiple fault tolerant computing. Existing recovery schemes are efficient for…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-02-15 Sanjay Bansal , Sanjeev Sharma

Workflows are prevalent in today's computing infrastructures. The workflow model support various different domains, from machine learning to finance and from astronomy to chemistry. Different Quality-of-Service (QoS) requirements and other…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-22 Laurens Versluis , Alexandru Iosup

Screening or assessing studies is critical to the quality and outcomes of a systematic review. Typically, a Boolean query retrieves the set of studies to screen. As the set of studies retrieved is unordered, screening all retrieved studies…

Information Retrieval · Computer Science 2021-12-09 Shuai Wang , Harrisen Scells , Ahmed Mourad , Guido Zuccon

DNN inference can be accelerated by distributing the workload among a cluster of collaborative edge nodes. Heterogeneity among edge devices and accuracy-performance trade-offs of DNN models present a complex exploration space while catering…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-27 Zain Taufique , Antonio Miele , Pasi Liljeberg , Anil Kanduri

We describe a project-based introduction to reproducible and collaborative neuroimaging analysis. Traditional teaching on neuroimaging usually consists of a series of lectures that emphasize the big picture rather than the foundations on…

Other Statistics · Statistics 2018-10-23 K. Jarrod Millman , Matthew Brett , Ross Barnowski , Jean-Baptiste Poline

The convergence of IoT, Edge, Cloud, and HPC technologies creates a compute continuum that merges cloud scalability and flexibility with HPC's computational power and specialized optimizations. However, integrating cloud and HPC resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-20 Aasish Kumar Sharma , Christian Boehme , Patrick Gelß , Ramin Yahyapour , Julian Kunkel

The work described in this paper improves the reactivity of the Coq system by completely redesigning the way it processes a formal document. By subdividing such work into independent tasks the system can give precedence to the ones of…

Logic in Computer Science · Computer Science 2015-06-19 Bruno Barras , Carst Tankink , Enrico Tassi

Workflows are critical for scientific discovery. However, the sophistication, heterogeneity, and scale of workflows make building, testing, and optimizing them increasingly challenging. Furthermore, their complexity and heterogeneity make…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-28 Ozgur Ozan Kilic , Tianle Wang , Matteo Turilli , Mikhail Titov , Andre Merzky , Line Pouchard , Shantenu Jha

Although some recent works show potential complementarity among different state-of-the-art systems, few works try to investigate this problem in text summarization. Researchers in other areas commonly refer to the techniques of reranking or…

Computation and Language · Computer Science 2021-04-16 Yixin Liu , Zi-Yi Dou , Pengfei Liu

Scientific workflows process extensive data sets over clusters of independent nodes, which requires a complex stack of infrastructure components, especially a resource manager (RM) for task-to-node assignment, a distributed file system…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-12 Fabian Lehmann , Jonathan Bader , Friedrich Tschirpke , Ninon De Mecquenem , Ansgar Lößer , Soeren Becker , Katarzyna Ewa Lewińska , Lauritz Thamsen , Ulf Leser

Reproducibility and sustainability present significant challenges in bioinformatics software development, where rapidly evolving tools and complex workflows often result in short-lived or difficult-to-adapt pipelines. This paper introduces…

Software Engineering · Computer Science 2025-05-07 Marco Masera , Alessandro Leone , Johannes Köster , Ivan Molineris

Computational notebook software such as Jupyter Notebook is popular for data science tasks. Numerous computational notebooks are available on the Web and reusable; however, searching for computational notebooks manually is a tedious task,…

Information Retrieval · Computer Science 2022-02-01 Misato Horiuchi , Yuya Sasaki , Chuan Xiao , Makoto Onizuka

Volunteer Computing, sometimes called Public Resource Computing, is an emerging computational model that is very suitable for work-pooled parallel processing. As more complex grid applications make use of work flows in their design and…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-11-27 Lei Ni , Aaron Harwood