English
Related papers

Related papers: Scientific Workflow Systems for 21st Century e-Sci…

200 papers

Large language models (LLMs) have ushered in a new era for processing complex information in various fields, including science. The increasing amount of scientific literature allows these models to acquire and understand scientific…

Computation and Language · Computer Science 2024-08-21 Huy Quoc To , Ming Liu , Guangyan Huang

Scientific workflow management systems support large-scale data analysis on cluster infrastructures. For this, they interact with resource managers which schedule workflow tasks onto cluster nodes. In addition to workflow task descriptions,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-30 Jonathan Bader , Kathleen West , Soeren Becker , Svetlana Kulagina , Fabian Lehmann , Lauritz Thamsen , Henning Meyerhenke , Odej Kao

A workflow describes the entirety of processing steps in an analysis, such as employed in many fields of physics. Workflow management makes the dependencies between individual steps of a workflow and their computational requirements…

Data Analysis, Statistics and Probability · Physics 2023-09-15 Caspar Schmitt , Boyang Yu , Thomas Kuhr

Scientific publishing seems to be at a turning point. Its paradigm has stayed basically the same for 300 years but is now challenged by the increasing volume of articles that makes it very hard for scientists to stay up to date in their…

Digital Libraries · Computer Science 2019-10-09 Cristina-Iulia Bucur , Tobias Kuhn , Davide Ceolin

All sciences, including astronomy, are now entering the era of information abundance. The exponentially increasing volume and complexity of modern data sets promises to transform the scientific practice, but also poses a number of common…

Astrophysics · Physics 2016-11-17 S. G. Djorgovski

Scientific workflows process extensive data sets over clusters of independent nodes, which requires a complex stack of infrastructure components, especially a resource manager (RM) for task-to-node assignment, a distributed file system…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-12 Fabian Lehmann , Jonathan Bader , Friedrich Tschirpke , Ninon De Mecquenem , Ansgar Lößer , Soeren Becker , Katarzyna Ewa Lewińska , Lauritz Thamsen , Ulf Leser

Over the past few years, we have seen fundamental breakthroughs in core problems in machine learning, largely driven by advances in deep neural networks. At the same time, the amount of data collected in a wide array of scientific domains…

Machine Learning · Computer Science 2020-03-27 Maithra Raghu , Eric Schmidt

Research methods are essential parts in conducting any research project. Although they have been theorized and summarized based on best practices, every field of science requires an adaptation of the overall approaches to perform research…

General Literature · Computer Science 2017-03-16 Hossein Hassani

Supply chains form the backbone of modern economies and therefore require reliable information flows. In practice, however, supply chains face severe technical challenges, especially regarding security and privacy. In this work, we…

Emerging data-driven scientific workflows are seeking to leverage distributed data sources to understand end-to-end phenomena, drive experimentation, and facilitate important decision-making. Despite the exponential growth of available…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-10 Manish Parashar

We present a novel system providing summaries for Computer Science publications. Through a qualitative user study, we identified the most valuable scenarios for discovery, exploration and understanding of scientific documents. Based on…

The way science is currently practiced shows conclusions but hides how they were reached. Researchers work privately, polish their results, publish a finished paper, and defend it. Errors are punished by retraction rather than corrected by…

Digital Libraries · Computer Science 2026-04-14 Sergey V. Samsonau

This paper describes a vision and work in progress to elevate network resources and data transfer management to the same level as compute and storage in the context of services access, scheduling, life cycle management, and orchestration.…

Networking and Internet Architecture · Computer Science 2022-03-22 Tom Lehman , Xi Yang , Chin Guok , Frank Wuerthwein , Igor Sfiligoi , John Graham , Aashay Arora , Dima Mishin , Diego Davila , Jonathan Guiang , Tom Hutton , Harvey Newman , Justas Balcas

This paper tries to reduce the effort of learning, deploying, and integrating several frameworks for the development of e-Science applications that combine simulations with High-Performance Data Analytics (HPDA). We propose a way to extend…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-10 Cristian Ramon-Cortes , Francesc Lordan , Jorge Ejarque , Rosa M. Badia

Over the past six decades, the computing systems field has experienced significant transformations, profoundly impacting society with transformational developments, such as the Internet and the commodification of computing. Underpinned by…

Scientific workflows automate the analysis of large-scale scientific data, fostering the reuse of data processing operators as well as the reproducibility and traceability of analysis results. In exploratory research, however, workflows are…

Other Computer Science · Computer Science 2023-09-26 Sebastian Pohl , Nourhan Elfaramawy , Kedi Cao , Birte Kehr , Matthias Weidlich

This study describes a vision, how technology can help improving the efficiency in research. We propose a new clean-slate design, where more emphasis is given on the correctness and up-to-dateness of the scientific results, it is more open…

Digital Libraries · Computer Science 2017-11-29 János Tapolcai

Scientific workflows are widely used to automate scientific data analysis and often involve processing large quantities of data on compute clusters. As such, their execution tends to be long-running and resource intensive, leading to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Kathleen West , Fabian Lehmann , Vasilis Bountris , Ulf Leser , Yehia Elkhatib , Lauritz Thamsen

Although computer science papers are often accompanied by software artifacts, connecting research papers to their software artifacts and vice versa is not always trivial. First of all, there is a lack of well-accepted standards for how such…

Software Engineering · Computer Science 2021-04-14 Hideaki Hata , Jin L. C. Guo , Raula Gaikovina Kula , Christoph Treude

The increasing availability of cloud computing services for science has changed the way scientific code can be developed, deployed, and run. Many modern scientific workflows are capable of running on cloud computing resources. Consequently,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-11 Peter Vaillancourt , Bennett Wineholt , Brandon Barker , Plato Deliyannis , Jackie Zheng , Akshay Suresh , Adam Brazier , Rich Knepper , Rich Wolski