English
Related papers

Related papers: WfBench: Automated Generation of Scientific Workfl…

200 papers

Large Language Models (LLMs) have made significant strides in front-end code generation. However, existing benchmarks exhibit several critical limitations: many tasks are overly simplistic, test cases often lack rigor, and end-to-end…

Software Engineering · Computer Science 2025-06-19 Hongda Zhu , Yiwen Zhang , Bing Zhao , Jingzhe Ding , Siyao Liu , Tong Liu , Dandan Wang , Yanan Liu , Zhaojian Li

Recent advances in probabilistic modelling have led to a large number of simulation-based inference algorithms which do not require numerical evaluation of likelihoods. However, a public benchmark with appropriate performance metrics for…

Machine Learning · Statistics 2021-04-12 Jan-Matthis Lueckmann , Jan Boelts , David S. Greenberg , Pedro J. Gonçalves , Jakob H. Macke

Heterogeneous scientific workflows consist of numerous types of tasks that require executing on heterogeneous resources. Asynchronous execution of those tasks is crucial to improve resource utilization, task throughput and reduce workflows'…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-28 Vincent R. Pascuzzi , Ozgur O. Kilic , Matteo Turilli , Shantenu Jha

A key hurdle is demonstrating compute resource capability with limited benchmarks. We propose workflow templates as a solution, offering adaptable designs for specific scientific applications. Our paper identifies common usage patterns for…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-31 Gregor von Laszewski , Wesley Brewer , Sean R. Wilkinson , Andrew Shao , J. P. Fleischer , Harshad Pitkar , Christine R. Kirkpatrick , Geoffrey C. Fox

Many existing scientific workflows require High Performance Computing environments to produce results in a timely manner. These workflows have several software library components and use different environments, making the deployment and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-26 Liliane Kunstmann , Débora Pina , Daniel de Oliveira , Marta Mattoso

Distributed stream processing frameworks help building scalable and reliable applications that perform transformations and aggregations on continuous data streams. This paper introduces ShuffleBench, a novel benchmark to evaluate the…

Software Engineering · Computer Science 2024-03-08 Sören Henning , Adriano Vogel , Michael Leichtfried , Otmar Ertl , Rick Rabiser

Scientific workflows process extensive data sets over clusters of independent nodes, which requires a complex stack of infrastructure components, especially a resource manager (RM) for task-to-node assignment, a distributed file system…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-12 Fabian Lehmann , Jonathan Bader , Friedrich Tschirpke , Ninon De Mecquenem , Ansgar Lößer , Soeren Becker , Katarzyna Ewa Lewińska , Lauritz Thamsen , Ulf Leser

Machine learning on graphs has made substantial progress across domains such as molecular property prediction and chip design. Yet benchmarking practices remain fragmented, often relying on narrow, task-specific datasets and inconsistent…

Autonomous agents are increasingly expected to support scientific research, and recent benchmarks report progress in code repair and autonomous experimentation. However, these evaluations typically assume a pre-configured execution…

Software Engineering · Computer Science 2026-03-12 Yubang Wang , Chenxi Zhang , Bowen Chen , Zezheng Huai , Zihao Dai , Xinchi Chen , Yuxin Wang , Yining Zheng , Jingjing Gong , Xipeng Qiu

Workflows provide an expressive programming model for fine-grained control of large-scale applications in distributed computing environments. Accurate estimates of complex workflow execution metrics on large-scale machines have several key…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-18 Alok Singh , Mai Nguyen , Shweta Purawat , Daniel Crawl , Ilkay Altintas

LLM agents are increasingly deployed as executable systems that use tools, modify workspaces, and produce concrete artifacts. In such workflows, performance depends not only on the base model, but also on the harness: the system layer that…

Artificial Intelligence · Computer Science 2026-05-28 Yilun Yao , Xinyu Tan , Chao-Hsuan Liu , Yaoming Li , Zhengyang Wang , Wenhan Yu , Zhewen Tan , Yuxuan Tian , Guangxiang Zhao , Lin Sun , Xiangzheng Zhang , Tong Yang

With the increasing amount of data available to scientists in disciplines as diverse as bioinformatics, physics, and remote sensing, scientific workflow systems are becoming increasingly important for composing and executing scalable data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-20 Jonathan Bader , Nils Diedrich , Lauritz Thamsen , Odej Kao

Cloud-native is an approach to building and running scalable applications in modern cloud infrastructures, with the Kubernetes container orchestration platform being often considered as a fundamental cloud-native building block. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-29 Michal Orzechowski , Bartosz Balis , Krzysztof Janecki

Running scientific workflows on a supercomputer can be a daunting task for a scientific domain specialist. Workflow management solutions (WMS) are a standard method for reducing the complexity of application deployment on high performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-30 Wouter Klijn , Sandra Diaz-Pier , Abigail Morrison , Alexander Peyser

Existing AI benchmarks for software automation rarely combine cross-application coordination, autonomous API discovery, and policy adherence. Real business workflows demand all three: a single task may span a CRM, inbox, calendar, and…

Artificial Intelligence · Computer Science 2026-04-22 Daniel Shepard , Robin Salimans

High Performance Distributed Computing is essential to boost scientific progress in many areas of science and to efficiently deploy a number of complex scientific applications. These applications have different characteristics that require…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-04 Mariza Ferro , Antonio R. Mury , Laion F. Manfroi , Bruno Schlze

AI models are increasingly prevalent in high-stakes environments, necessitating thorough assessment of their capabilities and risks. Benchmarks are popular for measuring these attributes and for comparing model performance, tracking…

Artificial Intelligence · Computer Science 2024-11-21 Anka Reuel , Amelia Hardy , Chandler Smith , Max Lamparth , Malcolm Hardy , Mykel J. Kochenderfer

The breakthrough in Deep Learning neural networks has transformed the use of AI and machine learning technologies for the analysis of very large experimental datasets. These datasets are typically generated by large-scale experimental…

Machine Learning · Computer Science 2021-10-26 Jeyan Thiyagalingam , Mallikarjun Shankar , Geoffrey Fox , Tony Hey

The automatic generation of Verilog code using Large Language Models (LLMs) has garnered significant interest in hardware design automation. However, existing benchmarks for evaluating LLMs in Verilog generation fall short in replicating…

Machine Learning · Computer Science 2025-07-23 Pengwei Jin , Di Huang , Chongxiao Li , Shuyao Cheng , Yang Zhao , Xinyao Zheng , Jiaguo Zhu , Shuyi Xing , Bohan Dou , Rui Zhang , Zidong Du , Qi Guo , Xing Hu

In this work, we present a new benchmarking suite with new real-life inspired skewed workloads to test the performance of concurrent index data structures. We started this project to prepare workloads specifically for self-adjusting data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-19 Vitaly Aksenov , Dmitry Ivanov , Ravil Galiev