English
Related papers

Related papers: Bauplan: zero-copy, scale-up FaaS for data pipelin…

200 papers

Distributed stream processing systems rely on the dataflow model to define and execute streaming jobs, organizing computations as Directed Acyclic Graphs (DAGs) of operators. Adjusting the parallelism of these operators is crucial to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-08 Yuxing Han , Lixiang Chen , Haoyu Wang , Zhanghao Chen , Yifan Zhang , Chengcheng Yang , Kongzhang Hao , Zhengyi Yang

Function as a Service (FaaS) has been gaining popularity as a way to deploy computations to serverless backends in the cloud. This paradigm shifts the complexity of allocating and provisioning resources to the cloud provider, which has to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-09 Mohammad Shahrad , Rodrigo Fonseca , Íñigo Goiri , Gohar Chaudhry , Paul Batum , Jason Cooke , Eduardo Laureano , Colby Tresness , Mark Russinovich , Ricardo Bianchini

Traditional data processing pipelines are typically static and handcrafted for specific tasks, limiting their adaptability to evolving requirements. While general-purpose agents and coding assistants can generate code for well-understood…

Artificial Intelligence · Computer Science 2026-02-20 Udayan Khurana

Asynchronous message-passing systems are employed frequently to implement distributed mechanisms, protocols, and processes. This paper addresses the problem of precise data flow analysis for such systems. To obtain good precision, data flow…

Programming Languages · Computer Science 2021-01-26 Snigdha Athaiya , Raghavan Komondoor , K Narayan Kumar

In a continuous deployment setting, Function-as-a-Service (FaaS) applications frequently receive updated releases, each of which can cause a performance regression. While continuous benchmarking, i.e., comparing benchmark results of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-20 Tim C. Rese , Nils Japke , Sebastian Koch , Tobias Pfandzelter , David Bermbach

Parallel real-time systems (e.g., autonomous driving systems) often contain functionalities with complex dependencies and execution uncertainties, leading to significant timing variability which can be represented as a probabilistic…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Yiyang Gao , Shuai Zhao , Boyang Li , Xinwei Fang , Zhiyang Lin , Zhe Jiang , Nan Guan

Many computational chemistry and molecular simulation workflows can be expressed as graphs. This abstraction is useful to modularize and potentially reuse existing components, as well as provide parallelization and ease reproducibility.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-05 Thomas Löhr , Michele Assante , Michael Dodds , Lili Cao , Mikhail Kabeshov , Jon-Paul Janet , Marco Klähn , Ola Engkvist

Serverless Function-as-a-Service (FaaS) is a popular cloud paradigm to quickly and cheaply implement complex applications. Because the function instances cloud providers start to execute user code run on shared infrastructure, their…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-27 Trever Schirmer , Natalie Carl , Nils Höller , Tobias Pfandzelter , David Bermbach

Cloud computing platforms offer elastic scaling, managed infrastructure, and pay-per-use pricing, but moving existing monolithic backends to them remains a difficult software engineering task. In practice, the migration requires coordinated…

Software Engineering · Computer Science 2026-04-28 Xingyan Chen , Yuxin Su , Zishan Su , Yang Yu , Zibin Zheng

With the progressive commoditization of modeling capabilities, data-centric AI recognizes that what happens before and after training becomes crucial for real-world deployments. Following the intuition behind Model Cards, we propose DAG…

Software Engineering · Computer Science 2021-11-28 Jacopo Tagliabue , Ville Tuulos , Ciro Greco , Valay Dave

Functional data analysis, which models data as realizations of random functions over a continuum, has emerged as a useful tool for time series data. Often, the goal is to infer the dynamic connections (or time-varying conditional…

Methodology · Statistics 2024-12-10 Chunshan Liu , Daniel R. Kowal , James Doss-Gollin , Marina Vannucci

Proof autoformalization, the task of translating natural language theorems and proofs into machine-verifiable code, is a critical step for integrating large language models into rigorous mathematical workflows. Current approaches focus on…

Artificial Intelligence · Computer Science 2025-10-21 Rafael Cabral , Tuan Manh Do , Xuejun Yu , Wai Ming Tai , Zijin Feng , Xin Shen

Spatiotemporal data are being produced in continuously growing volumes by a variety of data sources and a variety of application fields rely on rapid analysis of such data. Existing systems such as PostGIS or MobilityDB usually build on…

Databases · Computer Science 2026-05-21 Diana Baumann , Tim C. Rese , David Bermbach

In dataflow representations for signal processing systems, applications are represented as directed graphs in which vertices represent computations and edges correspond to buffers that store data as it passes between computations. The…

Signal Processing · Electrical Eng. & Systems 2018-07-17 Yanzhou Liu , Lee Barford , Shuvra S. Bhattacharyya

Function-as-a-Service (FaaS) has become a central paradigm in serverless cloud computing, yet optimizing FaaS deployments remains challenging. Using function fusion, multiple functions can be combined into a single deployment unit, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-19 Niklas Kowallik , Trever Schirmer , David Bermbach

It is a challenging task to train large DNN models on sophisticated GPU platforms with diversified interconnect capabilities. Recently, pipelined training has been proposed as an effective approach for improving device utilization. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-03 Shiqing Fan , Yi Rong , Chen Meng , Zongyan Cao , Siyu Wang , Zhen Zheng , Chuan Wu , Guoping Long , Jun Yang , Lixue Xia , Lansong Diao , Xiaoyong Liu , Wei Lin

Bayesian networks (BNs) are widely used graphical models usable to draw statistical inference about Directed acyclic graphs (DAGs). We presented here Graph_sampler a fast free C language software for structural inference on BNs.…

Computation · Statistics 2016-02-05 Sagnik Datta , Ghislaine Gayraud , Eric Leclerc , Frederic Y. Bois

The current landscape of scientific research is widely based on modeling and simulation, typically with complexity in the simulation's flow of execution and parameterization properties. Execution flows are not necessarily straightforward…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-26 Eduardo Ponce , Brittany Stephenson , Suzanne Lenhart , Judy Day , Gregory D. Peterson

Data-sharing pipelines involve a series of stages that apply policy-based data transformations to enable secure and effective data exchange among organizations. Although numerous tools and platforms exist to manage governance and…

Databases · Computer Science 2025-12-05 Sepideh Masoudi , Sebastian Werner , Pierluigi Plebani , Stefan Tai

Function-as-a-Service (FaaS) is a cloud service model enabling developers to offload event-driven executable snippets of code. The execution and management of such functions becomes a FaaS provider's responsibility, hereby included their…

Software Engineering · Computer Science 2020-04-03 Vladimir Yussupov , Jacopo Soldani , Uwe Breitenbücher , Antonio Brogi , Frank Leymann