English
Related papers

Related papers: Streaming Data in HPC Workflows Using ADIOS

200 papers

With the tremendous advances in processor and memory technology, I/O has risen to become the bottleneck in high-performance computing for many applications. The development of parallel file systems has helped to ease the performance gap,…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Avery Ching , Alok Choudhary , Wei-keng Liao , Rob Ross , William Gropp

3D data simulation aims to bridge the gap between simulated and real-captured 3D data, which is a fundamental problem for real-world 3D visual tasks. Most 3D data simulation methods inject predefined physical priors but struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Mutian Xu , Chongjie Ye , Haolin Liu , Yushuang Wu , Jiahao Chang , Xiaoguang Han

Increased adoption of scientific workflows in the community has urged for the development of multi-tenant platforms that provide these workflow executions as a service. As a result, Workflow-as-a-Service (WaaS) concept has been created by…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-25 Muhammad H. Hilman , Maria A. Rodriguez , Rajkumar Buyya

Software as a service (SaaS) has recently enjoyed much attention as it makes the use of software more convenient and cost-effective. At the same time, the arising of users' expectation for high quality service such as real-time information…

Software Engineering · Computer Science 2016-04-13 Feng-Lin Li , Chi-Hung Chi , Yue Wang , Cong Liu

The current work presents a realizable method to control streaky disturbances in boundary layer flows and delay transition to turbulence via active flow control. Numerical simulations of the nonlinear transitional regime in a Blasius…

Ensuring Service Level Objectives (SLOs) in large-scale architectures, such as Distributed Computing Continuum Systems (DCCS), is challenging due to their heterogeneous nature and varying service requirements across different devices and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-22 Alfreds Lapkovskis , Boris Sedlak , Sindri Magnússon , Schahram Dustdar , Praveen Kumar Donta

The Internet of Moving Things (IoMT) requires support for a data life cycle process ranging from sorting, cleaning and monitoring data streams to more complex tasks such as querying, aggregation, and analytics. Current solutions for stream…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-28 Lilian Hernandez , Hung Cao , Monica Wachowicz

With the growing reliance on the ubiquitous availability of IT systems and services, these systems become more global, scaled, and complex to operate. To maintain business viability, IT service providers must put in place reliable and cost…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-08 Anna Levin , Shelly Garion , Elliot K. Kolodner , Dean H. Lorenz , Katherine Barabash , Mike Kugler , Niall McShane

Operating cloud service infrastructures requires high energy efficiency while ensuring a satisfactory service level. Motivated by data centers, we consider a workload routing and server speed control policy applicable to the system…

Performance · Computer Science 2023-03-06 Seung Min Baik , Young Myoung Ko

High-Performance Computing (HPC) systems provide input/output (IO) performance growing relatively slowly compared to peak computational performance and have limited storage capacity. Computational Fluid Dynamics (CFD) applications aiming to…

Performance · Computer Science 2024-07-31 Yi Ju , Adalberto Perez , Stefano Markidis , Philipp Schlatter , Erwin Laure

Achieving high performance in virtualized data centers requires both deploying high throughput storage clusters, i.e. based on Solid State Disks (SSDs), as well as optimally consolidating the workloads across storage nodes. Nowadays, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-29 Zhihao Yao , Ioannis Papapanagiotou , Rean Griffith

Diffusion model deployment has been suffering from high energy consumption and inference latency despite its superior performance in visual generation tasks. Dynamic voltage and frequency scaling (DVFS) offers a promising solution to…

Hardware Architecture · Computer Science 2026-04-13 Jinqi Wen , Tong Xie , Runsheng Wang , Meng Li

Under several emerging application scenarios, such as in smart cities, operational monitoring of large infrastructure, wearable assistance, and Internet of Things, continuous data streams must be processed under very short delays. Several…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-05 Marcos Dias de Assuncao , Alexandre da Silva Veith , Rajkumar Buyya

Increasing popularity of the serverless computing approach has led to the emergence of new cloud infrastructures working in Container-as-a-Service (CaaS) model like AWS Fargate, Google Cloud Run, or Azure Container Instances. They introduce…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-23 Krzysztof Burkat , Maciej Pawlik , Bartosz Balis , Maciej Malawski , Karan Vahi , Mats Rynge , Rafael Ferreira da Silva , Ewa Deelman

For large-scale scientific simulations, it is expensive to store raw simulation results to perform post-analysis. To minimize expensive I/O, "in-situ" analysis is often used, where analysis applications are tightly coupled with scientific…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-01 Feng Li , Dali Wang , Feng Yan , Fengguang Song

With developments of real-time applications into data centers, the need for alternatives of the standard TCP protocol has been prime demand in several applications of data centers. The several alternatives of TCP protocol has been proposed…

Networking and Internet Architecture · Computer Science 2013-11-13 Fatma Almajadub , Eman Abdelfattah , Abdul Razaque

Exascale I/O initiatives will require new and fully integrated I/O models which are capable of providing straightforward functionality, fault tolerance and efficiency. One solution is the Distributed Asynchronous Object Storage (DAOS)…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-04 M. Scot Breitenfeld , Neil Fortner , Jordan Henderson , Jerome Soumagne , Mohamad Chaarawi , Johann Lombardi , Quincey Koziol

Many scientific applications are I/O intensive and generate or access large data sets, spanning hundreds or thousands of "files." Management, storage, efficient access, and analysis of this data present an extremely challenging task. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Jaechun No , Rajeev Thakur , Dinesh Kaushik , Lori Freitag , Alok Choudhary

Scene flow estimation is the task of describing the 3D motion field between temporally successive point clouds. State-of-the-art methods use strong priors and test-time optimization techniques, but require on the order of tens of seconds to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Kyle Vedder , Neehar Peri , Nathaniel Chodosh , Ishan Khatri , Eric Eaton , Dinesh Jayaraman , Yang Liu , Deva Ramanan , James Hays

Rapid growth of data center networks (DCNs) poses significant challenges for large-scale traffic engineering (TE). Existing acceleration strategies, which rely on commercial solvers or deep learning, face scalability issues and struggle…

Networking and Internet Architecture · Computer Science 2025-12-23 Yingming Mao , Qiaozhu Zhai , Ximeng Liu , Zhen Yao , Xia Zhu , Yuzhou Zhou