English
Related papers

Related papers: Global Optimization of Data Pipelines in Heterogen…

200 papers

The LOFAR radio telescope creates Petabytes of data per year. This data is important for many scientific projects. The data needs to be efficiently processed within the timespan of these projects in order to maximize the scientific impact.…

Instrumentation and Methods for Astrophysics · Physics 2018-09-03 A. P. Mechev , J. B. R Oonk , T. Shimwell , A. Plaat , H. T. Intema , H. J. A. Röttgering

Resource-intensive computations are a major factor that limits the effectiveness of automated machine learning solutions. In the paper, we propose a modular approach that can be used to increase the quality of evolutionary optimization for…

Machine Learning · Computer Science 2023-01-13 Nikolay O. Nikitin , Sergey Teryoshkin , Valerii Pokrovskii , Sergey Pakulin , Denis Nasonov

Edge applications generate a large influx of sensor data on massive scales, and these massive data streams must be processed shortly to derive actionable intelligence. However, traditional data processing systems are not well-suited for…

Databases · Computer Science 2025-07-31 Cheng-Wei Ching , Xin Chen , Chaeeun Kim , Tongze Wang , Dong Chen , Dilma Da Silva , Liting Hu

Efficient implementations of parallel applications on heterogeneous hybrid architectures require a careful balance between computations and communications with accelerator devices. Even if most of the communication time can be overlapped by…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-09-22 Raphaël Bleuse , Thierry Gautier , João V. F. Lima , Grégory Mounié , Denis Trystram

Parallel real-time embedded applications can be modelled as directed acyclic graphs (DAGs) whose nodes model subtasks and whose edges model precedence constraints among subtasks. Efficiently scheduling such parallel tasks can be challenging…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-24 Shardul Lendve , Konstantinos Bletsas , Pedro F. Souto

Graph stream summarization refers to the process of processing a continuous stream of edges that form a rapidly evolving graph. The primary challenges in handling graph streams include the impracticality of fully storing the ever-growing…

Databases · Computer Science 2024-12-23 Xuan Zhao , Xike Xie , Christian S. Jensen

Dataflow scheduling decisions are of vital importance to neural network (NN) accelerators. Recent scalable NN accelerators support a rich set of advanced dataflow techniques. The problems of comprehensively representing and quickly finding…

Hardware Architecture · Computer Science 2023-06-29 Zhiyao Li , Mingyu Gao

Workflow decision making is critical to performing many practical workflow applications. Scheduling in edge-cloud environments can address the high complexity problem of workflow applications, while decreasing the data transmission delay…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-31 Bing Lin , Chaowei Lin , Xing Chen

Traditional end-to-end contextual robust optimization models are trained for specific contextual data, requiring complete retraining whenever new contextual information arrives. This limitation hampers their use in online decision-making…

Optimization and Control · Mathematics 2025-10-20 Carlos Gamboa , Alexandre Street , Davi Valladão , Bernardo Pagnocelli

Containers are standalone, self-contained units that package software and its dependencies together. They offer lightweight performance isolation, fast and flexible deployment, and fine-grained resource sharing. They have gained popularity…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-04 Maria A. Rodriguez , Rajkumar Buyya

Modern multi-access 5G+ networks provide mobile terminals with additional capacity, improving network stability and performance. However, in highly mobile environments such as vehicular networks, supporting multi-access connectivity remains…

Information Theory · Computer Science 2026-03-24 Gregorio Maglione , Veselin Rakocevic , Markus Amend , Touraj Soleymani

Parallel real-time systems (e.g., autonomous driving systems) often contain functionalities with complex dependencies and execution uncertainties, leading to significant timing variability which can be represented as a probabilistic…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Yiyang Gao , Shuai Zhao , Boyang Li , Xinwei Fang , Zhiyang Lin , Zhe Jiang , Nan Guan

When orchestrating highly distributed and data-intensive Web service workflows the geographical placement of the orchestration engine can greatly affect the overall performance of a workflow. We present CloudForecast: a Web service…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-10-23 Michael Luckeneder , Adam Barker

A communication network modelled by a directed acyclic graph (DAG) is considered, over which a source wishes to send a specified number of bits to a destination node. Each node of the DAG is powered by a separate renewable energy source,…

Information Theory · Computer Science 2019-08-28 Rahul Vaze , Sibi Raj B Pillai

Job schedulers are a key component of scalable computing infrastructures. They orchestrate all of the work executed on the computing infrastructure and directly impact the effectiveness of the system. Recently, job workloads have…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-06 Albert Reuther , Chansup Byun , William Arcand , David Bestor , Bill Bergeron , Matthew Hubbell , Michael Jones , Peter Michaleas , Andrew Prout , Antonio Rosa , Jeremy Kepner

A growing number of critical workflow applications leverage a streamlined edge-hub-cloud architecture, which diverges from the conventional edge computing paradigm. An edge device, in collaboration with a hub device and a cloud server,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-23 Andreas Kouloumpris , Georgios L. Stavrinides , Maria K. Michael , Theocharis Theocharides

In the era of Internet of Things, there is an increasing demand for networked computing to support the requirements of the time-constrained, compute-intensive distributed applications such as multi-camera video processing and data fusion…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-24 Pradipta Ghosh , Quynh Nguyen , Pranav K Sakulkar , Aleksandra Knezevic , Jason A. Tran , Jiatong Wang , Zhifeng Lin , Bhaskar Krishnamachari , Murali Annavaram , Salman Avestimehr

We study the problem of optimizing data storage and access costs on the cloud while ensuring that the desired performance or latency is unaffected. We first propose an optimizer that optimizes the data placement tier (on the cloud) and the…

Vehicular cloud (VC) platforms integrate heterogeneous and distributed resources of moving vehicles to offer timely and cost-effective computing services. However, the dynamic nature of VCs (i.e., limited contact duration among vehicles),…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-29 Zhang Liu , Minghui Liwang , Seyyedali Hosseinalipour , Huaiyu Dai , Zhibin Gao , Lianfen Huang

Cloud computing has revolutionized the way organizations manage their IT infrastructure, but it has also introduced new challenges, such as managing cloud costs. The rapid adoption of artificial intelligence (AI) and machine learning (ML)…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-28 Saurabh Deochake