English
Related papers

Related papers: Automated Planning for Optimal Data Pipeline Insta…

200 papers

Operating a distributed data stream processing workload efficiently at scale is hard. The operator of the workload must parallelize and lay out tasks of the workload with resources that match the requirement of target data rate. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-27 Manu Bansal , Eyal Cidon , Arjun Balasingam , Aditya Gudipati , Christos Kozyrakis , Sachin Katti

As the demand for computational power grows, optimizing code through compilers becomes increasingly crucial. In this context, we focus on fully automatic code optimization techniques that automate the process of selecting and applying code…

Programming Languages · Computer Science 2025-11-11 Yacine Hakimi , Riyadh Baghdadi

Rapid progress in deep learning is leading to a diverse set of quickly changing models, with a dramatically growing demand for compute. However, as frameworks specialize performance optimization to patterns in popular networks, they…

Machine Learning · Computer Science 2022-08-31 Oliver Rausch , Tal Ben-Nun , Nikoli Dryden , Andrei Ivanov , Shigang Li , Torsten Hoefler

The overall performance of a distributed system is highly dependent on the communication efficiency of the system. Although network resources (links, bandwidth) are becoming increasingly more available, the communication performance of data…

Data Structures and Algorithms · Computer Science 2009-06-02 Mugurel Ionut Andreica , Eliana-Dina Tirsa , Nicolae Tapus , Florin Pop , Ciprian Mihai Dobre

Consider a device that is connected to an edge processor via a communication channel. The device holds local data that is to be offloaded to the edge processor so as to train a machine learning model, e.g., for regression or classification.…

Machine Learning · Computer Science 2019-06-13 Nicolas Skatchkovsky , Osvaldo Simeone

Modern distributed data processing systems struggle to balance performance, maintainability, and developer productivity when integrating machine learning at scale. These challenges intensify in large collaborative environments due to high…

While modern parallel computing systems offer high performance, utilizing these powerful computing resources to the highest possible extent demands advanced knowledge of various hardware architectures and parallel programming models.…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-03 Suejb Memeti , Sabri Pllana , Alecio Binotto , Joanna Kolodziej , Ivona Brandic

The pipeline optimization problem in machine learning requires simultaneous optimization of pipeline structures and parameter adaptation of their elements. Having an elegant way to express these structures can help lessen the complexity in…

Machine Learning · Computer Science 2021-07-15 Paulito P. Palmes , Akihiro Kishimoto , Radu Marinescu , Parikshit Ram , Elizabeth Daly

Much of the alignment tuning literature is organized around optimization objectives, while the construction of alignment data is often treated implicitly. In this survey, we adopt a data centric perspective and reframe alignment tuning as a…

Computation and Language · Computer Science 2026-05-27 Hwanjun Song

In business processes, activity batching refers to packing multiple activity instances for joint execution. Batching allows managers to trade off cost and processing effort against waiting time. Larger and less frequent batches may lower…

Artificial Intelligence · Computer Science 2025-07-22 Orlenys López-Pintado , Jannis Rosenbaum , Marlon Dumas

Obtaining optimal data transfer performance is of utmost importance to today's data-intensive distributed applications and wide-area data replication services. Doing so necessitates effectively utilizing available network bandwidth and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-21 Engin Arslan , Tevfik Kosar

MapReduce, the popular programming paradigm for large-scale data processing, has traditionally been deployed over tightly-coupled clusters where the data is already locally available. The assumption that the data and compute resources are…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-31 Benjamin Heintz , Abhishek Chandra , Ramesh K. Sitaraman

Network integration studies try to assess the impact of future developments, such as the increase of Renewable Energy Sources or the introduction of Smart Grid Technologies, on large-scale network areas. Goals can be to support strategic…

Computational Engineering, Finance, and Science · Computer Science 2018-02-19 Alexander Scheidler , Leon Thurner , Martin Braun

Modern communication networks are increasingly equipped with in-network computational capabilities and services. Routing in such networks is significantly more complicated than the traditional routing. A legitimate route for a flow not only…

Networking and Internet Architecture · Computer Science 2023-06-07 Lifan Mei , Jinrui Gou , Jingrui Yang , Yujin Cai , Yong Liu

Automated planning remains one of the most general paradigms in Artificial Intelligence, providing means of solving problems coming from a wide variety of domains. One of the key factors restricting the applicability of planning is its…

Artificial Intelligence · Computer Science 2017-07-24 Pawel Gomoluch , Dalal Alrajeh , Alessandra Russo , Antonio Bucchiarone

Traditional Data+AI systems utilize data-driven techniques to optimize performance, but they rely heavily on human experts to orchestrate system pipelines, enabling them to adapt to changes in data, queries, tasks, and environments. For…

Databases · Computer Science 2025-07-03 Zhaoyan Sun , Jiayi Wang , Xinyang Zhao , Jiachi Wang , Guoliang Li

Corrective Transmission Switching can be used by the grid operator to relieve line overloading and voltage violations, improve system reliability, and reduce system losses. Power grid optimization by means of line switching is typically…

Systems and Control · Computer Science 2018-03-19 Shuai Wang , John Baillieul

State-space search with explicit abstraction heuristics is at the state of the art of cost-optimal planning. These heuristics are inherently limited, nonetheless, because the size of the abstract space must be bounded by some, even if a…

Artificial Intelligence · Computer Science 2014-01-17 Michael Katz , Carmel Domshlak

The ubiquitous expansion and transformation of the energy supply system involves large-scale power infrastructure construction projects. In the view of investments of more than a million dollars per kilometre, planning authorities aim to…

Optimization and Control · Mathematics 2021-02-02 Nina Wiedemann , David Adjiashvili

Predictive motion planning is the key to achieve energy-efficient driving, which is one of the main benefits of automated driving. Researchers have been studying the planning of velocity trajectories, a simpler form of motion planning, for…

Optimization and Control · Mathematics 2019-02-22 Zlatan Ajanovic , Michael Stolz , Martin Horn