English
Related papers

Related papers: Opening the Black Boxes in Data Flow Optimization

200 papers

Orchestrating centralised service-oriented workflows presents significant scalability challenges that include: the consumption of network bandwidth, degradation of performance, and single points of failure. This paper presents a high-level…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-11 Ward Jaradat , Alan Dearle , Adam Barker

Operations research practitioners frequently want to model complicated functions that are are difficult to encode in their underlying optimisation framework. A common approach is to solve an approximate model, and to use a simulation to…

Optimization and Control · Mathematics 2022-07-06 Michael Forbes , Mitchell Harris , Marijn Jansen , Femke van der Schoot , Thomas Taimre

Graph simulation (using graph schemata or data guides) has been successfully proposed as a technique for adding structure to semistructured data. Design patterns for description (such as meta-classes and homomorphisms between schema…

Databases · Computer Science 2007-05-23 Christoph Koch

In this paper, we make the key delineation on the roles of resolution and statistical uncertainty in hierarchical bandits-based black-box optimization algorithms, guiding a more general analysis and a more efficient algorithm design. We…

Machine Learning · Statistics 2023-06-01 Wenjie Li , Chi-Hua Wang , Guang Cheng , Qifan Song

Classical algorithms for query optimization presuppose the absence of inconsistencies or uncertainties in the database and exploit only valid semantic knowledge provided, e.g., by integrity constraints. Data inconsistency or uncertainty,…

Databases · Computer Science 2014-05-05 Federica Panella

Various works have utilized deep learning to address the query optimization problem in database system. They either learn to construct plans from scratch in a bottom-up manner or steer the plan generation behavior of traditional optimizer…

Databases · Computer Science 2024-08-15 Kai Zhong , Luming Sun , Tao Ji , Cuiping Li , Hong Chen

Traditional query optimizers are designed to be fast and stateless: each query is quickly optimized using approximate statistics, sent off to the execution engine, and promptly forgotten. Recent work on learned query optimization have shown…

Databases · Computer Science 2023-07-12 Ryan Marcus

The problem of optimal allocation of monitoring resources for tracking transactions progressing through a distributed system, modeled as a queueing network, is considered. Two forms of monitoring information are considered, viz., locally…

Performance · Computer Science 2011-01-13 Animashree Anandkumar , Ting He , Chatschik Bisdikian , Dakshi Agrawal

We introduce ontology-mediated planning, in which planning problems are combined with an ontology. Our formalism differs from existing ones in that we focus on a strong separation of the formalisms for describing planning problems and…

Artificial Intelligence · Computer Science 2024-08-15 Tobias John , Patrick Koopmann

Machine learning algorithms use error function minimization to fit a large set of parameters in a preexisting model. However, error minimization eventually leads to a memorization of the training dataset, losing the ability to generalize to…

Machine Learning · Computer Science 2018-03-16 Fernando Martin-Maroto , Gonzalo G. de Polavieja

Serverless computing that runs functions with auto-scaling is a popular task execution pattern in the cloud-native era. By connecting serverless functions into workflows, tenants can achieve complex functionality. Prior researches adopt the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-01 Zijun Li , Chuhao Xu , Quan Chen , Jieru Zhao , Chen Chen , Minyi Guo

The explosion of Big Data was followed by the proliferation of numerous complex parallel software stacks whose aim is to tackle the challenges of data deluge. A drawback of a such multi-layered hierarchical deployment is the inability to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-01 Colin Barrett , Christos Kotselidis , Mikel Luján

Cooperative database systems support a database user by searching for answers that are closely related to his query and hence are informative answers. Common operators to relax the user query are Dropping Condition, Anti-Instantiation and…

Databases · Computer Science 2012-10-24 Lena Wiese

Networking data analytics is increasingly used for enhanced network visibility and controllability. We draw the similarities between the Software Defined Networking (SDN) architecture and the MapReduce programming model. Inspired by the…

Networking and Internet Architecture · Computer Science 2016-09-13 Haoyu Song , Jun Gong , Hongfei Chen

As modern data pipelines continue to collect, produce, and store a variety of data formats, extracting and combining value from traditional and context-rich sources such as strings, text, video, audio, and logs becomes a manual process…

Databases · Computer Science 2023-12-05 Viktor Sanca , Anastasia Ailamaki

In this work, which is done in the context of a (moded) logic programming language, we devise a data-flow analysis dedicated to computing what we call argument profiles. Such a profile essentially describes, for each argument of a…

Logic in Computer Science · Computer Science 2023-08-31 Gonzague Yernaux , Wim Vanhoof

The selection of the most appropriate algorithm to solve a given problem instance, known as algorithm selection, is driven by the potential to capitalize on the complementary performance of different algorithms across sets of problem…

Machine Learning · Computer Science 2024-06-12 Gjorgjina Cenikj , Ana Nikolikj , Gašper Petelin , Niki van Stein , Carola Doerr , Tome Eftimov

With dramatic improvements in optimization software, the solution of large-scale problems that seemed intractable decades ago are now a routine task. This puts even more real-world applications into the reach of optimizers. At the same…

Optimization and Control · Mathematics 2023-03-07 Marc Goerigk , Michael Hartisch

Obtaining an explanation for an SQL query result can enrich the analysis experience, reveal data errors, and provide deeper insight into the data. Inference query explanation seeks to explain unexpected aggregate query results on inference…

Databases · Computer Science 2021-06-22 Brandon Lockhart , Jinglin Peng , Weiyuan Wu , Jiannan Wang , Eugene Wu

Interprocedural flow analysis can be used to eliminate otherwise unnecessary heap allocated objects (unboxing), and in previous work we have shown how to do so while maintaining correctness with respect to the garbage collector. In this…

Programming Languages · Computer Science 2015-03-20 Neal Glew , Leaf Petersen