English
Related papers

Related papers: Redefining Cost Estimation in Database Systems: Th…

200 papers

The use of deep learning models for forecasting the resource consumption patterns of SQL queries have recently been a popular area of study. With many companies using cloud platforms to power their data lakes for large scale analytic…

Machine Learning · Computer Science 2021-03-24 Johan Kok Zhi Kang , Gaurav , Sien Yi Tan , Feng Cheng , Shixuan Sun , Bingsheng He

Query optimizer is at the heart of the database systems. Cost-based optimizer studied in this paper is adopted in almost all current database systems. A cost-based optimizer introduces a plan enumeration algorithm to find a (sub)plan, and…

Databases · Computer Science 2021-01-06 Hai Lan , Zhifeng Bao , Yuwei Peng

Workflows provide an expressive programming model for fine-grained control of large-scale applications in distributed computing environments. Accurate estimates of complex workflow execution metrics on large-scale machines have several key…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-18 Alok Singh , Mai Nguyen , Shweta Purawat , Daniel Crawl , Ilkay Altintas

Relational query optimisers rely on cost models to choose between different query execution plans. Selectivity estimates are known to be a crucial input to the cost model. In practice, standard selectivity estimation procedures are prone to…

Databases · Computer Science 2020-09-22 Max Halford , Philippe Saint-Pierre , Franck Morvan

The advantages of distributing workloads and utilizing multiple distributed resources are now well established. The type and degree of heterogeneity of distributed resources is increasing, and thus determining how to distribute the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-10 Ming Tai Ha , Matteo Turilli , Andre Merzky , Shantenu Jha

Co-scheduling of jobs in data-centers is a challenging scenario, where jobs can compete for resources yielding to severe slowdowns or failed executions. Efficient job placement on environments where resources are shared requires awareness…

Machine Learning · Computer Science 2020-07-07 David Buchaca Prats , Joan Marcual , Josep Lluís Berral , David Carrera

Many applications require the collection of data on different variables or measurements over many system performance metrics. We term those broadly as measures or variables. Often data collection along each measure incurs a cost, thus it is…

Methodology · Statistics 2021-11-30 Donghui Yan , Zhiwei Qin , Songxiang Gu , Haiping Xu , Ming Shao

External query execution cost modeling using query execution feedback has found its way in various database applications such as admission control and query scheduling. Existing techniques in general fall into two categories, plan-level…

Databases · Computer Science 2020-03-11 Wentao Wu

Deep learning compiler frameworks are gaining ground as a more portable back-end for deep learning applications on increasingly diverse hardware. However, they face the daunting challenge of matching performance offered by hand-tuned…

Machine Learning · Computer Science 2021-02-10 Jaehun Ryu , Hyojin Sung

The execution behavior of a program often depends on external resources, such as program inputs or file contents, and so cannot be run in isolation. Nevertheless, software developers benefit from fast iteration loops where automated tools…

Machine Learning · Computer Science 2022-03-30 David Bieber , Rishab Goel , Daniel Zheng , Hugo Larochelle , Daniel Tarlow

Query optimization, which finds the optimized execution plan for a given query, is a complex planning and decision-making problem within the exponentially growing plan space in database management systems (DBMS). Traditional optimizers…

Databases · Computer Science 2025-02-11 Jie Tan , Kangfei Zhao , Rui Li , Jeffrey Xu Yu , Chengzhi Piao , Hong Cheng , Helen Meng , Deli Zhao , Yu Rong

We consider a framework for structured prediction based on search in the space of complete structured outputs. Given a structured input, an output is produced by running a time-bounded search procedure guided by a learned cost function, and…

Machine Learning · Computer Science 2012-07-03 Janardhan Rao Doppa , Alan Fern , Prasad Tadepalli

Modern real-time systems require accurate characterization of task timing behavior to ensure predictable performance, particularly on complex hardware architectures. Existing methods, such as worst-case execution time analysis, often fail…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Georgiy A. Bondar , Abigail Eisenklam , Yifan Cai , Robert Gifford , Tushar Sial , Linh Thi Xuan Phan , Abhishek Halder

Performance tuning of Database Management Systems(DBMS) is both complex and challenging as it involves identifying and altering several key performance tuning parameters. The quality of tuning and the extent of performance enhancement…

Databases · Computer Science 2010-05-07 S. F. Rodd , U. P. Kulkarni

Query optimizer is a crucial module for database management systems. Existing optimizers exhibit two flawed paradigms: (1) cost-based optimizers use dynamic programming with cost models but face search space explosion and heuristic pruning…

Databases · Computer Science 2025-06-23 Jiazhen Peng , Zheng Qu , Xiaoye Miao , Rong Zhu

We propose a novel approach for generating complex outputs that significantly improves accuracy in text-to-SQL tasks. Our method leverages execution results to select the most semantically consistent query from multiple candidates, enabling…

Computation and Language · Computer Science 2025-04-01 Łukasz Borchmann , Marek Wydmuch

Methods for neural network hyperparameter optimization and meta-modeling are computationally expensive due to the need to train a large number of model configurations. In this paper, we show that standard frequentist regression models can…

Machine Learning · Computer Science 2017-11-09 Bowen Baker , Otkrist Gupta , Ramesh Raskar , Nikhil Naik

To improve decision-making and planning efficiency in back-end centralized redundant supply chains, this paper proposes a decision model integrating deep learning with intelligent particle swarm optimization. A distributed node deployment…

Machine Learning · Computer Science 2025-11-04 Shiman Zhang , Jinghan Zhou , Zhoufan Yu , Ningai Leng

The execution time of programs is a key element in many areas of computer science, mainly those where achieving good performance (e.g., scheduling in cloud computing) or a predictable one (e.g., meeting deadlines in embedded systems) is the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-13 Matheus Henrique Junqueira Saldanha

The query optimizer is a fundamental component of database management systems. Recent studies have shown that learned query optimizers outperform traditional cost-based query optimizers. However, they fail to exploit valuable runtime…

Databases · Computer Science 2026-03-05 Jiahao He , Yutao Cui , Cuiping Li , Jikang Jiang , Yuheng Hou , Hong Chen