English
Related papers

Related papers: Lero: A Learning-to-Rank Query Optimizer

200 papers

The query optimizer is a fundamental component of database management systems. Recent studies have shown that learned query optimizers outperform traditional cost-based query optimizers. However, they fail to exploit valuable runtime…

Databases · Computer Science 2026-03-05 Jiahao He , Yutao Cui , Cuiping Li , Jikang Jiang , Yuheng Hou , Hong Chen

The current boom of learned query optimizers (LQO) can be explained not only by the general continuous improvement of deep learning (DL) methods but also by the straightforward formulation of a query optimization problem (QOP) as a machine…

Databases · Computer Science 2024-02-29 Claude Lehmann , Pavel Sulimov , Kurt Stockinger

Query optimization is a critical task in database systems, focused on determining the most efficient way to execute a query from an enormous set of possible strategies. Traditional approaches rely on heuristic search methods and cost…

Databases · Computer Science 2025-03-11 Zhiming Yao , Haoyang Li , Jing Zhang , Cuiping Li , Hong Chen

With the growing popularity, the number of data sources and the amount of data has been growing very fast in recent years. The distribution of operational data on disperse data sources impose a challenge on processing user queries. In such…

Databases · Computer Science 2016-02-16 Vikash Mishra , Vikram Singh

Analytics database workloads often contain queries that are executed repeatedly. Existing optimization techniques generally prioritize keeping optimization cost low, normally well below the time it takes to execute a single instance of a…

Databases · Computer Science 2025-02-11 Jeffrey Tao , Natalie Maus , Haydn Jones , Yimeng Zeng , Jacob R. Gardner , Ryan Marcus

Accurate query runtime prediction is a critical component of effective query optimization in modern database systems. Traditional cost models, such as those used in PostgreSQL, rely on static heuristics that often fail to reflect actual…

Databases · Computer Science 2025-10-08 Utsav Pathak , Amit Mankodi

Modern deep learning systems require huge data sets to achieve impressive performance, but there is little guidance on how much or what kind of data to collect. Over-collecting data incurs unnecessary present costs, while under-collecting…

Machine Learning · Computer Science 2022-10-05 Rafid Mahmood , James Lucas , Jose M. Alvarez , Sanja Fidler , Marc T. Law

Recent deployments of learned query optimizers use expensive neural networks and ad-hoc search policies. To address these issues, we introduce \textsc{LimeQO}, a framework for offline query optimization leveraging low-rank learning to…

Databases · Computer Science 2025-04-10 Zixuan Yi , Yao Tian , Zachary G. Ives , Ryan Marcus

Subgraph query is a critical task in graph analysis with a wide range of applications across various domains. Most existing methods rely on heuristic vertex matching orderings, which may significantly degrade enumeration performance for…

Databases · Computer Science 2025-09-30 Linglin Yang , Lei Zou , Chunshan Zhao

Query optimizer is a crucial module for database management systems. Existing optimizers exhibit two flawed paradigms: (1) cost-based optimizers use dynamic programming with cost models but face search space explosion and heuristic pruning…

Databases · Computer Science 2025-06-23 Jiazhen Peng , Zheng Qu , Xiaoye Miao , Rong Zhu

Large Language Models (LLMs) demonstrate robust capabilities across various fields, leading to a paradigm shift in LLM-enhanced Recommender System (RS). Research to date focuses on point-wise and pair-wise recommendation paradigms, which…

Information Retrieval · Computer Science 2024-09-30 Wen-Shuo Chao , Zhi Zheng , Hengshu Zhu , Hao Liu

Many automated machine learning methods, such as those for hyperparameter and neural architecture optimization, are computationally expensive because they involve training many different model configurations. In this work, we present a new…

Machine Learning · Computer Science 2020-06-08 Martin Wistuba , Tejaswini Pedapati

In the last years decision-focused learning framework, also known as predict-and-optimize, have received increasing attention. In this setting, the predictions of a machine learning model are used as estimated cost coefficients in the…

Machine Learning · Computer Science 2022-06-20 Jayanta Mandi , Víctor Bucarey , Maxime Mulamba , Tias Guns

Database management systems (DBMSs) carefully optimize complex multi-join queries to avoid expensive disk I/O. As servers today feature tens or hundreds of gigabytes of RAM, a significant fraction of many analytic databases becomes…

Databases · Computer Science 2015-07-22 Feilong Liu , Spyros Blanas

Query optimization is a fundamental task in database systems that is crucial to providing high performance. To evaluate learned and traditional optimizer's performance, several benchmarks, such as the widely used JOB benchmark, are used.…

Databases · Computer Science 2025-07-11 Johannes Wehrstein , Timo Eckmann , Roman Heinrich , Carsten Binnig

Query optimizers are crucial for the performance of database systems. Recently, many learned query optimizers (LQOs) have demonstrated significant performance improvements over traditional optimizers. However, most of them operate under a…

Databases · Computer Science 2025-07-02 Qihan Zhang , Shaolin Xie , Ibrahim Sabek

Query rewrite, which aims to generate more efficient queries by altering a SQL query's structure without changing the query result, has been an important research problem. In order to maintain equivalence between the rewritten query and the…

Databases · Computer Science 2024-04-22 Zhaodonghui Li , Haitao Yuan , Huiming Wang , Gao Cong , Lidong Bing

Query processing over big data is ubiquitous in modern clouds, where the system takes care of picking both the physical query execution plans and the resources needed to run those plans, using a cost-based query optimizer. A good cost…

Databases · Computer Science 2020-03-02 Tarique Siddiqui , Alekh Jindal , Shi Qiao , Hiren Patel , Wangchao le

Recent work in database query optimization has used complex machine learning strategies, such as customized reinforcement learning schemes. Surprisingly, we show that LLM embeddings of query text contain useful semantic information for…

Databases · Computer Science 2024-11-06 Peter Akioyamen , Zixuan Yi , Ryan Marcus

We investigate an optimization problem in a queueing system where the service provider selects the optimal service fee p and service capacity \mu to maximize the cumulative expected profit (the service revenue minus the capacity cost and…

Optimization and Control · Mathematics 2025-08-12 Xinyun Chen , Guiyu Hong , Yunan Liu