English
Related papers

Related papers: Learning to Optimize Join Queries With Deep Reinfo…

200 papers

The exponential growth of data-intensive applications has placed unprecedented demands on modern storage systems, necessitating dynamic and efficient optimization strategies. Traditional heuristics employed for storage performance…

Operating Systems · Computer Science 2025-08-25 Chiyu Cheng , Chang Zhou , Yang Zhao

A recent line of works apply machine learning techniques to assist or rebuild cost-based query optimizers in DBMS. While exhibiting superiority in some benchmarks, their deficiencies, e.g., unstable performance, high training cost, and slow…

Databases · Computer Science 2023-02-21 Rong Zhu , Wei Chen , Bolin Ding , Xingguang Chen , Andreas Pfadler , Ziniu Wu , Jingren Zhou

A key challenge in satisficing planning is to use multiple heuristics within one heuristic search. An aggregation of multiple heuristic estimates, for example by taking the maximum, has the disadvantage that bad estimates of a single…

Artificial Intelligence · Computer Science 2021-04-13 David Speck , André Biedenkapp , Frank Hutter , Robert Mattmüller , Marius Lindauer

Query optimizers in RDBMSs search for execution plans expected to be optimal for given queries. They use parameter estimates, often inaccurate, and make assumptions that may not hold in practice. Consequently, they may select plans that are…

Databases · Computer Science 2025-05-27 Amin Kamali , Verena Kantere , Calisto Zuzarte , Vincent Corvinelli

Training a deep neural network to maximize a target objective has become the standard recipe for successful machine learning over the last decade. These networks can be optimized with supervised learning, if the target objective is…

Machine Learning · Computer Science 2025-05-12 Bernhard Jaeger , Andreas Geiger

Deep reinforcement learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their application on…

Machine Learning · Computer Science 2021-09-29 Hamed Khorasgani , Haiyan Wang , Chetan Gupta , Susumu Serita

With the rapid development of deep learning, deep reinforcement learning (DRL) began to appear in the field of resource scheduling in recent years. Based on the previous research on DRL in the literature, we introduce online resource…

Artificial Intelligence · Computer Science 2018-06-22 Yufei Ye , Xiaoqin Ren , Jin Wang , Lingxiao Xu , Wenxia Guo , Wenqiang Huang , Wenhong Tian

Domain-Independent Dynamic Programming (DIDP) is a state-space search paradigm based on dynamic programming for combinatorial optimization. In its current implementation, DIDP guides the search using user-defined dual bounds. Reinforcement…

Artificial Intelligence · Computer Science 2025-05-15 Minori Narita , Ryo Kuroiwa , J. Christopher Beck

Recent work investigated the use of Reinforcement Learning (RL) for the synthesis of heuristic guidance to improve the performance of temporal planners when a domain is fixed and a set of training problems (not plans) is given. The idea is…

Artificial Intelligence · Computer Science 2025-05-20 Irene Brugnara , Alessandro Valentini , Andrea Micheli

Recent advances in reinforcement learning (RL) have led to a growing interest in applying RL to classical planning domains or applying classical planning methods to some complex RL domains. However, the long-horizon goal-based problems…

Artificial Intelligence · Computer Science 2022-03-08 Clement Gehring , Masataro Asai , Rohan Chitnis , Tom Silver , Leslie Pack Kaelbling , Shirin Sohrabi , Michael Katz

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

Order Picker Routing is a critical issue in Warehouse Operations Management. Due to the complexity of the problem and the need for quick solutions, suboptimal algorithms are frequently employed in practice. However, Reinforcement Learning…

Machine Learning · Computer Science 2024-02-07 George Dunn , Hadi Charkhgard , Ali Eshragh , Sasan Mahmoudinazlou , Elizabeth Stojanovski

Reinforcement Learning (RL) has emerged as a powerful tool for neural combinatorial optimization, enabling models to learn heuristics that solve complex problems without requiring expert knowledge. Despite significant progress, existing RL…

Machine Learning · Computer Science 2025-05-14 Mingjun Pan , Guanquan Lin , You-Wei Luo , Bin Zhu , Zhien Dai , Lijun Sun , Chun Yuan

Existing exploration strategies in reinforcement learning (RL) often either ignore the history or feedback of search, or are complicated to implement. There is also a very limited literature showing their effectiveness over diverse domains.…

Artificial Intelligence · Computer Science 2020-10-01 Xing Wang , Alexander Vinel

We study ranked enumeration of join-query results according to very general orders defined by selective dioids. Our main contribution is a framework for ranked enumeration over a class of dynamic programming problems that generalizes…

Databases · Computer Science 2020-09-15 Nikolaos Tziavelis , Deepak Ajwani , Wolfgang Gatterbauer , Mirek Riedewald , Xiaofeng Yang

In this paper, we propose a Deep Reinforcement Learning (RL) framework for task arrangement, which is a critical problem for the success of crowdsourcing platforms. Previous works conduct the personalized recommendation of tasks to workers…

Machine Learning · Computer Science 2019-11-05 Caihua Shan , Nikos Mamoulis , Reynold Cheng , Guoliang Li , Xiang Li , Yuqiu Qian

This study focuses on the development of a simulation-driven reinforcement learning (RL) framework for optimizing routing decisions in complex queueing network systems, with a particular emphasis on manufacturing and communication…

Artificial Intelligence · Computer Science 2025-07-28 Fatima Al-Ani , Molly Wang , Jevon Charles , Aaron Ong , Joshua Forday , Vinayak Modi

Join order selection (JOS) is the problem of ordering join operations to minimize total query execution cost and it is the core NP-hard combinatorial optimization problem of query optimization. In this paper, we present JoinGym, a…

Machine Learning · Computer Science 2023-10-19 Kaiwen Wang , Junxiong Wang , Yueying Li , Nathan Kallus , Immanuel Trummer , Wen Sun

In this work, we consider the problem of network parameter optimization for rate maximization. We frame this as a joint optimization problem of power control, beam forming, and interference cancellation. We consider the setting where…

Machine Learning · Computer Science 2023-11-14 Heasung Kim , Sravan Kumar Ankireddy

Automatic summarization of legal texts is an important and still a challenging task since legal documents are often long and complicated with unusual structures and styles. Recent advances of deep models trained end-to-end with…

Computation and Language · Computer Science 2022-04-14 Duy-Hung Nguyen , Bao-Sinh Nguyen , Nguyen Viet Dung Nghiem , Dung Tien Le , Mim Amina Khatun , Minh-Tien Nguyen , Hung Le