English
Related papers

Related papers: Learned Query Optimizer in Alibaba MaxCompute: Cha…

200 papers

Query optimization is a critical task in database systems, focused on determining the most efficient way to execute a query from an enormous set of possible strategies. Traditional approaches rely on heuristic search methods and cost…

Databases · Computer Science 2025-03-11 Zhiming Yao , Haoyang Li , Jing Zhang , Cuiping Li , Hong Chen

Database systems encompass several performance-critical optimization tasks, such as join ordering and index tuning. As data volumes grow and workloads become more complex, these problems have become exponentially harder to solve…

Databases · Computer Science 2026-01-21 Hanwen Liu , Ibrahim Sabek

As AI moves beyond text, large language models (LLMs) increasingly power vision, audio, and document understanding; however, their high inference costs hinder real-time, scalable deployment. Conversely, smaller open-source models offer cost…

Computation and Language · Computer Science 2025-11-11 Mayank Saini , Arit Kumar Bishwas

Learned optimizers are a crucial component of meta-learning. Recent advancements in scalable learned optimizers have demonstrated their superior performance over hand-designed optimizers in various tasks. However, certain characteristics of…

Machine Learning · Computer Science 2023-06-01 Gaole Dai , Wei Wu , Ziyu Wang , Jie Fu , Shanghang Zhang , Tiejun Huang

Large language models (LLMs) deliver superior performance but require substantial computational resources and operate with relatively low efficiency, while smaller models can efficiently handle simpler tasks with fewer resources. LLM…

Databases · Computer Science 2025-12-01 Kai Mei , Wujiang Xu , Minghao Guo , Shuhang Lin , Yongfeng Zhang

Supply chain operations traditionally involve a variety of complex decision making problems. Over the last few decades, supply chains greatly benefited from advances in computation, which allowed the transition from manual processing to…

Artificial Intelligence · Computer Science 2023-07-14 Beibin Li , Konstantina Mellou , Bo Zhang , Jeevan Pathuri , Ishai Menache

Non-Uniform Memory Access (NUMA) architecture imposes numerous performance challenges to today's cloud workloads. Due to the complexity and the massive scale of modern warehouse-scale computers (WSCs), a lot of efforts need to be done to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-05 Yueji Liu , Jun Jin , Wenhui Shu , Shiyong Li , Yongzhan He

LSM-tree-based data stores are widely used in industry due to their exceptional performance. However, as data volumes grow, efficiently querying large-scale databases becomes increasingly challenging. To address this, recent studies…

Databases · Computer Science 2025-06-11 Junfeng Liu , Jiarui Ye , Mengshi Chen , Meng Li , Siqiang Luo

The quantum approximate optimisation algorithm (QAOA) is at the core of many scenarios that aim to combine the power of quantum computers and classical high-performance computing appliances for combinatorial optimisation. Several obstacles…

Quantum Physics · Physics 2026-02-26 Simon Thelen , Hila Safi , Wolfgang Mauerer

Optimization modeling underlies critical decision-making across industries, yet remains difficult to automate: natural-language problem descriptions must be translated into precise mathematical formulations and executable solver code.…

Complex queries for massive data analysis jobs have become increasingly commonplace. Many such queries contain com- mon subexpressions, either within a single query or among multiple queries submitted as a batch. Conventional query…

Databases · Computer Science 2017-01-20 Tarun Kathuria , S. Sudarshan

In modern distributed systems, efficient resource allocation is a vital aspect to maintain scalability, reduce operational costs, and ensure fast execution even across heterogeneous workloads. Predictive models for resource usage are…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-21 Jonathan Bader , Edgar Blumenthal , Marten Eckardt , Justus Krebs , Joel Witzke , Xemena Wysokinska , Haci Ismail Aslan , Odej Kao

Increasing demand for Large Language Models (LLMs) services imposes substantial deployment and computation costs on providers. LLM routing offers a cost-efficient solution by directing queries to the optimal LLM based on model and query…

Databases · Computer Science 2025-12-16 Fangzhou Wu , Sandeep Silwal

Many real-world scientific and industrial applications require the optimization of expensive black-box functions. Bayesian Optimization (BO) provides an effective framework for such problems. However, traditional BO methods are prone to get…

Artificial Intelligence · Computer Science 2025-09-29 Zhuo Yang , Daolang Wang , Lingli Ge , Beilun Wang , Tianfan Fu , Yuqiang Li

While Large Language Models (LLMs) achieve near-human performance on standard benchmarks, their capabilities often fail to generalize to complex, real-world problems. To bridge this gap, we introduce DeepQuestion, a scalable, automated…

Computation and Language · Computer Science 2026-03-02 Ali Khoramfar , Ali Ramezani , Mohammad Mahdi Mohajeri , Mohammad Javad Dousti , Majid Nili Ahmadabadi , Heshaam Faili

Query optimization is essential for efficient SQL query execution in DBMS, and remains attractive over time due to the growth of data volumes and advances in hardware. Existing traditional optimizers struggle with the cumbersome hand-tuning…

Databases · Computer Science 2025-07-08 Suchen Liu , Jun Gao , Yinjun Han , Yang Lin

Various works have utilized deep learning to address the query optimization problem in database system. They either learn to construct plans from scratch in a bottom-up manner or steer the plan generation behavior of traditional optimizer…

Databases · Computer Science 2024-08-15 Kai Zhong , Luming Sun , Tao Ji , Cuiping Li , Hong Chen

Distributed optimization algorithms are widely used in many industrial machine learning applications. However choosing the appropriate algorithm and cluster size is often difficult for users as the performance and convergence rate of…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-21 Xinghao Pan , Shivaram Venkataraman , Zizheng Tai , Joseph Gonzalez

The proliferation of massive datasets combined with the development of sophisticated analytical techniques have enabled a wide variety of novel applications such as improved product recommendations, automatic image tagging, and improved…

Databases · Computer Science 2015-03-10 Evan R. Sparks , Ameet Talwalkar , Michael J. Franklin , Michael I. Jordan , Tim Kraska

Enterprise LLM deployment faces a critical scalability challenge: organizations must optimize models systematically to scale AI initiatives within constrained compute budgets, yet the specialized expertise required for manual optimization…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-29 Nicholas Santavas , Kareem Eissa , Patrycja Cieplicka , Piotr Florek , Matteo Nulli , Stefan Vasilev , Seyyed Hadi Hashemi , Antonios Gasteratos , Shahram Khadivi