English
Related papers

Related papers: Cuttlefish: A Lightweight Primitive for Adaptive Q…

200 papers

Optimizing the parallel training of large models requires exploring intra-operator parallelism plans for a computation graph that typically contains tens of thousands of primitive operators. While the optimization of parallel data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-08 Weifang Hu , Xuanhua Shi , Yunkai Zhang , Chang Wu , Xuan Peng , Jiaqi Zhai , Hai Jin , Xuehai Qian , Jingling Xue , Yongluan Zhou

Probabilistic inference over large data sets is a challenging data management problem since exact inference is generally #P-hard and is most often solved approximately with sampling-based methods today. This paper proposes an alternative…

Databases · Computer Science 2016-06-15 Wolfgang Gatterbauer , Dan Suciu

Retrieval-Augmented Generation (RAG) pipelines are central to applying large language models (LLMs) to proprietary or dynamic data. However, building effective RAG flows is complex, requiring careful selection among vector databases,…

Artificial Intelligence · Computer Science 2025-05-27 Alexander Conway , Debadeepta Dey , Stefan Hackmann , Matthew Hausknecht , Michael Schmidt , Mark Steadman , Nick Volynets

The optimization of query execution plans is known to be crucial for reducing the query execution time. In particular, query optimization has been studied thoroughly for relational databases over the past decades. Recently, the Resource…

Databases · Computer Science 2020-03-25 Philipp D. Rohde , Maria-Esther Vidal

The SPARQL query language is a recent W3C standard for processing RDF data, a format that has been developed to encode information in a machine-readable way. We investigate the foundations of SPARQL query optimization and (a) provide novel…

Databases · Computer Science 2009-01-26 Michael Schmidt , Michael Meier , Georg Lausen

Static filtering is a data-independent optimisation method for Datalog, which generalises algebraic query rewriting techniques from relational databases. In spite of its early discovery by Kifer and Lozinskii in 1986, the method has been…

Databases · Computer Science 2026-01-14 Philipp Hanisch , Markus Krötzsch

Due to the falling costs of data acquisition and storage, researchers and industry analysts often want to find all instances of rare events in large datasets. For instance, scientists can cheaply capture thousands of hours of video, but are…

Databases · Computer Science 2022-01-05 Daniel Kang , Edward Gan , Peter Bailis , Tatsunori Hashimoto , Matei Zaharia

We introduce a sampling framework to support approximate computing with estimated error bounds in Spark. Our framework allows sampling to be performed at the beginning of a sequence of multiple transformations ending in an aggregation…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-07 Guangyan Hu , Desheng Zhang , Sandro Rigo , Thu D. Nguyen

Natural Language to SQL (NL2SQL) enables intuitive interactions with databases by transforming natural language queries into structured SQL statements. Despite recent advancements in enhancing human-computer interaction within database…

Databases · Computer Science 2025-10-10 Peixian Ma , Xialie Zhuang , Chengjin Xu , Xuhui Jiang , Ran Chen , Jian Guo

Manual modeling in Constraint Programming is a substantial bottleneck, which Constraint Acquisition (CA) aims to automate. However, passive CA methods are prone to over-fitting, often learning models that include spurious global constraints…

Artificial Intelligence · Computer Science 2025-09-30 Vasileios Balafas , Dimos Tsouros , Nikolaos Ploskas , Kostas Stergiou

We introduce ADEPT: Adaptive Data ExPloiTation, a simple yet powerful framework to enhance the **data efficiency** and **generalization** in deep reinforcement learning (RL). Specifically, ADEPT adaptively manages the use of sampled data…

Machine Learning · Computer Science 2025-01-23 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

The index selection problem (ISP) is an important problem for accelerating the execution of relational queries, and it has received a lot of attention as a combinatorial knapsack problem in the past. Various solutions to this very hard…

Databases · Computer Science 2017-09-13 Herbert Jordan , Bernhard Scholz , Pavle Subotić

Effective network slicing requires an infrastructure/network provider to deal with the uncertain demand and real-time dynamics of network resource requests. Another challenge is the combinatorial optimization of numerous resources, e.g.,…

Networking and Internet Architecture · Computer Science 2019-02-27 Nguyen Van Huynh , Dinh Thai Hoang , Diep N. Nguyen , Eryk Dutkiewicz

This paper studies a bandit optimization problem where the goal is to maximize a function $f(x)$ over $T$ periods for some unknown strongly concave function $f$. We consider a new pairwise comparison oracle, where the decision-maker chooses…

Machine Learning · Computer Science 2025-05-29 Xiangyu Chang , Xi Chen , Yining Wang , Zhiyi Zeng

We study methods for efficiently aligning large language models (LLMs) with human preferences given budgeted online feedback. We first formulate the LLM alignment problem in the frame of contextual dueling bandits. This formulation,…

Machine Learning · Computer Science 2024-11-12 Zichen Liu , Changyu Chen , Chao Du , Wee Sun Lee , Min Lin

Recent studies have explored integrating Large Language Models (LLMs) with search engines to leverage both the LLMs' internal pre-trained knowledge and external information. Specially, reinforcement learning (RL) has emerged as a promising…

Artificial Intelligence · Computer Science 2025-12-30 Lang Mei , Zhihan Yang , Xiaohan Yu , Huanyao Zhang , Chong Chen

Effective information retrieval requires reasoning over partial evidence and refining strategies as information emerges. Yet current approaches fall short: neural retrievers lack reasoning capabilities, large language models (LLMs) provide…

Artificial Intelligence · Computer Science 2025-11-12 Supriti Vijay , Aman Priyanshu , Anu Vellore , Baturay Saglam , Amin Karbasi

Matrix trace estimation is ubiquitous in machine learning applications and has traditionally relied on Hutchinson's method, which requires $O(\log(1/\delta)/\epsilon^2)$ matrix-vector product queries to achieve a $(1 \pm…

Data Structures and Algorithms · Computer Science 2021-11-02 Shuli Jiang , Hai Pham , David P. Woodruff , Qiuyi , Zhang

Although the many efforts to apply deep reinforcement learning to query optimization in recent years, there remains room for improvement as query optimizers are complex entities that require hand-designed tuning of workloads and datasets.…

Databases · Computer Science 2023-06-05 Yuri Kim , Yewon Choi , Yujung Gil , Sanghee Lee , Heesik Shin , Jaehyok Chong

Query response time often influences user experience in the real world. However, it possibly takes more time to answer a query with its all exact solutions, especially when it contains the OPT operations since the OPT operation is the least…

Databases · Computer Science 2016-03-23 Zhenyu Song , Zhiyong Feng , Xiaowang Zhang , Xin Wang , Guozheng Rao