English
Related papers

Related papers: The Case for Cardinality Lower Bounds

200 papers

We develop a new technique for constructing sparse graphs that allow us to prove near-linear lower bounds on the round complexity of computing distances in the CONGEST model. Specifically, we show an $\widetilde{\Omega}(n)$ lower bound for…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-18 Amir Abboud , Keren Censor-Hillel , Seri Khoury

Cardinality estimation is the task of approximating the number of distinct elements in a large dataset with possibly repeating elements. LogLog and HyperLogLog (c.f. Durand and Flajolet [ESA 2003], Flajolet et al. [Discrete Math Theor.…

Data Structures and Algorithms · Computer Science 2020-08-19 Aleksander Łukasiewicz , Przemysław Uznański

Modern Cardinality Estimators struggle with data updates. This research tackles this challenge within single-table. We introduce ICE, an Index-based Cardinality Estimator, the first data-driven estimator that enables instant, tuple-leveled…

Databases · Computer Science 2024-09-02 Yingze Li , Xianglong Liu , Hongzhi Wang , Kaixin Zhang , Zixuan Wang

Real-world data typically contain repeated and periodic patterns. This suggests that they can be effectively represented and compressed using only a few coefficients of an appropriate basis (e.g., Fourier, Wavelets, etc.). However, distance…

Machine Learning · Statistics 2014-05-26 Michail Vlachos , Nikolaos Freris , Anastasios Kyrillidis

Black-box optimization is often encountered for decision-making in complex systems management, where the knowledge of system is limited. Under these circumstances, it is essential to balance the utilization of new information with…

Computation · Statistics 2025-01-15 Teng Lian , Jian-Qiang Hu , Yuhang Wu , Zeyu Zheng

Computing lower and upper bounds on the competitive ratio of online algorithms is a challenging question: For a minimization combinatorial problem, proving a competitive ratio for a given algorithm leads to an upper bound. However computing…

Computer Science and Game Theory · Computer Science 2022-12-19 Antoine Lhomme , Olivier Romane , Nicolas Catusse , Nadia Brauner

Class imbalance is a common and pernicious issue for the training of neural networks. Often, an imbalanced majority class can dominate training to skew classifier performance towards the majority outcome. To address this problem we…

Machine Learning · Computer Science 2026-01-09 Miguel O'Malley

Porting a scientific data analysis workflow (DAW) to a cluster infrastructure, a new software stack, or even only a new dataset with some notably different properties is often challenging. Despite the structured definition of the steps…

Decision making under uncertainty is at the heart of any autonomous system acting with imperfect information. The cost of solving the decision making problem is exponential in the action and observation spaces, thus rendering it unfeasible…

Artificial Intelligence · Computer Science 2024-06-18 Tom Yotam , Vadim Indelman

In this work we study preprocessing for tractable problems when part of the input is unknown or uncertain. This comes up naturally if, e.g., the load of some machines or the congestion of some roads is not known far enough in advance, or if…

Data Structures and Algorithms · Computer Science 2015-10-20 Stefan Fafianie , Stefan Kratsch , Voung Anh Quyen

Cardinality estimation (CardEst), a central component of the query optimizer, plays a significant role in generating high-quality query plans in DBMS. The CardEst problem has been extensively studied in the last several decades, using both…

Databases · Computer Science 2021-12-08 Rong Zhu , Tianjing Zeng , Andreas Pfadler , Wei Chen , Bolin Ding , Jingren Zhou

This paper presents some ideas to reduce the computational cost of evidence-based robust design optimization. Evidence Theory crystallizes both the aleatory and epistemic uncertainties in the design parameters, providing two quantitative…

Computational Engineering, Finance, and Science · Computer Science 2012-07-17 Massimiliano Vasile , Edmondo Minisci , Quirien Wijnands

Learned index structures aim to accelerate queries by training machine learning models to approximate the rank function associated with a database attribute. While effective in practice, their theoretical limitations are not fully…

Data Structures and Algorithms · Computer Science 2026-01-13 Luis Alberto Croquevielle , Roman Sokolovskii , Thomas Heinis

Maximization of {\it non-submodular} functions appears in various scenarios, and many previous works studied it based on some measures that quantify the closeness to being submodular. On the other hand, many practical non-submodular…

Data Structures and Algorithms · Computer Science 2019-10-04 Shinsaku Sakaue

In software development, the prevalence of unsafe languages such as C and C++ introduces potential vulnerabilities, especially within the heap, a pivotal component for dynamic memory allocation. Despite its significance, heap management…

Cryptography and Security · Computer Science 2024-09-24 Zheng Yu , Ganxiang Yang , Xinyu Xing

This paper addresses the problem of estimating causal effects when adjustment variables in the back-door or front-door criterion are partially observed. For such scenarios, we derive bounds on the causal effects by solving two non-linear…

Methodology · Statistics 2021-06-24 Ang Li , Judea Pearl

Explanations of the replication crisis often emphasize misconduct, questionable research practices, or incentive misalignment, implying that behavioral reform is sufficient. This paper argues that a substantial component is architectural:…

Methodology · Statistics 2026-03-05 Marco Pollanen

We consider the problem of computing bounds for causal queries on causal graphs with unobserved confounders and discrete valued observed variables, where identifiability does not hold. Existing non-parametric approaches for computing such…

Machine Learning · Computer Science 2023-08-08 Madhumitha Shridharan , Garud Iyengar

Query-driven learned estimators are accurate, flexible, and lightweight alternatives to traditional estimators in query optimization. However, existing query-driven approaches struggle with the Out-of-distribution (OOD) problem, where the…

Databases · Computer Science 2024-12-10 Rui Li , Kangfei Zhao , Jeffrey Xu Yu , Guoren Wang

Cardinality estimation - calculating the number of distinct elements in a stream - is a longstanding problem with applications from networking to bioinformatics. HyperLogLog (HLL), the prevailing standard, has a well-known error spike in…

Data Structures and Algorithms · Computer Science 2026-05-14 Brian Bushnell