English
Related papers

Related papers: Cardinality-Aware Set Prediction and Top-$k$ Class…

200 papers

Cardinality estimation is a fundamental functionality in database systems. Most existing cardinality estimators focus on handling predicates over numeric or categorical data. They have largely omitted an important data type, set-valued…

Databases · Computer Science 2025-03-20 Yufan Sheng , Xin Cao , Kaiqi Zhao , Yixiang Fang , Jianzhong Qi , Wenjie Zhang , Christian S. Jensen

We propose a novel adaptive approximation approach for test-time resource-constrained prediction. Given an input instance at test-time, a gating function identifies a prediction model for the input among a collection of models. Our…

Machine Learning · Statistics 2017-05-30 Feng Nan , Venkatesh Saligrama

This work presents new cardinality estimation methods for data sets recorded by HyperLogLog sketches. A simple derivation of the original estimator was found, that also gives insight how to correct its deficiencies. The result is an…

Data Structures and Algorithms · Computer Science 2017-06-23 Otmar Ertl

The minimization of loss functions is the heart and soul of Machine Learning. In this paper, we propose an off-the-shelf optimization approach that can minimize virtually any non-differentiable and non-decomposable loss function (e.g.…

Machine Learning · Computer Science 2019-05-27 Josif Grabocka , Randolf Scholz , Lars Schmidt-Thieme

Cardinality estimation algorithms receive a stream of elements, with possible repetitions, and return the number of distinct elements in the stream. Such algorithms seek to minimize the required memory and CPU resource consumption at the…

Networking and Internet Architecture · Computer Science 2019-03-15 Reuven Cohen , Yuval Nezri

Many real-world problems, e.g. object detection, have outputs that are naturally expressed as sets of entities. This creates a challenge for traditional deep neural networks which naturally deal with structured outputs such as vectors,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 S. Hamid Rezatofighi , Roman Kaskman , Farbod T. Motlagh , Qinfeng Shi , Daniel Cremers , Laura Leal-Taixé , Ian Reid

Cardinality estimation (CardEst) is a critical aspect of query optimization. Traditionally, it leverages statistics built directly over the data. However, organizational policies (e.g., regulatory compliance) may restrict global data…

Databases · Computer Science 2025-06-23 Peizhi Wu , Rong Kang , Tieying Zhang , Jianjun Chen , Ryan Marcus , Zachary G. Ives

The top-k error is a common measure of performance in machine learning and computer vision. In practice, top-k classification is typically performed with deep neural networks trained with the cross-entropy loss. Theoretical results indeed…

Machine Learning · Computer Science 2018-02-22 Leonard Berrada , Andrew Zisserman , M. Pawan Kumar

The cardinality estimation is a key aspect of query optimization research, and its performance has significantly improved with the integration of machine learning. To overcome the "cold start" problem or the lack of model transferability in…

Databases · Computer Science 2025-05-29 Boyang Fang

Cardinality estimation remains a fundamental challenge in query optimization, often resulting in sub-optimal execution plans and degraded performance. While errors in cardinality estimation are inevitable, existing methods for identifying…

Databases · Computer Science 2025-01-29 Asoke Datta , Yesdaulet Izenov , Brian Tsan , Abylay Amanbayev , Florin Rusu

Cardinality estimation is a key component of database query optimization. Recent studies have demonstrated that learned cardinality estimation techniques can surpass traditional methods in accuracy. However, a significant barrier to their…

Databases · Computer Science 2025-12-30 Lyu Yi , Weiqi Feng , Yuanbiao Wang , Yuhong Kan

We present a study of surrogate losses and algorithms for the general problem of learning to defer with multiple experts. We first introduce a new family of surrogate losses specifically tailored for the multiple-expert setting, where the…

Machine Learning · Computer Science 2024-04-02 Anqi Mao , Mehryar Mohri , Yutao Zhong

The typical way for relation extraction is fine-tuning large pre-trained language models on task-specific datasets, then selecting the label with the highest probability of the output distribution as the final prediction. However, the usage…

Computation and Language · Computer Science 2023-01-02 Bo Li , Wei Ye , Jinglei Zhang , Shikun Zhang

When evaluating computer vision systems, we are often concerned with performance on a task-specific evaluation measure such as the Intersection-Over-Union score used in the PASCAL VOC image segmentation challenge. Ideally, our systems would…

Computer Vision and Pattern Recognition · Computer Science 2014-12-11 Faruk Ahmed , Daniel Tarlow , Dhruv Batra

Class imbalance is a common and pernicious issue for the training of neural networks. Often, an imbalanced majority class can dominate training to skew classifier performance towards the majority outcome. To address this problem we…

Machine Learning · Computer Science 2026-01-09 Miguel O'Malley

Cardinality estimation has long been crucial for cost-based database optimizers in identifying optimal query execution plans, attracting significant attention over the past decades. While recent advancements have significantly improved the…

Databases · Computer Science 2025-10-20 Renrui Li , Qingzhi Ma , Jiajie Xu , Lei Zhao , An Liu

We consider the problem of Cost-Aware Learning, where sampling different component functions of a finite-sum objective incurs different costs. The objective is to reach a target error while minimizing the total cost. First, we propose the…

Machine Learning · Computer Science 2026-05-01 Clara Mohri , Amir Globerson , Haim Kaplan , Tomer Koren , Yishay Mansour

Cardinality estimation algorithms receive a stream of elements whose order might be arbitrary, with possible repetitions, and return the number of distinct elements. Such algorithms usually seek to minimize the required storage and…

Data Structures and Algorithms · Computer Science 2015-08-26 Reuven Cohen , Liran Katzir , Aviv Yehezkel

Subgraph counting is a fundamental problem in understanding and analyzing graph structured data, yet computationally challenging. This calls for an accurate and efficient algorithm for Subgraph Cardinality Estimation, which is to estimate…

Databases · Computer Science 2024-04-16 Wonseok Shin , Siwoo Song , Kunsoo Park , Wook-Shin Han

We study the key framework of learning with abstention in the multi-class classification setting. In this setting, the learner can choose to abstain from making a prediction with some pre-defined cost. We present a series of new theoretical…

Machine Learning · Computer Science 2024-04-02 Anqi Mao , Mehryar Mohri , Yutao Zhong