English
Related papers

Related papers: DistJoin: A Decoupled Join Cardinality Estimator b…

200 papers

We address distributed learning problems, both nonconvex and convex, over undirected networks. In particular, we design a novel algorithm based on the distributed Alternating Direction Method of Multipliers (ADMM) to address the challenges…

Machine Learning · Computer Science 2026-03-23 Xiaoxing Ren , Nicola Bastianello , Karl H. Johansson , Thomas Parisini

SQL queries, with the AND, OR, and NOT operators, constitute a broad class of highly used queries. Thus, their cardinality estimation is important for query optimization. In addition, a query planner requires the set-theoretic cardinality…

Databases · Computer Science 2020-04-16 Rojeh Hayek , Oded Shmueli

Cardinality estimation (CardEst) is an essential component in query optimizers and a fundamental problem in DBMS. A desired CardEst method should attain good algorithm performance, be stable to varied data settings, and be friendly to…

Databases · Computer Science 2021-02-03 Ziniu Wu , Amir Shaikhha , Rong Zhu , Kai Zeng , Yuxing Han , Jingren Zhou

Despite plenty of efforts focusing on improving the domain adaptation ability (DA) under unsupervised or few-shot semi-supervised settings, recently the solution of active learning started to attract more attention due to its suitability in…

Machine Learning · Computer Science 2022-04-05 Ming Xie , Yuxi Li , Yabiao Wang , Zekun Luo , Zhenye Gan , Zhongyi Sun , Mingmin Chi , Chengjie Wang , Pei Wang

Reward fine-tuning has become a common approach for aligning pretrained diffusion and flow models with human preferences in text-to-image generation. Among reward-gradient-based methods, Adjoint Matching (AM) provides a principled…

Machine Learning · Computer Science 2026-05-19 Jeongwoo Shin , Dongsoo Shin , Yuchen Zhu , Wei Guo , Yongxin Chen , Joonseok Lee , Jaewoong Choi , Jaemoo Choi

Joint detection and estimation refers to deciding between two or more hypotheses and, depending on the test outcome, simultaneously estimating the unknown parameters of the underlying distribution. This problem is investigated in a…

Signal Processing · Electrical Eng. & Systems 2019-04-19 Dominik Reinhard , Michael Fauss , Abdelhak M. Zoubir

This article presents an adaptive mean shift algorithm designed for datasets with varying local scale and cluster cardinality. Local distance distributions, from a point to all others, are used to estimate the cardinality of the local…

Machine Learning · Computer Science 2025-08-19 Étienne Pepin

Cardinality estimation algorithms receive a stream of elements whose order might be arbitrary, with possible repetitions, and return the number of distinct elements. Such algorithms usually seek to minimize the required storage and…

Data Structures and Algorithms · Computer Science 2015-08-26 Reuven Cohen , Liran Katzir , Aviv Yehezkel

Recent work has reemphasized the importance of cardinality estimates for query optimization. While new techniques have continuously improved in accuracy over time, they still generally allow for under-estimates which often lead optimizers…

Databases · Computer Science 2022-11-21 Kyle Deeds , Dan Suciu , Magda Balazinska

Cardinality estimation is a critical component and a longstanding challenge in modern data warehouses. ByteHouse, ByteDance's cloud-native engine for extensive data analysis in exabyte-scale environments, serves numerous internal…

Databases · Computer Science 2024-04-12 Yuxing Han , Haoyu Wang , Lixiang Chen , Yifeng Dong , Xing Chen , Benquan Yu , Chengcheng Yang , Weining Qian

We consider the estimation of Dirichlet Process Mixture Models (DPMMs) in distributed environments, where data are distributed across multiple computing nodes. A key advantage of Bayesian nonparametric models such as DPMMs is that they…

Machine Learning · Statistics 2017-09-20 Ruohui Wang , Dahua Lin

Uncertainty estimation for machine learning models is of high importance in many scenarios such as constructing the confidence intervals for model predictions and detection of out-of-distribution or adversarially generated points. In this…

Machine Learning · Computer Science 2022-05-06 Kirill Fedyanin , Evgenii Tsymbalov , Maxim Panov

Although Convolutional Neural Networks (CNNs) have achieved promising results in image classification, they still are vulnerable to affine transformations including rotation, translation, flip and shuffle. The drawback motivates us to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Zijie Tan , Guanfang Dong , Chenqiu Zhao , Anup Basu

Joining trajectory datasets is a significant operation in mobility data analytics and the cornerstone of various methods that aim to extract knowledge out of them. In the era of Big Data, the production of mobility data has become massive…

Databases · Computer Science 2020-02-07 Panagiotis Tampakis , Christos Doulkeridis , Nikos Pelekis , Yannis Theodoridis

Cardinal scores (numeric ratings) collected from people are well known to suffer from miscalibrations. A popular approach to address this issue is to assume simplistic models of miscalibration (such as linear biases) to de-bias the scores.…

Machine Learning · Statistics 2018-09-14 Jingyan Wang , Nihar B. Shah

In a large database system, upper-bounding the cardinality of a join query is a crucial task called $\textit{pessimistic cardinality estimation}$. Recently, Abo Khamis, Nakos, Olteanu, and Suciu unified related works into the following…

Databases · Computer Science 2025-10-07 Yu-Ting Lin , Hsin-Po Wang

We present a detailed study of cardinality-aware top-$k$ classification, a novel approach that aims to learn an accurate top-$k$ set predictor while maintaining a low cardinality. We introduce a new target loss function tailored to this…

Machine Learning · Computer Science 2024-07-12 Corinna Cortes , Anqi Mao , Christopher Mohri , Mehryar Mohri , Yutao Zhong

We propose new methods to speed up convergence of the Alternating Direction Method of Multipliers (ADMM), a common optimization tool in the context of large scale and distributed learning. The proposed method accelerates the speed of…

Machine Learning · Computer Science 2016-04-05 Changkyu Song , Sejong Yoon , Vladimir Pavlovic

Neural ordinary differential equations (NODEs) have recently attracted increasing attention; however, their empirical performance on benchmark tasks (e.g. image classification) are significantly inferior to discrete-layer models. We…

Machine Learning · Statistics 2020-12-07 Juntang Zhuang , Nicha Dvornek , Xiaoxiao Li , Sekhar Tatikonda , Xenophon Papademetris , James Duncan

Modern Cardinality Estimators struggle with data updates. This research tackles this challenge within single-table. We introduce ICE, an Index-based Cardinality Estimator, the first data-driven estimator that enables instant, tuple-leveled…

Databases · Computer Science 2024-09-02 Yingze Li , Xianglong Liu , Hongzhi Wang , Kaixin Zhang , Zixuan Wang