English
Related papers

Related papers: Cardinality estimation using Gumbel distribution

200 papers

Inference in log-linear models scales linearly in the size of output space in the worst-case. This is often a bottleneck in natural language processing and computer vision tasks when the output space is feasibly enumerable but very large.…

Machine Learning · Computer Science 2017-07-12 Stephen Mussmann , Daniel Levy , Stefano Ermon

Effective recommendation systems rely on capturing user preferences, often requiring incorporating numerous features such as universally unique identifiers (UUIDs) of entities. However, the exceptionally high cardinality of UUIDs poses a…

Information Retrieval · Computer Science 2024-01-19 Dhruva Dixith Kurra , Bo Ling , Chun Zh , Seyedshahin Ashrafzadeh

Given a social network, which of its nodes are more central? This question has been asked many times in sociology, psychology and computer science, and a whole plethora of centrality measures (a.k.a. centrality indices, or rankings) were…

Data Structures and Algorithms · Computer Science 2013-08-13 Paolo Boldi , Sebastiano Vigna

Cardinality estimation is one of the most fundamental and challenging problems in query optimization. Neither classical nor learning-based methods yield satisfactory performance when estimating the cardinality of the join queries. They…

Databases · Computer Science 2022-12-13 Ziniu Wu , Parimarjan Negi , Mohammad Alizadeh , Tim Kraska , Samuel Madden

We present the Cardinal mock galaxy catalogs, a new version of the Buzzard simulation that has been updated to support ongoing and future cosmological surveys, including DES, DESI, and LSST. These catalogs are based on a one-quarter sky…

Cosmology and Nongalactic Astrophysics · Physics 2023-03-23 Chun-Hao To , Joseph DeRose , Risa H. Wechsler , Eli Rykoff , Hao-Yi Wu , Susmita Adhikari , Elisabeth Krause , Eduardo Rozo , David H. Weinberg

We present a new Subset Simulation approach using Hamiltonian neural network-based Monte Carlo sampling for reliability analysis. The proposed strategy combines the superior sampling of the Hamiltonian Monte Carlo method with…

Machine Learning · Statistics 2024-01-11 Denny Thaler , Somayajulu L. N. Dhulipala , Franz Bamer , Bernd Markert , Michael D. Shields

Gaussian process hyperparameter optimization requires linear solves with, and log-determinants of, large kernel matrices. Iterative numerical techniques are becoming popular to scale to larger datasets, relying on the conjugate gradient…

Machine Learning · Computer Science 2022-06-22 Jonathan Wenger , Geoff Pleiss , Philipp Hennig , John P. Cunningham , Jacob R. Gardner

A probabilistic expert system emulates the decision-making ability of a human expert through a directional graphical model. The first step in building such systems is to understand data generation mechanism. To this end, one may try to…

Methodology · Statistics 2021-09-29 Vahid Partovi Nia , Xinlin Li , Masoud Asgharian , Shoubo Hu , Zhitang Chen , Yanhui Geng

Super point is a special host in network which communicates with lots of other hosts in a certain time period. The number of hosts contacting with a super point is called as its cardinality. Cardinality estimating plays important roles in…

Networking and Internet Architecture · Computer Science 2018-07-05 Jie Xu , Wei Ding , Jian Gong , Xiaoyan Hu

Cardinality estimation is a fundamental functionality in database systems. Most existing cardinality estimators focus on handling predicates over numeric or categorical data. They have largely omitted an important data type, set-valued…

Databases · Computer Science 2025-03-20 Yufan Sheng , Xin Cao , Kaiqi Zhao , Yixiang Fang , Jianzhong Qi , Wenjie Zhang , Christian S. Jensen

Cardinality estimation (CardEst) is a critical aspect of query optimization. Traditionally, it leverages statistics built directly over the data. However, organizational policies (e.g., regulatory compliance) may restrict global data…

Databases · Computer Science 2025-06-23 Peizhi Wu , Rong Kang , Tieying Zhang , Jianjun Chen , Ryan Marcus , Zachary G. Ives

In this paper, we study the problem of deriving fast and accurate classification algorithms with uncertainty quantification. Gaussian process classification provides a principled approach, but the corresponding computational burden is…

Machine Learning · Computer Science 2018-05-29 Dimitrios Milios , Raffaello Camoriano , Pietro Michiardi , Lorenzo Rosasco , Maurizio Filippone

Cardinality estimation is a fundamental component in database systems, crucial for generating efficient execution plans. Despite advancements in learning-based cardinality estimation, existing methods may struggle to simultaneously optimize…

Databases · Computer Science 2025-05-14 Jiawei Liu , Ju Fan , Tongyu Liu , Kai Zeng , Jiannan Wang , Quehuan Liu , Tao Ye , Nan Tang

Deep Learning (DL) methods have been transforming computer vision with innovative adaptations to other domains including climate change. For DL to pervade Science and Engineering (S&E) applications where risk management is a core component,…

Machine Learning · Computer Science 2018-05-25 Thomas Vandal , Evan Kodra , Jennifer Dy , Sangram Ganguly , Ramakrishna Nemani , Auroop R. Ganguly

We study the statistical distribution of the closest encounter between generic smooth observations computed along different trajectories of a rapidly mixing dynamical system. At the limit of large trajectories, we obtain a distribution of…

Chaotic Dynamics · Physics 2022-08-31 Theophile Caby

Computational models of the cardiovascular system are increasingly used for the diagnosis, treatment, and prevention of cardiovascular disease. Before being used for translational applications, the predictive abilities of these models need…

Applications · Statistics 2024-01-11 Friederike Schäfer , Daniele E. Schiavazzi , Leif Rune Hellevik , Jacob Sturdy

We study a relaxation of the problem of coupling probability distributions -- a list of samples is generated from one distribution and an accept is declared if any one of these samples is identical to the sample generated from the other…

Machine Learning · Computer Science 2026-01-13 Joseph Rowan , Buu Phan , Ashish Khisti

In object tracking and state estimation problems, ambiguous evidence such as imprecise measurements and the absence of detections can contain valuable information and thus be leveraged to further refine the probabilistic belief state. In…

Signal Processing · Electrical Eng. & Systems 2023-05-23 Keith A. LeGrand , Silvia Ferrari

The massive dark matter halos that host groups and clusters of galaxies have observable properties that appear to be log-normally distributed about power-law mean scaling relations in halo mass. Coupling this assumption with either…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-19 August E. Evrard , Pablo Arnault , Dragan Huterer , Arya Farahi

Kernel Regularized Least Squares (KRLS) is a popular method for flexibly estimating models that may have complex relationships between variables. However, its usefulness to many researchers is limited for two reasons. First, existing…

Machine Learning · Statistics 2023-09-12 Qing Chang , Max Goplerud