English
Related papers

Related papers: Scardina: Scalable Join Cardinality Estimation by …

200 papers

Motivated by genome-wide association studies, we consider a standard linear model with one additional random effect in situations where many predictors have been collected on the same subjects and each predictor is analyzed separately.…

Applications · Statistics 2013-04-24 Matti Pirinen , Peter Donnelly , Chris C. A. Spencer

Clustering algorithms are fundamental tools across many fields, with density-based methods offering particular advantages in identifying arbitrarily shaped clusters and handling noise. However, their effectiveness is often limited by the…

Machine Learning · Computer Science 2025-12-01 Meysam Shirdel Bilehsavar , Razieh Ghaedi , Samira Seyed Taheri , Xinqi Fan , Christian O'Reilly

Clustering methods with dimension reduction have been receiving considerable wide interest in statistics lately and a lot of methods to simultaneously perform clustering and dimension reduction have been proposed. This work presents a novel…

Methodology · Statistics 2014-06-17 Michio Yamamoto , Kenichi Hayashi

Entity alignment has always had significant uses within a multitude of diverse scientific fields. In particular, the concept of matching entities across networks has grown in significance in the world of social science as communicative…

Social and Information Networks · Computer Science 2020-04-21 James Flamino , Christopher Abriola , Ben Zimmerman , Zhongheng Li , Joel Douglas

We develop a new method for multivariate scalar on multidimensional distribution regression. Traditional approaches typically analyze isolated univariate scalar outcomes or consider unidimensional distributional representations as…

Methodology · Statistics 2023-10-17 Rahul Ghosal , Marcos Matabuena

Mining subgraphs with interesting structural properties from networks (or graphs) is a computationally challenging task. In this paper, we propose two algorithms for enumerating all connected induced subgraphs of a given cardinality from…

Data Structures and Algorithms · Computer Science 2023-03-17 Shanshan Wang , Chenglong Xiao

Cost-based query optimization remains a critical task in relational databases even after decades of research and industrial development. Query optimizers rely on a large range of statistical synopses -- including attribute-level histograms…

Databases · Computer Science 2021-02-05 Yesdaulet Izenov , Asoke Datta , Florin Rusu , Jun Hyung Shin

As the data size in Machine Learning fields grows exponentially, it is inevitable to accelerate the computation by utilizing the ever-growing large number of available cores provided by high-performance computing hardware. However, existing…

Machine Learning · Computer Science 2021-04-23 Kun Li , Liang Yuan , Yunquan Zhang , Gongwei Chen

Data sketching is a critical tool for distinct counting, enabling multisets to be represented by compact summaries that admit fast cardinality estimates. Because sketches may be merged to summarize multiset unions, they are a basic building…

Data Structures and Algorithms · Computer Science 2023-02-07 Jonathan Hehir , Daniel Ting , Graham Cormode

In many applications, data can be heterogeneous in the sense of spanning latent groups with different underlying distributions. When predictive models are applied to such data the heterogeneity can affect both predictive performance and…

Machine Learning · Statistics 2022-05-04 Thomas Lartigue , Sach Mukherjee

This paper focuses on multi-enrollment speaker recognition which naturally occurs in the task of online speaker clustering, and studies the properties of different scoring back-ends in this scenario. First, we show that popular cosine…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-21 Alexey Sholokhov , Nikita Kuzmin , Kong Aik Lee , Eng Siong Chng

There has been a recent emergence of sampling-based techniques for estimating epistemic uncertainty in deep neural networks. While these methods can be applied to classification or semantic segmentation tasks by simply averaging samples,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Dimity Miller , Feras Dayoub , Michael Milford , Niko Sünderhauf

Cardinality estimation is the task of approximating the number of distinct elements in a large dataset with possibly repeating elements. LogLog and HyperLogLog (c.f. Durand and Flajolet [ESA 2003], Flajolet et al. [Discrete Math Theor.…

Data Structures and Algorithms · Computer Science 2020-08-19 Aleksander Łukasiewicz , Przemysław Uznański

Chromosome recognition is an essential task in karyotyping, which plays a vital role in birth defect diagnosis and biomedical research. However, existing classification methods face significant challenges due to the inter-class similarity…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Ruijia Chang , Suncheng Xiang , Chengyu Zhou , Kui Su , Dahong Qian , Jun Wang

A new method for combining several initial estimators of the regression function is introduced. Instead of building a linear or convex optimized combination over a collection of basic estimators $r_1,\dots,r_M$, we use them as a collective…

Statistics Theory · Mathematics 2019-05-24 Gérard Biau , Aurélie Fischer , Benjamin Guedj , James Malley

In the era of Big Data, scalable and accurate clustering algorithms for high-dimensional data are essential. We present new Bayesian Distance Clustering (BDC) models and inference algorithms with improved scalability while maintaining the…

Methodology · Statistics 2024-09-02 Rafael Cabral , Maria de Iorio , Andrew Harris

Although linear classifiers are one of the oldest methods in machine learning, they are still very popular in the machine learning community. This is due to their low computational complexity and robustness to overfitting. Consequently,…

Machine Learning · Computer Science 2022-03-29 Pawel Trajdos , Robert Burduk

Canonical correlation analysis (CCA) is a widely used technique for estimating associations between two sets of multi-dimensional variables. Recent advancements in CCA methods have expanded their application to decipher the interactions of…

Machine Learning · Statistics 2025-02-05 Hongju Park , Shuyang Bai , Zhenyao Ye , Hwiyoung Lee , Tianzhou Ma , Shuo Chen

In this paper, computational aspects of the panel aggregation problem are addressed. Motivated primarily by applications of risk assessment, an algorithm is developed for aggregating large corpora of internally incoherent probability…

Artificial Intelligence · Computer Science 2007-07-13 Joel B. Predd , Sanjeev R. Kulkarni , Daniel N. Osherson , H. Vincent Poor

Graph clustering, or community detection, is the task of identifying groups of closely related objects in a large network. In this paper we introduce a new community-detection framework called LambdaCC that is based on a specially weighted…

Data Structures and Algorithms · Computer Science 2018-07-17 Nate Veldt , David Gleich , Anthony Wirth