English
Related papers

Related papers: Non-Mergeable Sketching for Cardinality Estimation

200 papers

We investigate iterative methods with randomized preconditioners for solving overdetermined least-squares problems, where the preconditioners are based on a random embedding of the data matrix. We consider two distinct approaches: the…

Numerical Analysis · Mathematics 2021-04-15 Jonathan Lacotte , Mert Pilanci

Semidefinite programming is an important tool to tackle several problems in data science and signal processing, including clustering and community detection. However, semidefinite programs are often slow in practice, so speed up techniques…

Optimization and Control · Mathematics 2022-05-11 Pedro Abdalla , Afonso S. Bandeira

Stochastic gradient Markov Chain Monte Carlo (SG-MCMC) has been developed as a flexible family of scalable Bayesian sampling algorithms. However, there has been little theoretical analysis of the impact of minibatch size to the algorithm's…

Machine Learning · Statistics 2017-09-06 Changyou Chen , Wenlin Wang , Yizhe Zhang , Qinliang Su , Lawrence Carin

Algorithmic Gaussianization is a phenomenon that can arise when using randomized sketching or sampling methods to produce smaller representations of large datasets: For certain tasks, these sketched representations have been observed to…

Machine Learning · Computer Science 2023-07-28 Michał Dereziński

We introduce a novel technique for ``lifting'' dimension lower bounds for linear sketches in the real-valued setting to dimension lower bounds for linear sketches with polynomially-bounded integer entries when the input is a…

Data Structures and Algorithms · Computer Science 2025-03-26 Elena Gribelyuk , Honghao Lin , David P. Woodruff , Huacheng Yu , Samson Zhou

Merge trees are a type of topological descriptors that record the connectivity among the sublevel sets of scalar fields. They are among the most widely used topological tools in visualization. In this paper, we are interested in sketching a…

Computational Geometry · Computer Science 2021-06-01 Mingzhe Li , Sourabh Palande , Lin Yan , Bei Wang

Constrained least squares problems arise in many applications. Their memory and computation costs are expensive in practice involving high-dimensional input data. We employ the so-called "sketching" strategy to project the least squares…

Optimization and Control · Mathematics 2021-09-07 Ke Chen , Ruhui Jin

Cost-based query optimization remains a critical task in relational databases even after decades of research and industrial development. Query optimizers rely on a large range of statistical synopses -- including attribute-level histograms…

Databases · Computer Science 2021-02-05 Yesdaulet Izenov , Asoke Datta , Florin Rusu , Jun Hyung Shin

Stream monitoring is fundamental in many data stream applications, such as financial data trackers, security, anomaly detection, and load balancing. In that respect, quantiles are of particular interest, as they often capture the user's…

Data Structures and Algorithms · Computer Science 2022-01-07 Rana Shahout , Roy Friedman , Ran Ben Basat

The key challenge in designing a sketch representation lies with handling the abstract and iconic nature of sketches. Existing work predominantly utilizes either, (i) a pixelative format that treats sketches as natural images employing…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Yonggang Qi , Guoyao Su , Pinaki Nath Chowdhury , Mingkang Li , Yi-Zhe Song

We present MMbeddings, a probabilistic embedding approach that reinterprets categorical embeddings through the lens of nonlinear mixed models, effectively bridging classical statistical theory with modern deep learning. By treating…

Machine Learning · Statistics 2025-11-04 Giora Simchoni , Saharon Rosset

Streaming analytics are essential in a large range of applications, including databases, networking, and machine learning. To optimize performance, practitioners are increasingly offloading such analytics to network nodes such as switches.…

Networking and Internet Architecture · Computer Science 2025-03-19 Jonatan Langlet , Peiqing Chen , Michael Mitzenmacher , Ran Ben Basat , Zaoxing Liu , Gianni Antichi

The immense amount of daily generated and communicated data presents unique challenges in their processing. Clustering, the grouping of data without the presence of ground-truth labels, is an important tool for drawing inferences from data.…

Machine Learning · Statistics 2018-02-08 Panagiotis A. Traganitis , Georgios B. Giannakis

Sketch-based algorithms for network traffic monitoring have drawn increasing interest in recent years due to their sub-linear memory efficiency and high accuracy. As the volume of network traffic grows, software-based sketch implementations…

Hardware Architecture · Computer Science 2025-04-28 Zhaoyang Han , Yicheng Qian , Michael Zink , Miriam Leeser

The power of randomized algorithms in numerical methods have led to fast solutions which use the Singular Value Decomposition (SVD) as a core routine. However, given the large data size of modern and the modest runtime of SVD, most…

Machine Learning · Computer Science 2018-12-20 Hui Han Chin , Paul Pu Liang

A minimum $s$-$t$ cut in a hypergraph is a bipartition of vertices that separates two nodes $s$ and $t$ while minimizing a hypergraph cut function. The cardinality-based hypergraph cut function assigns a cut penalty to each hyperedge based…

Data Structures and Algorithms · Computer Science 2024-09-25 Vedangi Bengali , Nate Veldt

Mining cohesive subgraphs from a graph is a fundamental problem in graph data analysis. One notable cohesive structure is $\gamma$-quasi-clique (QC), where each vertex connects at least a fraction $\gamma$ of the other vertices inside.…

Databases · Computer Science 2023-08-29 Kaiqiang Yu , Cheng Long

In this paper, we propose a novel deep framework for part-level semantic parsing of freehand sketches, which makes three main contributions that are experimentally shown to have substantial practical merit. First, we propose a homogeneous…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Ying Zheng , Hongxun Yao , Xiaoshuai Sun

The hierarchical architecture has become a mainstream design paradigm for Vision Transformers (ViTs), with Patch Merging serving as the pivotal component that transforms a columnar architecture into a hierarchical one. Drawing inspiration…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Yonghao Yu , Dongcheng Zhao , Guobin Shen , Yiting Dong , Yi Zeng

Modern parallel computing devices, such as the graphics processing unit (GPU), have gained significant traction in scientific and statistical computing. They are particularly well-suited to data-parallel algorithms such as the particle…

Computation · Statistics 2015-06-12 Lawrence M. Murray , Anthony Lee , Pierre E. Jacob