English
Related papers

Related papers: Universal Perfect Samplers for Incremental Streams

200 papers

We study the classical problem of moment estimation of an underlying vector whose $n$ coordinates are implicitly defined through a series of updates in a data stream. We show that if the updates to the vector arrive in the random-order…

Data Structures and Algorithms · Computer Science 2022-07-08 David P. Woodruff , Samson Zhou

We study $\ell_p$ sampling and frequency moment estimation in a single-pass insertion-only data stream. For $p \in (0,2)$, we present a nearly space-optimal approximate $\ell_p$ sampler that uses $\widetilde{O}(\log n \log(1/\delta))$ bits…

Data Structures and Algorithms · Computer Science 2026-04-07 Honghao Lin , Hoai-An Nguyen , William Swartworth , David P. Woodruff

For a class $\mathcal{G}$ of graphs, the objective of \textsc{Subgraph Complementation to} $\mathcal{G}$ is to find whether there exists a subset $S$ of vertices of the input graph $G$ such that modifying $G$ by complementing the subgraph…

Data Structures and Algorithms · Computer Science 2023-03-29 Dhanyamol Antony , Sagartanu Pal , R. B. Sandeep

We consider variable selection problem in linear regression using mixture of $g$-priors. A number of mixtures are proposed in the literature which work well, especially when the number of regressors $p$ is fixed. In this paper, we propose a…

Statistics Theory · Mathematics 2015-04-16 Minerva Mukhopadhyay

In this work we study the {\it moment estimation} problem using weighted sampling. Given sample access to a set $A$ with $n$ weighted elements, and a parameter $t>0$, we estimate the $t$-th moment of $A$ given as $S_t=\sum_{a\in A} w(a)^t$.…

Data Structures and Algorithms · Computer Science 2025-02-24 Anup Bhattacharya , Pinki Pradhan

In this work, we examine sampling problems with non-smooth potentials. We propose a novel Markov chain Monte Carlo algorithm for sampling from non-smooth potentials. We provide a non-asymptotical analysis of our algorithm and establish a…

Machine Learning · Computer Science 2022-02-11 Jiaming Liang , Yongxin Chen

Motivated by applications in statistics and machine learning, we consider a problem of unmixing convex combinations of nonparametric densities. Suppose we observe $n$ groups of samples, where the $i$th group consists of $N_i$ independent…

Statistics Theory · Mathematics 2026-03-31 Jianqing Fan , Zheng Tracy Ke , Zhaoyang Shi

Perfect $L_p$ sampling in a stream was introduced by Jayaram and Woodruff (FOCS 2018) as a streaming primitive which, given turnstile updates to a vector $x \in \{-\text{poly}(n), \ldots, \text{poly}(n)\}^n$, outputs an index $i^* \in \{1,…

Data Structures and Algorithms · Computer Science 2025-12-02 William Swartworth , David P. Woodruff , Samson Zhou

We consider the minimization of a sum of a smooth function with a nonsmooth composite function, where the composition is applied on a random linear mapping. This random composite model encompasses many problems, and can especially capture…

Optimization and Control · Mathematics 2024-12-02 Dan Greenstein , Nadav Hallak

This paper studies the \emph{subset sampling} problem. The input is a set $\mathcal{S}$ of $n$ records together with a function $\textbf{p}$ that assigns each record $v\in\mathcal{S}$ a probability $\textbf{p}(v)$. A query returns a random…

Data Structures and Algorithms · Computer Science 2023-07-24 Jinchao Huang , Sibo Wang

Sampled point and voxel methods are usually employed to downsample the dense events into sparse ones. After that, one popular way is to leverage a graph model which treats the sparse points/voxels as nodes and adopts graph neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Bo Jiang , Chengguo Yuan , Xiao Wang , Zhimin Bao , Lin Zhu , Yonghong Tian , Jin Tang

Text-attributed Graphs (TAGs) are commonly found in the real world, such as social networks and citation networks, and consist of nodes represented by textual descriptions. Currently, mainstream machine learning methods on TAGs involve a…

Social and Information Networks · Computer Science 2023-09-07 Xuanwen Huang , Kaiqiao Han , Dezheng Bao , Quanjin Tao , Zhisheng Zhang , Yang Yang , Qi Zhu

Obtaining high certainty in predictive models is crucial for making informed and trustworthy decisions in many scientific and engineering domains. However, extensive experimentation required for model accuracy can be both costly and…

Machine Learning · Computer Science 2024-12-17 Giorgio Morales , John Sheppard

We prove bounds for the number of solutions to $$a_1 + \dots + a_k = a_1' + \dots + a_k'$$ over $N$-element sets of reals, which are sufficiently convex or near-convex. A near-convex set will be the image of a set with small additive…

Number Theory · Mathematics 2021-04-26 Peter J. Bradshaw , Brandon Hanson , Misha Rudnev

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over the years. Existing literature mainly focus on selecting a subgraph, through combinatorial optimization, to provide faithful…

Machine Learning · Computer Science 2023-03-07 Wenqian Li , Yinchuan Li , Zhigang Li , Jianye Hao , Yan Pang

Stochastic differential equations (SDEs) or diffusions are continuous-valued continuous-time stochastic processes widely used in the applied and mathematical sciences. Simulating paths from these processes is usually an intractable problem,…

Computation · Statistics 2020-05-27 Qi Wang , Vinayak Rao , Yee Whye Teh

We study the problem of efficiently summarizing a short video into several keyframes, leveraging recent progress in fast graph sampling. Specifically, we first construct a similarity path graph (SPG) $\mathcal{G}$, represented by graph…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Sadid Sahami , Gene Cheung , Chia-Wen Lin

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

Machine Learning · Statistics 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

The output distribution of a neural network (NN) over the entire input space captures the complete input-output mapping relationship, offering insights toward a more comprehensive NN understanding. Exhaustive enumeration or traditional…

Artificial Intelligence · Computer Science 2023-02-22 Weitang Liu , Ying-Wai Li , Yi-Zhuang You , Jingbo Shang

We tackle the problem of sampling from intractable high-dimensional density functions, a fundamental task that often appears in machine learning and statistics. We extend recent sampling-based approaches that leverage controlled stochastic…

Machine Learning · Computer Science 2024-03-12 Dinghuai Zhang , Ricky T. Q. Chen , Cheng-Hao Liu , Aaron Courville , Yoshua Bengio