English
Related papers

Related papers: Rejection sampling from shape-constrained distribu…

200 papers

We study the regret of Thompson sampling (TS) algorithms for exponential family bandits, where the reward distribution is from a one-dimensional exponential family, which covers many common reward distributions including Bernoulli,…

Machine Learning · Statistics 2022-06-09 Tianyuan Jin , Pan Xu , Xiaokui Xiao , Anima Anandkumar

Matrix completion is the problem of recovering a low rank matrix by observing a small fraction of its entries. A series of recent works [KOM12,JNS13,HW14] have proposed fast non-convex optimization based iterative algorithms to solve this…

Numerical Analysis · Computer Science 2014-11-06 Prateek Jain , Praneeth Netrapalli

Regularization, whether explicit in terms of a penalty in the loss or implicit in the choice of algorithm, is a cornerstone of modern machine learning. Indeed, controlling the complexity of the model class is particularly important when…

Machine Learning · Statistics 2024-10-22 Matteo Vilucchio , Nikolaos Tsilivis , Bruno Loureiro , Julia Kempe

Elliptical slice sampling is a widely used gradient-free Markov chain Monte Carlo algorithm that is tuning-free and capable of adapting to local characteristics of the target distribution. However, its primary limitation is that sampling…

Computation · Statistics 2026-05-22 Nicholas Marco , Surya T. Tokdar

The generalized egg dropping problem is a classic challenge in sequential decision-making. Standard dynamic programming evaluates the minimax minimum number of tests in $\mathcal{O}(K \cdot N^2)$ time. A known approach formulates the…

Data Structures and Algorithms · Computer Science 2026-05-18 Kleitos Papadopoulos

Developing simple, sample-efficient learning algorithms for robust classification is a pressing issue in today's tech-dominated world, and current theoretical techniques requiring exponential sample complexity and complicated improper…

Machine Learning · Computer Science 2023-02-07 Robi Bhattacharjee , Max Hopkins , Akash Kumar , Hantao Yu , Kamalika Chaudhuri

In this work we provide a new technique to design fast approximation algorithms for graph problems where the points of the graph lie in a metric space. Specifically, we present a sampling approach for such metric graphs that, using a…

Data Structures and Algorithms · Computer Science 2018-07-26 Hossein Esfandiari , Michael Mitzenmacher

We consider a replicable stochastic multi-armed bandit algorithm that ensures, with high probability, that the algorithm's sequence of actions is not affected by the randomness inherent in the dataset. Replicability allows third parties to…

Machine Learning · Statistics 2025-01-14 Junpei Komiyama , Shinji Ito , Yuichi Yoshida , Souta Koshino

A new method based on the rejection sampling for finding statistical tests is proposed. This method is conceptually intuitive, easy to implement, and applicable for arbitrary dimension. To illustrate its potential applicability, three…

Methodology · Statistics 2026-03-11 Markku Kuismin

We approach the Max-3-Cut problem through the lens of maximizing complex-valued quadratic forms and demonstrate that low-rank structure in the objective matrix can be exploited, leading to alternative algorithms to classical semidefinite…

Data Structures and Algorithms · Computer Science 2026-04-27 Ria Stevens , Fangshuo Liao , Barbara Su , Jianqiang Li , Anastasios Kyrillidis

Detecting and counting copies of permutation patterns are fundamental algorithmic problems, with applications in the analysis of rankings, nonparametric statistics, and property testing tasks such as independence and quasirandomness…

Data Structures and Algorithms · Computer Science 2026-05-07 Michal Opler

We investigate the problem of batched best arm identification in multi-armed bandits, where we aim to identify the best arm from a set of $n$ arms while minimizing both the number of samples and batches. We introduce an algorithm that…

Machine Learning · Computer Science 2025-01-30 Tianyuan Jin , Qin Zhang , Dongruo Zhou

Importance sampling is a technique that is commonly used to speed up Monte Carlo simulation of rare events. However, little is known regarding the design of efficient importance sampling algorithms in the context of queueing networks. The…

Probability · Mathematics 2009-09-29 Paul Dupuis , Ali Devin Sezer , Hui Wang

We consider the adversarial combinatorial multi-armed bandit (CMAB) problem, whose decision set can be exponentially large with respect to the number of given arms. To avoid dealing with such large decision sets directly, we propose an…

Data Structures and Algorithms · Computer Science 2017-07-27 Shinsaku Sakaue , Masakazu Ishihata , Shin-ichi Minato

We propose an efficient novel path sampling-based framework designed to accelerate the investigation of rare events in complex molecular systems. A key innovation is the shift from sampling restricted path ensemble distributions, as in…

Chemical Physics · Physics 2025-03-28 Gianmarco Lazzeri , Peter G. Bolhuis , Roberto Covino

The computational equivalence between approximate counting and sampling is well established for polynomial-time algorithms. The most efficient general reduction from counting to sampling is achieved via simulated annealing, where the…

Data Structures and Algorithms · Computer Science 2026-04-03 David G. Harris , Vladimir Kolmogorov , Hongyang Liu , Yitong Yin , Yiyao Zhang

We present a simple sublinear-time algorithm for sampling an arbitrary subgraph $H$ \emph{exactly uniformly} from a graph $G$ with $m$ edges, to which the algorithm has access by performing the following types of queries: (1) degree…

Data Structures and Algorithms · Computer Science 2021-03-29 Hendrik Fichtenberger , Mingze Gao , Pan Peng

Large-sample data became prevalent as data acquisition became cheaper and easier. While a large sample size has theoretical advantages for many statistical methods, it presents computational challenges. Sketching, or compression, is a…

Machine Learning · Statistics 2020-05-11 Alexander F. Lapanowski , Irina Gaynanova

We study distribution-free property testing and learning problems where the unknown probability distribution is a product distribution over $\mathbb{R}^d$. For many important classes of functions, such as intersections of halfspaces,…

Data Structures and Algorithms · Computer Science 2021-11-17 Nathaniel Harms , Yuichi Yoshida

The challenge of identifying the best feasible arm within a fixed budget has attracted considerable interest in recent years. However, a notable gap remains in the literature: the exact exponential rate at which the error probability…

Machine Learning · Computer Science 2025-06-04 Jie Bian , Vincent Y. F. Tan