English
Related papers

Related papers: Adaptive Rejection Sampling with fixed number of n…

200 papers

The purpose of model selection algorithms such as All Subsets, Forward Selection and Backward Elimination is to choose a linear model on the basis of the same set of data to which the model will be applied. Typically we have available a…

Statistics Theory · Mathematics 2007-06-13 Bradley Efron , Trevor Hastie , Iain Johnstone , Robert Tibshirani

Large Reasoning Language Models (LRLMs or LRMs) demonstrate remarkable capabilities in complex reasoning tasks, but suffer from significant computational inefficiencies due to overthinking phenomena. Existing efficient reasoning methods…

Artificial Intelligence · Computer Science 2025-10-13 Dongqi Zheng

Importance sampling (IS) is a Monte Carlo methodology that allows for approximation of a target distribution using weighted samples generated from another proposal distribution. Adaptive importance sampling (AIS) implements an iterative…

Computation · Statistics 2018-06-04 Yousef El-Laham , Victor Elvira , Monica F. Bugallo

Autonomous driving vehicles aim to free the hands of vehicle operators, helping them to drive easier and faster, meanwhile, improving the safety of driving on the highway or in complex scenarios. Automated driving systems (ADS) are…

Robotics · Computer Science 2023-07-04 Yucheng LI

Partial Rejection Sampling is an algorithmic approach to obtaining a perfect sample from a specified distribution. The objects to be sampled are assumed to be represented by a number of random variables. In contrast to classical rejection…

Data Structures and Algorithms · Computer Science 2024-09-18 Mark Jerrum

We propose a coupled rejection-sampling method for sampling from couplings of arbitrary distributions. The method relies on accepting or rejecting coupled samples coming from dominating marginals. Contrary to existing acceptance-rejection…

Methodology · Statistics 2022-03-11 Adrien Corenflos , Simo Särkkä

Retrieval-Augmented Generation (RAG) systems often rely on fixed top-k document selection mechanisms that ignore downstream generation quality and impose computational overheads. We propose SRAS (Sparse Reward-Aware Selector), a lightweight…

Information Retrieval · Computer Science 2026-01-06 Rajiv Chaitanya Muttur

Rejection sampling is a common tool for low dimensional problems ($d \leq 2$), often touted as an "easy" way to obtain valid samples from a distribution $f(\cdot)$ of interest. In practice it is non-trivial to apply, often requiring…

Computation · Statistics 2023-10-03 Edward Raff , Mark McLean , James Holt

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by pulling in external material, document, code, manuals, from vast and ever-growing corpora, to effectively answer user queries. The effectiveness of RAG depends…

Information Retrieval · Computer Science 2025-11-20 Yifan Xu , Vipul Gupta , Rohit Aggarwal , Varsha Mahadevan , Bhaskar Krishnamachari

We propose Adaptive Randomized Smoothing (ARS) to certify the predictions of our test-time adaptive models against adversarial examples. ARS extends the analysis of randomized smoothing using $f$-Differential Privacy to certify the adaptive…

Machine Learning · Computer Science 2025-07-11 Saiyue Lyu , Shadab Shaikh , Frederick Shpilevskiy , Evan Shelhamer , Mathias Lécuyer

Response-Adaptive Randomization (RAR) is part of a wider class of data-dependent sampling algorithms, for which clinical trials are typically used as a motivating application. In that context, patient allocation to treatments is determined…

Methodology · Statistics 2022-06-09 David S. Robertson , Kim May Lee , Boryana C. Lopez-Kolkovska , Sofia S. Villar

Adaptive simulated annealing (ASA) is a global optimization algorithm based on an associated proof that the parameter space can be sampled much more efficiently than by using other previous simulated annealing algorithms. The author's ASA…

Mathematical Software · Computer Science 2007-05-23 Lester Ingber

Rejection sampling methods have recently been proposed to improve the performance of discriminator-based generative models. However, these methods are only optimal under an unlimited sampling budget, and are usually applied to a generator…

Machine Learning · Computer Science 2024-03-04 Alexandre Verine , Muni Sreenivas Pydi , Benjamin Negrevergne , Yann Chevaleyre

The Gamma distribution is well-known and widely used in many signal processing and communications applications. In this letter, a simple and extremely efficient accept/reject algorithm is introduced for the generation of independent random…

Computation · Statistics 2013-06-27 Luca Martino , David Luengo

Sequential recommender systems (SRS) have gained increasing popularity due to their remarkable proficiency in capturing dynamic user preferences. In the current setup of SRS, a common configuration is to uniformly consider each historical…

Information Retrieval · Computer Science 2025-06-03 Hao Zhang , Mingyue Cheng , Zhiding Liu , Junzhe Jiang

Recommendation systems often rely on implicit feedback, where only positive user-item interactions can be observed. Negative sampling is therefore crucial to provide proper negative training signals. However, existing methods tend to…

Information Retrieval · Computer Science 2026-01-06 Na Li , Fanghui Sun , Yan Zou , Yangfu Zhu , Xiatian Zhu , Ying Ma

High-dimensional classification has become an increasingly important problem. In this paper we propose a "Multivariate Adaptive Stochastic Search" (MASS) approach which first reduces the dimension of the data space and then applies a…

Applications · Statistics 2010-10-08 Tian Siva Tian , Gareth M. James , Rand R. Wilcox

The problem of estimating the number $n$ of distinct keys of a large collection of $N$ data is well known in computer science. A classical algorithm is the adaptive sampling (AS). $n$ can be estimated by $R.2^D$, where $R$ is the final…

Data Structures and Algorithms · Computer Science 2019-05-17 Matthew Drescher , Guy Louchard , Yvik Swan

Traditional approaches to variational inference rely on parametric families of variational distributions, with the choice of family playing a critical role in determining the accuracy of the resulting posterior approximation. Simple…

Machine Learning · Statistics 2023-09-27 Martin Jankowiak , Du Phan

Label assignment is a crucial process in object detection, which significantly influences the detection performance by determining positive or negative samples during training process. However, existing label assignment strategies barely…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Jian Guan , Mingjie Xie , Youtian Lin , Guangjun He , Pengming Feng