English
Related papers

Related papers: Regenerative Rejection Sampling

200 papers

In diffusion models, samples are generated through an iterative refinement process, requiring hundreds of sequential model evaluations. Several recent methods have introduced approximations (fewer discretization steps or distillation) to…

Machine Learning · Computer Science 2024-12-12 Nikil Roashan Selvam , Amil Merchant , Stefano Ermon

In a conventional supervised learning setting, a machine learning model has access to examples of all object classes that are desired to be recognized during the inference stage. This results in a fixed model that lacks the flexibility to…

Computer Vision and Pattern Recognition · Computer Science 2020-01-27 Jathushan Rajasegaran , Munawar Hayat , Salman Khan , Fahad Shahbaz Khan , Ling Shao , Ming-Hsuan Yang

We present an autodifferentiable rejection sampling algorithm termed Rejection Sampling with Autodifferentiation (RSA). In conjunction with reweighting, we show that RSA can be used for efficient parameter estimation and model exploration.…

High Energy Physics - Phenomenology · Physics 2024-12-09 Nick Heller , Phil Ilten , Tony Menzo , Stephen Mrenna , Benjamin Nachman , Andrzej Siodmok , Manuel Szewc , Ahmed Youssef

Repeated Sampling (RS) is a simple inference-time algorithm that has been shown to improve model performance on complex tasks. Although it is an effective way of scaling inference time, it often struggles to generate diverse solution…

Artificial Intelligence · Computer Science 2026-02-17 Divij Handa , Mihir Parmar , Aswin RRV , Md Nayem Uddin , Hamid Palangi , Chitta Baral

Confounding is a significant obstacle to unbiased estimation of causal effects from observational data. For settings with high-dimensional covariates -- such as text data, genomics, or the behavioral social sciences -- researchers have…

Artificial Intelligence · Computer Science 2024-02-01 Katherine A. Keith , Sergey Feldman , David Jurgens , Jonathan Bragg , Rohit Bhattacharya

Respondent-driven sampling (RDS) is a commonly used substitute for random sampling when studying hidden populations, such as injecting drug users or men who have sex with men, for which no sampling frame is known. The method is an extension…

Methodology · Statistics 2012-05-01 Xin Lu , Jens Malmros , Fredrik Liljeros , Tom Britton

The reduced-rank regression model is a popular model to deal with multivariate response and multiple predictors, and is widely used in biology, chemometrics, econometrics, engineering, and other fields. In the reduced-rank regression…

Methodology · Statistics 2022-07-05 Canhong Wen , Qin Wang , Yuan Jiang

Recurrent neural networks are good at solving prediction problems. However, finding a network that suits a problem is quite hard because their performance is strongly affected by their architecture configuration. Automatic architecture…

Neural and Evolutionary Computing · Computer Science 2021-03-16 Andrés Camero , Jamal Toutouh , Enrique Alba

Methods for carefully selecting or generating a small set of training data to learn from, i.e., data pruning, coreset selection, and data distillation, have been shown to be effective in reducing the ever-increasing cost of training neural…

This article introduces Random Error Sampling-based Neuroevolution (RESN), a novel automatic method to optimize recurrent neural network architectures. RESN combines an evolutionary algorithm with a training-free evaluation approach. The…

Neural and Evolutionary Computing · Computer Science 2021-06-30 Andrés Camero , Jamal Toutouh , Enrique Alba

Adaptive sampling algorithms are modern and efficient methods that dynamically adjust the sample size throughout the optimization process. However, they may encounter difficulties in risk-averse settings, particularly due to the challenge…

Optimization and Control · Mathematics 2025-02-17 Sandra Pieraccini , Tommaso Vanzan

We present a randomized approximation scheme for the permanent of a matrix with nonnegative entries. Our scheme extends a recursive rejection sampling method of Huber and Law (SODA 2008) by replacing the upper bound for the permanent with a…

Data Structures and Algorithms · Computer Science 2021-08-18 Juha Harviainen , Antti Röyskö , Mikko Koivisto

Reachability analysis is at the core of many applications, from neural network verification, to safe trajectory planning of uncertain systems. However, this problem is notoriously challenging, and current approaches tend to be either too…

Systems and Control · Electrical Eng. & Systems 2020-11-10 Thomas Lew , Marco Pavone

We propose a coupled rejection-sampling method for sampling from couplings of arbitrary distributions. The method relies on accepting or rejecting coupled samples coming from dominating marginals. Contrary to existing acceptance-rejection…

Methodology · Statistics 2022-03-11 Adrien Corenflos , Simo Särkkä

The Metropolis algorithm involves producing a Markov chain to converge to a specified target density $\pi$. In order to improve its efficiency, we can use the Rejection-Free version of the Metropolis algorithm, which avoids the inefficiency…

Computation · Statistics 2022-10-20 Sigeng Chen , Jeffrey S. Rosenthal , Aki Dote , Hirotaka Tamura , Ali Sheikholeslami

Task robust adaptation is a long-standing pursuit in sequential decision-making. Some risk-averse strategies, e.g., the conditional value-at-risk principle, are incorporated in domain randomization or meta reinforcement learning to…

Machine Learning · Computer Science 2025-05-16 Yun Qu , Qi Cheems Wang , Yixiu Mao , Yiqin Lv , Xiangyang Ji

Because optical systems have huge bandwidth and are capable of generating low noise short pulses they are ideal for undersampling multi-band signals that are located within a very broad frequency range. In this paper we propose a new scheme…

Optics · Physics 2009-11-13 Amir Rosenthal , Alex Linden , Moshe Horowitz

Respondent driven sampling (RDS) is a method often used to estimate population properties (e.g. sexual risk behavior) in hard-to-reach populations. It combines an effective modified snowball sampling methodology with an estimation procedure…

Methodology · Statistics 2013-08-19 Jens Malmros , Naoki Masuda , Tom Britton

We introduce a new approach for designing Random-order Contention Resolution Schemes (RCRS) via exact solution in continuous time. Given a function $c(y):[0,1] \rightarrow [0,1]$, we show how to select each element which arrives at time $y…

Data Structures and Algorithms · Computer Science 2023-12-14 Calum MacRury , Will Ma

A number of distributions that arise in statistical applications can be expressed in the form of a weighted density: the product of a base density and a nonnegative weight function. Generating variates from such a distribution may be…

Methodology · Statistics 2025-03-18 Andrew M. Raim , James A. Livsey , Kyle M. Irimata