English
Related papers

Related papers: Rejection Sampling with Autodifferentiation - Case…

200 papers

We provide a method for approximating Bayesian inference using rejection sampling. We not only make the process efficient, but also dramatically reduce the memory required relative to conventional methods by combining rejection sampling…

Machine Learning · Computer Science 2015-12-04 Nathan Wiebe , Christopher Granade , Ashish Kapoor , Krysta M Svore

Rejection sampling is a well-known method to sample from a target distribution, given the ability to sample from a given distribution. The method has been first formalized by von Neumann (1951) and has many applications in classical…

Quantum Physics · Physics 2015-03-19 Maris Ozols , Martin Roetteler , Jérémie Roland

Self-Taught Reasoners (STaR), synonymously known as Rejection sampling Fine-Tuning (RFT), is an integral part of the training pipeline of self-improving reasoning Language Models (LMs). The self-improving mechanism often employs random…

Machine Learning · Computer Science 2025-10-07 Woosung Koh , Wonbeen Oh , Jaein Jang , MinHyung Lee , Hyeongjin Kim , Ah Yeon Kim , Joonkee Kim , Junghyun Lee , Taehyeon Kim , Se-Young Yun

This paper proposes a classification framework with a rejection option to mitigate the performance deterioration caused by adversarial examples. While recent machine learning algorithms achieve high prediction performance, they are…

Machine Learning · Computer Science 2020-10-27 Masahiro Kato , Zhenghang Cui , Yoshihiro Fukuhara

Traditional approaches to variational inference rely on parametric families of variational distributions, with the choice of family playing a critical role in determining the accuracy of the resulting posterior approximation. Simple…

Machine Learning · Statistics 2023-09-27 Martin Jankowiak , Du Phan

Recent advancements in keypoint detection and descriptor extraction have shown impressive performance in local feature learning tasks. However, existing methods generally exhibit suboptimal performance under extreme conditions such as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Jingtai He , Gehao Zhang , Tingting Liu , Songlin Du

Since high resolution remote sensing image classification often requires a relatively high computation complexity, lightweight models tend to be practical and efficient. Model pruning is an effective method for model compression. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Guangwenjie Zou , Liang Yao , Fan Liu , Chuanyi Zhang , Xin Li , Ning Chen , Shengxiang Xu , Jun Zhou

This paper studies $\ell_1$ regularization with high-dimensional features for support vector machines with a built-in reject option (meaning that the decision of classifying an observation can be withheld at a cost lower than that of…

Statistics Theory · Mathematics 2012-01-06 Marten Wegkamp , Ming Yuan

This paper studies simultaneous feature selection and extraction in supervised and unsupervised learning. We propose and investigate selective reduced rank regression for constructing optimal explanatory factors from a parsimonious subset…

Methodology · Statistics 2016-10-27 Yiyuan She

We consider the problem of learning from data corrupted by underrepresentation bias, where positive examples are filtered from the data at different, unknown rates for a fixed number of sensitive groups. We show that with a small amount of…

Machine Learning · Computer Science 2024-06-05 Emily Diana , Alexander Williams Tolbert

We address the question of sensitivity analysis for model outputs of any dimension using Regional Sensitivity Analysis (RSA). Classical RSA computes sensitivity indices related to the impact of model inputs variations on the occurrence of a…

Statistics Theory · Mathematics 2022-11-04 Sébastien Roux , Patrice Loisel , Samuel Buis

We propose a rejection sampling scheme using the discriminator of a GAN to approximately correct errors in the GAN generator distribution. We show that under quite strict assumptions, this will allow us to recover the data distribution…

Machine Learning · Statistics 2019-02-27 Samaneh Azadi , Catherine Olsson , Trevor Darrell , Ian Goodfellow , Augustus Odena

Arbitrary-oriented object detection is a relatively emerging but challenging task. Although remarkable progress has been made, there still remain many unsolved issues due to the large diversity of patterns in orientation, scale, aspect…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Peng Sun , Yongbin Zheng , Wenqi Wu , Wanying Xu , Shengjian Bai

In past years model-agnostic meta-learning (MAML) has been one of the most promising approaches in meta-learning. It can be applied to different kinds of problems, e.g., reinforcement learning, but also shows good results on few-shot…

Machine Learning · Computer Science 2021-05-13 Thomas Goerttler , Klaus Obermayer

The paper presents a novel learning-based sampling strategy that guarantees rejection-free sampling of the free space under both biased and approximately uniform conditions, leveraging multivariate kernel densities. Historical data from a…

Robotics · Computer Science 2025-05-15 Thomas T. Enevoldsen , Roberto Galeazzi

Test-time scaling methods improve the capabilities of large language models (LLMs) by increasing the amount of compute used during inference to make a prediction. Inference-time compute can be scaled in parallel by choosing among multiple…

In both observational data and randomized control trials, researchers select statistical models to articulate how the outcome of interest varies with combinations of observable covariates. Choosing a model that is too simple can obfuscate…

The performance of reinforcement learning (RL) algorithms is sensitive to the choice of hyperparameters, with the learning rate being particularly influential. RL algorithms fail to reach convergence or demand an extensive number of samples…

Machine Learning · Computer Science 2024-08-09 Aida Afshar , Aldo Pacchiano

Person re-identification is a problem of identifying individuals across non-overlapping cameras. Although remarkable progress has been made in the re-identification problem, it is still a challenging problem due to appearance variations of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Seongyeop Yang , Byeongkeun Kang , Yeejin Lee

Naive approaches to amortized inference in probabilistic programs with unbounded loops can produce estimators with infinite variance. This is particularly true of importance sampling inference in programs that explicitly include rejection…