中文
相关论文

相关论文: Rejection Sampling with Autodifferentiation - Case…

200 篇论文

We provide a method for approximating Bayesian inference using rejection sampling. We not only make the process efficient, but also dramatically reduce the memory required relative to conventional methods by combining rejection sampling…

机器学习 · 计算机科学 2015-12-04 Nathan Wiebe , Christopher Granade , Ashish Kapoor , Krysta M Svore

Rejection sampling is a well-known method to sample from a target distribution, given the ability to sample from a given distribution. The method has been first formalized by von Neumann (1951) and has many applications in classical…

量子物理 · 物理学 2015-03-19 Maris Ozols , Martin Roetteler , Jérémie Roland

Self-Taught Reasoners (STaR), synonymously known as Rejection sampling Fine-Tuning (RFT), is an integral part of the training pipeline of self-improving reasoning Language Models (LMs). The self-improving mechanism often employs random…

This paper proposes a classification framework with a rejection option to mitigate the performance deterioration caused by adversarial examples. While recent machine learning algorithms achieve high prediction performance, they are…

机器学习 · 计算机科学 2020-10-27 Masahiro Kato , Zhenghang Cui , Yoshihiro Fukuhara

Traditional approaches to variational inference rely on parametric families of variational distributions, with the choice of family playing a critical role in determining the accuracy of the resulting posterior approximation. Simple…

机器学习 · 统计学 2023-09-27 Martin Jankowiak , Du Phan

Recent advancements in keypoint detection and descriptor extraction have shown impressive performance in local feature learning tasks. However, existing methods generally exhibit suboptimal performance under extreme conditions such as…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Jingtai He , Gehao Zhang , Tingting Liu , Songlin Du

Since high resolution remote sensing image classification often requires a relatively high computation complexity, lightweight models tend to be practical and efficient. Model pruning is an effective method for model compression. However,…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Guangwenjie Zou , Liang Yao , Fan Liu , Chuanyi Zhang , Xin Li , Ning Chen , Shengxiang Xu , Jun Zhou

This paper studies $\ell_1$ regularization with high-dimensional features for support vector machines with a built-in reject option (meaning that the decision of classifying an observation can be withheld at a cost lower than that of…

统计理论 · 数学 2012-01-06 Marten Wegkamp , Ming Yuan

This paper studies simultaneous feature selection and extraction in supervised and unsupervised learning. We propose and investigate selective reduced rank regression for constructing optimal explanatory factors from a parsimonious subset…

统计方法学 · 统计学 2016-10-27 Yiyuan She

We consider the problem of learning from data corrupted by underrepresentation bias, where positive examples are filtered from the data at different, unknown rates for a fixed number of sensitive groups. We show that with a small amount of…

机器学习 · 计算机科学 2024-06-05 Emily Diana , Alexander Williams Tolbert

We address the question of sensitivity analysis for model outputs of any dimension using Regional Sensitivity Analysis (RSA). Classical RSA computes sensitivity indices related to the impact of model inputs variations on the occurrence of a…

统计理论 · 数学 2022-11-04 Sébastien Roux , Patrice Loisel , Samuel Buis

We propose a rejection sampling scheme using the discriminator of a GAN to approximately correct errors in the GAN generator distribution. We show that under quite strict assumptions, this will allow us to recover the data distribution…

机器学习 · 统计学 2019-02-27 Samaneh Azadi , Catherine Olsson , Trevor Darrell , Ian Goodfellow , Augustus Odena

Arbitrary-oriented object detection is a relatively emerging but challenging task. Although remarkable progress has been made, there still remain many unsolved issues due to the large diversity of patterns in orientation, scale, aspect…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Peng Sun , Yongbin Zheng , Wenqi Wu , Wanying Xu , Shengjian Bai

In past years model-agnostic meta-learning (MAML) has been one of the most promising approaches in meta-learning. It can be applied to different kinds of problems, e.g., reinforcement learning, but also shows good results on few-shot…

机器学习 · 计算机科学 2021-05-13 Thomas Goerttler , Klaus Obermayer

The paper presents a novel learning-based sampling strategy that guarantees rejection-free sampling of the free space under both biased and approximately uniform conditions, leveraging multivariate kernel densities. Historical data from a…

机器人学 · 计算机科学 2025-05-15 Thomas T. Enevoldsen , Roberto Galeazzi

Test-time scaling methods improve the capabilities of large language models (LLMs) by increasing the amount of compute used during inference to make a prediction. Inference-time compute can be scaled in parallel by choosing among multiple…

In both observational data and randomized control trials, researchers select statistical models to articulate how the outcome of interest varies with combinations of observable covariates. Choosing a model that is too simple can obfuscate…

The performance of reinforcement learning (RL) algorithms is sensitive to the choice of hyperparameters, with the learning rate being particularly influential. RL algorithms fail to reach convergence or demand an extensive number of samples…

机器学习 · 计算机科学 2024-08-09 Aida Afshar , Aldo Pacchiano

Person re-identification is a problem of identifying individuals across non-overlapping cameras. Although remarkable progress has been made in the re-identification problem, it is still a challenging problem due to appearance variations of…

计算机视觉与模式识别 · 计算机科学 2022-11-09 Seongyeop Yang , Byeongkeun Kang , Yeejin Lee

Naive approaches to amortized inference in probabilistic programs with unbounded loops can produce estimators with infinite variance. This is particularly true of importance sampling inference in programs that explicitly include rejection…