English
Related papers

Related papers: Asymptotic optimality of adaptive importance sampl…

200 papers

This paper investigates the use of stratified sampling as a variance reduction technique for approximating integrals over large dimensional spaces. The accuracy of this method critically depends on the choice of the space partition, the…

Probability · Mathematics 2009-09-15 Pierre Etoré , Gersende Fort , Benjamin Jourdain , Eric Moulines

Sampling is a fundamental problem in computer science and statistics. However, for a given task and stream, it is often not possible to choose good sampling probabilities in advance. We derive a general framework for adaptively changing the…

Machine Learning · Statistics 2022-06-16 Daniel Ting

The note studies the problem of selecting a good enough subset out of a finite number of alternatives under a fixed simulation budget. Our work aims to maximize the posterior probability of correctly selecting a good subset. We formulate…

Optimization and Control · Mathematics 2023-05-09 Gongbo Zhang , Bin Chen , Qing-shan Jia , Yijie Peng

The self-normalized importance sampling (SNIS) estimator is a Monte Carlo estimator widely used to approximate expectations in statistical signal processing and machine learning. The efficiency of SNIS depends on the choice of proposal, but…

Computation · Statistics 2025-05-06 Nicola Branchini , Víctor Elvira

We consider the "policy choice" problem -- otherwise known as best arm identification in the bandit literature -- proposed by Kasy and Sautmann (2021) for adaptive experimental design. Theorem 1 of Kasy and Sautmann (2021) provides three…

Econometrics · Economics 2021-11-25 Kaito Ariu , Masahiro Kato , Junpei Komiyama , Kenichiro McAlinn , Chao Qin

Artificial Immune Systems (AIS) employing hypermutations with linear static mutation potential have recently been shown to be very effective at escaping local optima of combinatorial optimisation problems at the expense of being slower…

Neural and Evolutionary Computing · Computer Science 2019-03-29 Dogan Corus , Pietro S. Oliveto , Donya Yazdani

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

Efficient sampling and remote estimation are critical for a plethora of wireless-empowered applications in the Internet of Things and cyber-physical systems. Motivated by such applications, this work proposes decentralized policies for the…

Systems and Control · Electrical Eng. & Systems 2022-06-09 Xingran Chen , Xinyu Liao , Shirin Saeedi Bidokhti

The normalizing constant plays an important role in Bayesian computation, and there is a large literature on methods for computing or approximating normalizing constants that cannot be evaluated in closed form. When the normalizing constant…

Computation · Statistics 2020-09-02 Yuling Yao , Collin Cademartori , Aki Vehtari , Andrew Gelman

Importance sampling is a widely used technique to estimate properties of a distribution. This paper investigates trading-off some bias for variance by adaptively winsorizing the importance sampling estimator. The novel winsorizing…

Computation · Statistics 2021-02-10 Paulo Orenstein

In this paper, we propose a sampling-based planning and optimal control method of nonlinear systems under non-differentiable constraints. Motivated by developing scalable planning algorithms, we consider the optimal motion plan to be a…

Systems and Control · Computer Science 2016-12-19 Jie Fu

Negative sampling is essential for implicit-feedback-based collaborative filtering, which is used to constitute negative signals from massive unlabeled data to guide supervised learning. The state-of-the-art idea is to utilize hard negative…

Information Retrieval · Computer Science 2023-08-14 Yuhan Zhao , Rui Chen , Riwei Lai , Qilong Han , Hongtao Song , Li Chen

We describe an adaptive importance sampling algorithm for rare events that is based on a dual stochastic control formulation of a path sampling problem. Specifically, we focus on path functionals that have the form of cumulate generating…

Dynamical Systems · Mathematics 2019-01-30 Omar Kebiri , Lara Neureither , Carsten Hartmann

Importance sampling is a Monte Carlo method that introduces a proposal distribution to sample the space according to the target distribution. Yet calibration of the proposal distribution is essential to achieving efficiency, thus the resort…

Computation · Statistics 2022-06-17 Grégoire Aufort , Pierre Pudlo , Denis Burgarella

Integrated task and motion planning problems describe a multi-modal state space, which is often abstracted as a set of smooth manifolds that are connected via sets of transitions states. One approach to solving such problems is to sample…

Robotics · Computer Science 2022-01-21 Rahul Shome , Daniel Nakhimovich , Kostas E. Bekris

Non-active adaptive sampling is a way of building machine learning models from a training data base which are supposed to dynamically and automatically derive guaranteed sample size. In this context and regardless of the strategy used in…

Computation and Language · Computer Science 2024-02-06 Manuel Vilares Ferro , Victor M. Darriba Bilbao , Jesús Vilares Ferro

This paper introduces a new Importance Sampling scheme, called Adaptive Twisted Importance Sampling, which is adequate for the improved estimation of rare event probabilities in he range of moderate deviations pertaining to the empirical…

Computation · Statistics 2009-10-13 Michel Broniatowski , Ya'Acov Ritov

In modern data analysis, it is common to select a model before performing statistical inference. Selective inference tools make adjustments for the model selection process in order to ensure reliable inference post selection. In this paper,…

Methodology · Statistics 2025-02-24 Yumeng Wang , Snigdha Panigrahi , Xuming He

The paper considers the problem of distributed adaptive linear parameter estimation in multi-agent inference networks. Local sensing model information is only partially available at the agents and inter-agent communication is assumed to be…

Optimization and Control · Mathematics 2012-08-07 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

Consider a decision maker who is responsible to collect observations so as to enhance his information in a speedy manner about an underlying phenomena of interest. The policies under which the decision maker selects sensing actions can be…

Information Theory · Computer Science 2015-06-12 Mohammad Naghshvar , Tara Javidi
‹ Prev 1 3 4 5 6 7 10 Next ›