English
Related papers

Related papers: Optimisation via Slice Sampling

200 papers

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

Efficient sampling from constraint manifolds, and thereby generating a diverse set of solutions for feasibility problems, is a fundamental challenge. We consider the case where a problem is factored, that is, the underlying nonlinear…

Robotics · Computer Science 2021-03-30 Joaquim Ortiz-Haro , Valentin N. Hartmann , Ozgur S. Oguz , Marc Toussaint

This paper investigates the use of stratified sampling as a variance reduction technique for approximating integrals over large dimensional spaces. The accuracy of this method critically depends on the choice of the space partition, the…

Probability · Mathematics 2009-09-15 Pierre Etoré , Gersende Fort , Benjamin Jourdain , Eric Moulines

Slice Sampling has emerged as a powerful Markov Chain Monte Carlo algorithm that adapts to the characteristics of the target distribution with minimal hand-tuning. However, Slice Sampling's performance is highly sensitive to the…

Machine Learning · Statistics 2021-10-05 Minas Karamanis , Florian Beutler

Optimization of expensive computer models with the help of Gaussian process emulators in now commonplace. However, when several (competing) objectives are considered, choosing an appropriate sampling strategy remains an open question. We…

Optimization and Control · Mathematics 2013-10-03 Victor Picheny

In this paper we present a novel multiscale splitting approach to solve multiscale Schroedinger equation, which have large different time-scales. The energy potential is based on highly oscillating functions, which are magnitudes faster…

Numerical Analysis · Mathematics 2018-05-31 Juergen Geiser , Amirbahador Nasari

Sampling from multivariate normal distributions, subjected to a variety of restrictions, is a problem that is recurrent in statistics and computing. In the present work, we demonstrate a general framework to efficiently sample a…

Running machine learning algorithms on large and rapidly growing volumes of data is often computationally expensive, one common trick to reduce the size of a data set, and thus reduce the computational cost of machine learning algorithms,…

Machine Learning · Computer Science 2022-01-25 Shaojie Tang , Jing Yuan

Inspired by the Boltzmann kinetics, we propose a collision-based dynamics with a Monte Carlo solution algorithm that approximates the solution of the multi-marginal optimal transport problem via randomized pairwise swapping of sample…

Artificial Intelligence · Computer Science 2025-08-05 Mohsen Sadr , Hossein Gorji

In many robotics applications, multiple robots are working in a shared workspace to complete a set of tasks as fast as possible. Such settings can be treated as multi-modal multi-robot multi-goal path planning problems, where each robot has…

Robotics · Computer Science 2026-04-20 Valentin N. Hartmann , Tirza Heinle , Yijiang Huang , Stelian Coros

Recent works have proposed optimal subsampling algorithms to improve computational efficiency in large datasets and to design validation studies in the presence of measurement error. Existing approaches generally fall into two categories:…

Methodology · Statistics 2025-12-25 Jasper B. Yang , Thomas Lumley , Bryan E. Shepherd , Pamela A. Shaw

This paper focuses on multi-block optimization problems over transport polytopes, which underlie various applications including strongly correlated quantum physics and machine learning. Conventional block coordinate descent-type methods for…

Optimization and Control · Mathematics 2024-08-27 Yukuan Hu , Mengyu Li , Xin Liu , Cheng Meng

This article describes a method for using optimization to derive efficient independent transition functions for Markov chain Monte Carlo simulations. Our interest is in sampling from a posterior density $\pi(x)$ for problems in which the…

Computation · Statistics 2022-06-03 Dean S. Oliver

We introduce a method to sample the orientational distribution function in computer simulations. The method is based on the exact torque balance equation for classical many-body systems of interacting anisotropic particles in equilibrium.…

Soft Condensed Matter · Physics 2023-04-12 Johannes Renner , Matthias Schmidt , Daniel de las Heras

In contrast to the many continuous global optimization methods that assume the objective function and constraints are factorable, we study how to find globally maximal solutions to problems that are not factorable, focusing on a particular…

Optimization and Control · Mathematics 2022-08-31 Hugh Medal , Izuwa Ahanor

Polar slice sampling (Roberts & Rosenthal, 2002) is a Markov chain approach for approximate sampling of distributions that is difficult, if not impossible, to implement efficiently, but behaves provably well with respect to the dimension.…

Methodology · Statistics 2023-08-10 Philip Schär , Michael Habeck , Daniel Rudolf

We study the problem of maximizing a spectral risk measure of a given output function which depends on several underlying variables, whose individual distributions are known but whose joint distribution is not. We establish and exploit an…

Optimization and Control · Mathematics 2022-11-16 Hamza Ennaji , Quentin Mérigot , Luca Nenna , Brendan Pass

Autonomous robots typically incorporate complex sensors in their decision-making and control loops. These sensors, such as cameras and Lidars, have imperfections in their sensing and are influenced by environmental conditions. In this…

Systems and Control · Electrical Eng. & Systems 2023-05-01 Guy Scher , Sadra Sadraddini , Russ Tedrake , Hadas Kress-Gazit

As computer resources become increasingly limited, traditional statistical methods face challenges in analyzing massive data, especially in functional data analysis. To address this issue, subsampling offers a viable solution by…

Methodology · Statistics 2024-07-01 Jingxiang Pan , Xiaohui Yuan , Xiaohui Yuan

This paper derives two new optimization-driven Monte Carlo algorithms inspired from variable splitting and data augmentation. In particular, the formulation of one of the proposed approaches is closely related to the alternating direction…

Methodology · Statistics 2019-03-27 Maxime Vono , Nicolas Dobigeon , Pierre Chainais