English
Related papers

Related papers: Stochastic Collection and Replenishment (SCAR): Ob…

200 papers

Stochastic convex optimization, where the objective is the expectation of a random convex function, is an important and widely used method with numerous applications in machine learning, statistics, operations research and other areas. We…

Machine Learning · Computer Science 2016-11-23 Vitaly Feldman , Cristobal Guzman , Santosh Vempala

Intelligent systems sometimes need to infer the probable goals of people, cars, and robots, based on partial observations of their motion. This paper introduces a class of probabilistic programs for formulating and solving these problems.…

Artificial Intelligence · Computer Science 2017-04-19 Marco F. Cusumano-Towner , Alexey Radul , David Wingate , Vikash K. Mansinghka

For random variables produced through the inverse transform method, approximate random variables are introduced, which are produced by approximations to a distribution's inverse cumulative distribution function. These approximations are…

Numerical Analysis · Mathematics 2023-06-21 Oliver Sheridan-Methven , Michael Giles

This paper introduces Stochastic RAG--a novel approach for end-to-end optimization of retrieval-augmented generation (RAG) models that relaxes the simplifying assumptions of marginalization and document independence, made in most prior…

Computation and Language · Computer Science 2024-05-07 Hamed Zamani , Michael Bendersky

We study stochastic combinatorial optimization problems where the objective is to minimize the expected maximum load (a.k.a.\ the makespan). In this framework, we have a set of $n$ tasks and $m$ resources, where each task $j$ uses some…

Data Structures and Algorithms · Computer Science 2021-06-25 Anupam Gupta , Amit Kumar , Viswanath Nagarajan , Xiangkun Shen

We describe an adaptive importance sampling algorithm for rare events that is based on a dual stochastic control formulation of a path sampling problem. Specifically, we focus on path functionals that have the form of cumulate generating…

Dynamical Systems · Mathematics 2019-01-30 Omar Kebiri , Lara Neureither , Carsten Hartmann

Safe path planning is a crucial component in autonomous robotics. The many approaches to find a collision free path can be categorically divided into trajectory optimisers and sampling-based methods. When planning using occupancy maps, the…

Robotics · Computer Science 2017-03-02 Gilad Francis , Lionel Ott , Fabio Ramos

In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed…

Information Theory · Computer Science 2019-10-23 Naeimeh Omidvar , An Liu , Vincent Lau , Danny H. K. Tsang , Mohammad Reza Pakravan

We address an optimization problem where the cost function is the expectation of a random mapping. To tackle the problem two approaches based on the approximation of the objective function by consensus-based particle optimization methods on…

Optimization and Control · Mathematics 2025-11-24 Sabrina Bonandin , Michael Herty

We analyse a multilevel Monte Carlo method for the approximation of distribution functions of univariate random variables. Since, by assumption, the target distribution is not known explicitly, approximations have to be used. We provide an…

Probability · Mathematics 2017-06-22 Mike B. Giles , Tigran Nagapetyan , Klaus Ritter

Stochastic Optimal Control (SOC) problems arise in systems influenced by uncertainty, such as autonomous robots or financial models. Traditional methods like dynamic programming are often intractable for high-dimensional, nonlinear systems…

Optimization and Control · Mathematics 2025-04-25 Apurva Patil

The state space representation of active resident space objects can be posed in the form of a stochastic hybrid system. Satellite maneuvers may be accounted for according to control cost or heuristical considerations, yet it is possible to…

Signal Processing · Electrical Eng. & Systems 2022-04-06 Guillermo Escribano , Manuel Sanjurjo-Rivo , Jan Siminski , Alejandro Pastor , Diego Escobar

We consider the problem of adaptive stratified sampling for Monte Carlo integration of a differentiable function given a finite number of evaluations to the function. We construct a sampling scheme that samples more often in regions where…

Machine Learning · Statistics 2012-10-22 Alexandra Carpentier , Rémi Munos

A core problem in statistics and probabilistic machine learning is to compute probability distributions and expectations. This is the fundamental problem of Bayesian statistics and machine learning, which frames all inference as…

Machine Learning · Statistics 2024-12-06 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

In this paper, we study a functional SAR model in which explanatory variables are sampling points of a continuous-time process. We propose a procedure for the maximum likelihood estimation for the spatial parameter dependence and the…

Statistics Theory · Mathematics 2016-09-14 Wilmer Pineda-Ríos , Ramón Giraldo

We present adaptive sequential SAA (sample average approximation) algorithms to solve large-scale two-stage stochastic linear programs. The iterative algorithm framework we propose is organized into \emph{outer} and \emph{inner} iterations…

Optimization and Control · Mathematics 2020-12-08 Raghu Pasupathy , Yongjia Song

Overfitting remains a critical challenge in data-driven financial modeling, where machine learning (ML) systems learn spurious patterns in historical prices and fail out of sample and in deployment. This paper introduces the GT-Score, a…

Statistical Finance · Quantitative Finance 2026-02-03 Alexander Sheppert

We propose a novel stochastic algorithm that randomly samples entire rows and columns of the matrix as a way to approximate an arbitrary matrix function using the power series expansion. This contrasts with existing Monte Carlo methods,…

Data Structures and Algorithms · Computer Science 2024-09-23 Nicolas L. Guidotti , Juan A. Acebrón , José Monteiro

Various works have aimed at combining the inference efficiency of recurrent models and training parallelism of multi-head attention for sequence modeling. However, most of these works focus on tasks with fixed-dimension observation spaces,…

Machine Learning · Computer Science 2024-10-14 Bryce Ferenczi , Michael Burke , Tom Drummond

Submodular maximization with a cardinality constraint can model various problems, and those problems are often very large in practice. For the case where objective functions are monotone, many fast approximation algorithms have been…

Data Structures and Algorithms · Computer Science 2020-01-13 Shinsaku Sakaue