English
Related papers

Related papers: A Probabilistic Sample Path Convergence Time Analy…

200 papers

Consider the problem of finding a population or a probability distribution amongst many with the largest mean when these means are unknown but population samples can be simulated or otherwise generated. Typically, by selecting largest…

Probability · Mathematics 2018-09-11 Peter Glynn , Sandeep Juneja

This paper considers online convex optimization with time-varying constraint functions. Specifically, we have a sequence of convex objective functions $\{f_t(x)\}_{t=0}^{\infty}$ and convex constraint functions…

Optimization and Control · Mathematics 2017-02-20 Michael J. Neely , Hao Yu

We analyze the convergence of gradient-based optimization algorithms that base their updates on delayed stochastic gradient information. The main application of our results is to the development of gradient-based distributed optimization…

Optimization and Control · Mathematics 2011-05-02 Alekh Agarwal , John C. Duchi

Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for…

Systems and Control · Electrical Eng. & Systems 2023-10-05 Alexandre Capone , Tim Brüdigam , Sandra Hirche

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

Optimization and Control · Mathematics 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

We model the joint distribution of choice probabilities and decision times in binary choice tasks as the solution to a problem of optimal sequential sampling, where the agent is uncertain of the utility of each action and pays a constant…

Neurons and Cognition · Quantitative Biology 2015-05-14 Drew Fudenberg , Philipp Strack , Tomasz Strzalecki

This paper considers the distributed bandit convex optimization problem with time-varying constraints. In this problem, the global loss function is the average of all the local convex loss functions, which are unknown beforehand. Each agent…

Systems and Control · Electrical Eng. & Systems 2025-04-25 Kunpeng Zhang , Lei Xu , Xinlei Yi , Guanghui Wen , Lihua Xie , Tianyou Chai , Tao Yang

Chance-constrained optimization has emerged as a promising framework for managing uncertainties in power systems. This work advances its application to the DC Optimal Power Flow (DC-OPF) model, developing a novel approach to uncertainty…

Systems and Control · Electrical Eng. & Systems 2026-03-18 Tianyang Yi , D. Adrian Maldonado , Anirudh Subramanyam

We study dropout regularization in continuous-time models through the lens of random-batch methods -- a family of stochastic sampling schemes originally devised to reduce the computational cost of interacting particle systems. We construct…

Machine Learning · Computer Science 2025-10-16 Antonio Álvarez-López , Martín Hernández

We develop two new proximal alternating penalty algorithms to solve a wide range class of constrained convex optimization problems. Our approach mainly relies on a novel combination of the classical quadratic penalty, alternating…

Optimization and Control · Mathematics 2018-09-20 Quoc Tran-Dinh

In this paper we study simulation based optimization algorithms for solving discrete time optimal stopping problems. This type of algorithms became popular among practioneers working in the area of quantitative finance. Using large…

Optimization and Control · Mathematics 2009-09-22 Denis Belomestny

While Robust Model Predictive Control considers the worst-case system uncertainty, Stochastic Model Predictive Control, using chance constraints, provides less conservative solutions by allowing a certain constraint violation probability…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Tim Brüdigam , Victor Gaßmann , Dirk Wollherr , Marion Leibold

This paper addresses sampling-based trajectory optimization for risk-aware navigation under stochastic dynamics. Typically such approaches operate by computing $\tilde{N}$ perturbed rollouts around the nominal dynamics to estimate the…

Robotics · Computer Science 2025-07-15 Basant Sharma , Arun Kumar Singh

We study the effect of stochastic sampling on the estimation of the drift parameter of continuous time AR(1) process. A natural distribution free moment estimator is considered for the drift based on stochastically observed time points. The…

Statistics Theory · Mathematics 2013-07-29 Radhendushka Srivastava , Ping Li

This paper is devoted to the distributed continuous-time optimization problem with time-varying objective functions and time-varying nonlinear inequality constraints. Different from most studied distributed optimization problems with…

Optimization and Control · Mathematics 2020-09-08 Shan Sun , Wei Ren

Mini-batch optimization has proven to be a powerful paradigm for large-scale learning. However, the state of the art parallel mini-batch algorithms assume synchronous operation or cyclic update orders. When worker nodes are heterogeneous…

Optimization and Control · Mathematics 2015-05-20 Hamid Reza Feyzmahdavian , Arda Aytekin , Mikael Johansson

We devise a distributed asynchronous stochastic epsilon-gradient-based algorithm to enable a network of computing and communicating nodes to solve a constrained discrete-time time-varying stochastic convex optimization problem. Each node…

Optimization and Control · Mathematics 2014-10-02 Andrea Simonetto , Leon Kester , Geert Leus

This paper focuses on stochastic optimal control problems with constraints in law, which are rewritten as optimization (minimization) of probability measures problem on the canonical space. We introduce a penalized version of this type of…

Optimization and Control · Mathematics 2025-03-18 Thibaut Bourdais , Nadia Oudjane , Francesco Russo

Two-stage methods addressing continuous shortest path problems start local minimization from discrete shortest paths in a spatial graph. The convergence of such hybrid methods to global minimizers hinges on the discretization error induced…

Optimization and Control · Mathematics 2022-04-13 Ralf Borndörfer , Fabian Danecker , Martin Weiser

We study asynchronous finite sum minimization in a distributed-data setting with a central parameter server. While asynchrony is well understood in parallel settings where the data is accessible by all machines -- e.g., modifications of…

Machine Learning · Computer Science 2021-03-11 Margalit Glasgow , Mary Wootters