English
Related papers

Related papers: Non-stationary Stochastic Optimization

200 papers

We present stability conditions for deterministic time-varying nonlinear discrete-time systems whose inputs aim to minimize an infinite-horizon time-dependent cost. Global asymptotic and exponential stability properties for general…

Systems and Control · Electrical Eng. & Systems 2023-08-28 Sifeddine Benahmed , Romain Postoyan , Mathieu Granzotto , Lucian Buşoniu , Jamal Daafouz , Dragan Nešić

We consider the classical problem of sequential resource allocation where a decision maker must repeatedly divide a budget between several resources, each with diminishing returns. This can be recast as a specific stochastic optimization…

Machine Learning · Statistics 2020-01-17 Xavier Fontaine , Shie Mannor , Vianney Perchet

This work aims to solve a stochastic nonconvex nonsmooth composite optimization problem. Previous works on composite optimization problem requires the major part to satisfy Lipschitz smoothness or some relaxed smoothness conditions, which…

Optimization and Control · Mathematics 2025-10-07 Ziyi Chen , Peiran Yu , Heng Huang

In this paper, we consider a finite horizon non-stationary inventory system with setup costs. We detail an algorithm to find an approximate optimal policy and the basic idea is to use numerical procedure for computing integrals involved in…

Optimization and Control · Mathematics 2023-03-16 Jianyong Liu , Wei Geng , Xiaobo Zhao

The configuration balancing problem with stochastic requests generalizes many well-studied resource allocation problems such as load balancing and virtual circuit routing. In it, we have $m$ resources and $n$ requests. Each request has…

Data Structures and Algorithms · Computer Science 2022-08-30 Franziska Eberle , Anupam Gupta , Nicole Megow , Benjamin Moseley , Rudy Zhou

This paper studies a continuous-time market {under stochastic environment} where an agent, having specified an investment horizon and a target terminal mean return, seeks to minimize the variance of the return with multiple stocks and a…

Portfolio Management · Quantitative Finance 2013-02-28 Wan-Kai Pang , Yuan-Hua Ni , Xun Li , Ka-Fai Cedric Yiu

We study non-smooth stochastic decentralized optimization problems over time-varying networks, where objective functions are distributed across nodes and network connections may intermittently appear or break. Specifically, we consider two…

Optimization and Control · Mathematics 2026-04-28 Maxim Divilkovskiy , Alexander Gasnikov

Contextual stochastic optimization is an advanced methodology to model uncertainty in the presence of contextual information during decision planning processes. Although classical methodologies focus on minimizing the expectation of a…

Optimization and Control · Mathematics 2025-11-24 Man Yiu Tsang , Tony Sit , Hoi Ying Wong

In this paper, we study the problem of bandits with knapsacks (BwK) in a non-stationary environment. The BwK problem generalizes the multi-arm bandit (MAB) problem to model the resource consumption associated with playing each arm. At each…

Machine Learning · Computer Science 2022-10-13 Shang Liu , Jiashuo Jiang , Xiaocheng Li

Standard algorithms for finding the shortest path in a graph require that the cost of a path be additive in edge costs, and typically assume that costs are deterministic. We consider the problem of uncertain edge costs, with potential…

Artificial Intelligence · Computer Science 2013-02-21 Michael P. Wellman , Matthew Ford , Kenneth Larson

We revisit a classical assumption for analyzing stochastic gradient algorithms where the squared norm of the stochastic subgradient (or the variance for smooth problems) is allowed to grow as fast as the squared norm of the optimization…

Optimization and Control · Mathematics 2025-04-15 Ahmet Alacaoglu , Yura Malitsky , Stephen J. Wright

Optimal values and solutions of empirical approximations of stochastic optimization problems can be viewed as statistical estimators of their true values. From this perspective, it is important to understand the asymptotic behavior of these…

Optimization and Control · Mathematics 2025-07-01 Johannes Milz , Thomas M. Surowiec

The use of min-max optimization in adversarial training of deep neural network classifiers and training of generative adversarial networks has motivated the study of nonconvex-nonconcave optimization objectives, which frequently arise in…

Optimization and Control · Mathematics 2021-03-02 Jelena Diakonikolas , Constantinos Daskalakis , Michael I. Jordan

In a typical stochastic multi-armed bandit problem, the objective is often to maximize the expected sum of rewards over some time horizon $T$. While the choice of a strategy that accomplishes that is optimal with no additional information,…

Machine Learning · Computer Science 2023-11-01 Reda Alami , Mohammed Mahfoud , Mastane Achab

We study the problem of non-stationary Lipschitz bandits, where the number of actions is infinite and the reward function, satisfying a Lipschitz assumption, can change arbitrarily over time. We design an algorithm that adaptively tracks…

Machine Learning · Statistics 2025-10-23 Nicolas Nguyen , Solenne Gaucher , Claire Vernade

We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random…

Machine Learning · Computer Science 2021-06-30 Uri Sherman , Tomer Koren , Yishay Mansour

A widely used heuristic for solving stochastic optimization problems is to use a deterministic rolling horizon procedure, which has been modified to handle uncertainty (e.g. buffer stocks, schedule slack). This approach has been criticized…

Optimization and Control · Mathematics 2017-03-16 Raymond T. Perkins , Warren B. Powell

We empirically evaluate a stochastic annealing strategy for Bayesian posterior optimization with variational inference. Variational inference is a deterministic approach to approximate posterior inference in Bayesian models in which a…

Machine Learning · Statistics 2015-05-26 San Gultekin , Aonan Zhang , John Paisley

We propose a novel algorithm for online resource allocation with non-stationary customer arrivals and unknown click-through rates. We assume multiple types of customers arrive in a nonstationary stochastic fashion, with unknown arrival…

Machine Learning · Computer Science 2024-06-04 Xiaoyue Zhang , Hanzhang Qin , Mabel C. Chou

We expose a theoretical hedging optimization framework with variational preferences under convex risk measures. We explore a general dual representation for the composition between risk measures and utilities. We study the properties of the…

Mathematical Finance · Quantitative Finance 2024-10-11 Marcelo Righi