English
Related papers

Related papers: Superposition-Assisted Stochastic Optimization for…

200 papers

We give a construction of the Hawkes process as a piecewise competing risks model. We argue that the most natural interpretation of the self-excitation kernel is the hazard function of a defective random variable. This establishes a link…

Methodology · Statistics 2021-05-04 Maximilian Aigner , Valérie Chavez-Demoulin

We consider stochastic optimization problems in multi-agent settings, where a network of agents aims to learn parameters which are optimal in terms of a global objective, while giving preference to locally observed streaming information. To…

Multiagent Systems · Computer Science 2017-05-24 Alec Koppel , Brian M. Sadler , Alejandro Ribeiro

In this paper I present several algorithmic techniques for improving the decision process of multiple types of agents behaving in environments where their interests are in conflict. The interactions between the agents are modelled by using…

Computer Science and Game Theory · Computer Science 2009-08-04 Mugurel Ionut Andreica

Policy optimization methods with function approximation are widely used in multi-agent reinforcement learning. However, it remains elusive how to design such algorithms with statistical guarantees. Leveraging a multi-agent performance…

Machine Learning · Computer Science 2023-05-09 Yulai Zhao , Zhuoran Yang , Zhaoran Wang , Jason D. Lee

This paper proposes a machine-learning-based solution approach for solving multi-horizon stochastic programs. The approach embeds a deep learning neural network into a multi-horizon stochastic program to approximate the recourse operational…

Optimization and Control · Mathematics 2025-12-03 Hongyu Zhang , Gabriele Sormani , Enza Messina , Alan King , Francesca Maggioni

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

Machine Learning · Computer Science 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

We present an approach for designing swarm-based optimizers for the global optimization of expensive black-box functions. In the proposed approach, the problem of finding efficient optimizers is framed as a reinforcement learning problem,…

Artificial Intelligence · Computer Science 2023-04-12 Eloghosa Ikponmwoba , Ope Owoyele

Stochastic gradient methods are scalable for solving large-scale optimization problems that involve empirical expectations of loss functions. Existing results mainly apply to optimization problems where the objectives are one- or two-level…

Optimization and Control · Mathematics 2018-01-15 Shuoguang Yang , Mengdi Wang , Ethan X. Fang

This paper presents an algorithm for the simulation of Hawkes-type processes where the intensity is expressed in terms of a continuous-time autoregressive moving average model. We identify upper bounds for both the univariate and the…

Computation · Statistics 2025-06-10 Lorenzo Mercuri , Andrea Perchiazzo , Edit Rroji

We present Coordinated Proximal Policy Optimization (CoPPO), an algorithm that extends the original Proximal Policy Optimization (PPO) to the multi-agent setting. The key idea lies in the coordinated adaptation of step size during the…

Artificial Intelligence · Computer Science 2021-11-09 Zifan Wu , Chao Yu , Deheng Ye , Junge Zhang , Haiyin Piao , Hankz Hankui Zhuo

Bayesian optimisation is a sample efficient method for finding a global optimum of expensive black-box objective functions. Historic datasets from related problems can be exploited to help improve performance of Bayesian optimisation by…

Machine Learning · Computer Science 2026-01-23 Natasha Trinkle , Huong Ha , Jeffrey Chan

This study proposes a versatile model for the dynamics of the best bid and ask prices using an extended Hawkes process. The model incorporates the zero intensities of the spread-narrowing processes at the minimum bid-ask spread,…

Trading and Market Microstructure · Quantitative Finance 2022-01-26 Kyungsub Lee , Byoung Ki Seo

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang

We consider computationally expensive blackbox optimization problems and present a method that employs surrogate models and concurrent computing at the search step of the mesh adaptive direct search (MADS) algorithm. Specifically, we solve…

Optimization and Control · Mathematics 2021-07-28 Bastien Talgorn , Stéphane Alarie , Michael Kokkolaras

We consider stochastic model predictive control of a multi-agent systems with constraints on the probabilities of inter-agent collisions. We first study a sample-based approximation of the collision probabilities and use this approximation…

Systems and Control · Computer Science 2011-08-17 Daniel Lyons , Jan-P. Calliess , Uwe D. Hanebeck

In this paper, we focus on the problem of stochastic optimization where the objective function can be written as an expectation function over a closed convex set. We also consider multiple expectation constraints which restrict the domain…

Statistics Theory · Mathematics 2019-06-18 Kinjal Basu , Preetam Nandy

In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed…

Information Theory · Computer Science 2019-10-23 Naeimeh Omidvar , An Liu , Vincent Lau , Danny H. K. Tsang , Mohammad Reza Pakravan

We investigate multi-stage demand uncertainty for the multi-item multi-echelon capacitated lot sizing problem with setup carry-over. Considering a multi-stage decision framework helps to quantify the benefits of being able to adapt…

Optimization and Control · Mathematics 2025-03-28 Manuel Schlenkrich , Jean-François Cordeau , Sophie N. Parragh

Task robust adaptation is a long-standing pursuit in sequential decision-making. Some risk-averse strategies, e.g., the conditional value-at-risk principle, are incorporated in domain randomization or meta reinforcement learning to…

Machine Learning · Computer Science 2025-05-16 Yun Qu , Qi Cheems Wang , Yixiu Mao , Yiqin Lv , Xiangyang Ji

This work develops effective distributed strategies for the solution of constrained multi-agent stochastic optimization problems with coupled parameters across the agents. In this formulation, each agent is influenced by only a subset of…

Optimization and Control · Mathematics 2019-03-15 Sulaiman A. Alghunaim , Ali H. Sayed