English
Related papers

Related papers: Multi-step dual control for exploration and exploi…

200 papers

In many sequential decision-making problems, the goal is to optimize a utility function while satisfying a set of constraints on different utilities. This learning problem is formalized through Constrained Markov Decision Processes (CMDPs).…

Machine Learning · Computer Science 2020-03-05 Yonathan Efroni , Shie Mannor , Matteo Pirotta

This paper introduces Data-enabled Predictive Control Hyperparameter Tuning via Differentiable Optimization (DeePC-Hunt), a backpropagation-based method for automatic hyperparameter tuning of the DeePC algorithm. The necessity for such a…

Optimization and Control · Mathematics 2025-05-30 Michael Cummins , Alberto Padoan , Keith Moffat , Florian Dorfler , John Lygeros

Multi-Agent Path Finding (MAPF) involves finding collision-free paths for multiple agents while minimizing a cost function--an NP-hard problem. Bounded suboptimal methods like Enhanced Conflict-Based Search (ECBS) and Explicit Estimation…

Multiagent Systems · Computer Science 2025-08-07 Yimin Tang , Zhenghong Yu , Jiaoyang Li , Sven Koenig

An integrated optimization method based on the constrained multi-objective evolutionary algorithm (MOEA) and non-intrusive polynomial chaos expansion (PCE) is proposed, which solves robust multi-objective optimization problems under…

Neural and Evolutionary Computing · Computer Science 2022-09-29 Yuji Takubo , Masahiro Kanazaki

Multiobjective evolutionary algorithms (MOEAs) have been successfully applied to a number of constrained optimization problems. Many of them adopt mutation and crossover operators from differential evolution. However, these operators do not…

Neural and Evolutionary Computing · Computer Science 2019-11-11 Wei Huang , Tao Xu , Kangshun Li , Jun He

Cooperative control of connected and automated vehicles (CAVs) promises smoother traffic flow. In mixed traffic, where human-driven vehicles with unknown dynamics coexist, data-driven predictive control techniques allow for CAV safe and…

Systems and Control · Electrical Eng. & Systems 2023-05-01 Jiawei Wang , Yingzhao Lian , Yuning Jiang , Qing Xu , Keqiang Li , Colin N. Jones

Numerous heuristics and advanced approaches have been proposed for exploration in different settings for deep reinforcement learning. Noise-based exploration generally fares well with dense-shaped rewards and bonus-based exploration with…

Machine Learning · Computer Science 2025-10-22 Sebastian Griesbach , Carlo D'Eramo

This study presents a novel integrated framework for dynamic origin-destination demand estimation (DODE) in multi-class mesoscopic network models, incorporating high-resolution satellite imagery together with conventional traffic data from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Jiachao Liu , Pablo Guarda , Koichiro Niinuma , Sean Qian

This paper considers the problem of planning trajectories for a team of sensor-equipped robots to reduce uncertainty about a dynamical process. Optimizing the trade-off between information gain and energy cost (e.g., control effort,…

This paper proposes a Model Predictive Control (MPC) algorithm for target tracking amongst static and dynamic obstacles. Our main contribution lies in improving the computational tractability and reliability of the underlying non-convex…

Robotics · Computer Science 2021-12-24 Houman Masnavi , Vivek Adajania , Karl Kruusamae , Arun Kumar Singh

Efficient autonomous exploration in large-scale environments remains challenging due to the high planning computational cost and low-speed maneuvers. In this paper, we propose a fast and computationally efficient dual-layer exploration…

Robotics · Computer Science 2026-01-22 Qianli Dong , Xuebo Zhang , Shiyong Zhang , Ziyu Wang , Zhe Ma , Haobo Xi

This letter proposes a novel sampled-data model predictive control framework for continuous control-affine nonlinear systems that provides rigorous reach-avoid and recursive feasibility guarantees under physical constraints. By propagating…

Optimization and Control · Mathematics 2026-04-07 Jianqiang Ding , Nishant Jayesh Bhave , Shankar A. Deka

We consider the utilization of a computational model to guide the optimal acquisition of experimental data to inform the stochastic description of model input parameters. Our formulation is based on the recently developed consistent…

Computation · Statistics 2021-05-04 Scott N. Walsh , Tim M. Wildey , John D. Jakeman

Fast and accurate device activity detection is the critical challenge in grant-free access for supporting massive machine-type communications (mMTC) and ultra-reliable low-latency communications (URLLC) in 5G and beyond. The…

Optimization and Control · Mathematics 2025-03-25 Bowen Tan , Ying Cui

This paper presents an efficient algorithm, naming Centralized Searching and Decentralized Optimization (CSDO), to find feasible solution for large-scale Multi-Vehicle Trajectory Planning (MVTP) problem. Due to the intractable growth of…

Robotics · Computer Science 2024-10-24 Yibin Yang , Shaobing Xu , Xintao Yan , Junkai Jiang , Jianqiang Wang , Heye Huang

Missing value imputation is a crucial preprocessing step for many machine learning problems. However, it is often considered as a separate subtask from downstream applications such as classification, regression, or clustering, and thus is…

Machine Learning · Computer Science 2024-05-02 Adam Catto , Nan Jia , Ansaf Salleb-Aouissi , Anita Raja

Accurate multi-step port-of-call sequence prediction is vital for tactical resource orchestration and logistical efficiency. However, existing methods struggle with unreliable voyage schedules and the inability of AIS data to provide…

Machine Learning · Computer Science 2026-05-18 Yanzhao Su , Fang He , Yineng Wang

Various efforts have been devoted to developing stabilizing distributed Model Predictive Control (MPC) schemes for tracking piecewise constant references. In these schemes, terminal sets are usually computed offline and used in the MPC…

Systems and Control · Electrical Eng. & Systems 2021-10-29 Ahmed Aboudonia , Annika Eichler , Francesco Cordiano , Goran Banjac , John Lygeros

Doubly selective (DS) channel estimation in largescale multiple-input multiple-output (MIMO) systems is a challenging problem due to the requirement of unaffordable pilot overheads and prohibitive complexity. In this paper, we propose a…

Information Theory · Computer Science 2015-11-10 Bo Gong , Qibo Qin , Xiang Ren , Lin Gui , Hanwen Luo , Wen Chen

The use of the Bayesian tools in system identification and model updating paradigms has been increased in the last ten years. Usually, the Bayesian techniques can be implemented to incorporate the uncertainties associated with measurements…

Computational Engineering, Finance, and Science · Computer Science 2017-10-27 M. Sherri , I. Boulkaibet , T. Marwala , M. I. Friswell