中文
相关论文

相关论文: Dual Control of Exploration and Exploitation for A…

200 篇论文

Autonomous exploration requires robots to generate informative trajectories iteratively. Although sampling-based methods are highly efficient in unmanned aerial vehicle exploration, many of these methods do not effectively utilize the…

机器人学 · 计算机科学 2021-03-23 Zhefan Xu , Di Deng , Kenji Shimada

There is a strong link between the general concept of intelligence and the ability to collect and use information. The theory of Bayes-adaptive exploration offers an attractive optimality framework for training machines to perform complex…

机器学习 · 统计学 2021-09-20 Luca Ambrogioni

Real-time computation of optimal control is a challenging problem and, to solve this difficulty, many frameworks proposed to use learning techniques to learn (possibly sub-optimal) controllers and enable their usage in an online fashion.…

机器人学 · 计算机科学 2024-07-18 Hugo T. M. Kussaba , Abdalla Swikir , Fan Wu , Anastasija Demerdjieva , Gitta Kutyniok , Sami Haddadin

Dual control denotes a class of control problems where the parameters governing the system are imperfectly known. The challenge is to find the optimal balance between probing, i.e. exciting the system to understand it more, and caution,…

最优化与控制 · 数学 2020-04-29 Martin Péron , Christopher M. Baker , Barry D. Hughes , Iadine Chadès

Successful engineering requires environmentally adapted procedural and architectural approaches. While dealing with complicated issues has become an engineering standard mastering uncertainties in complex environment is still a major issue.…

系统与控制 · 计算机科学 2018-06-18 Herbert Palm

Evolutionary computation (EC) algorithms, renowned as powerful black-box optimizers, leverage a group of individuals to cooperatively search for the optimum. The exploration-exploitation tradeoff (EET) plays a crucial role in EC, which,…

神经与进化计算 · 计算机科学 2024-04-15 Zeyuan Ma , Jiacheng Chen , Hongshu Guo , Yining Ma , Yue-Jiao Gong

Robots in uncertain real-world environments must perform both goal-directed and exploratory actions. However, most deep learning-based control methods neglect exploration and struggle under uncertainty. To address this, we adopt deep active…

机器人学 · 计算机科学 2025-12-02 Kentaro Fujii , Shingo Murata

The exploration-exploitation trade-off is central to the description of adaptive behaviour in fields ranging from machine learning, to biology, to economics. While many approaches have been taken, one approach to solving this trade-off has…

机器学习 · 计算机科学 2021-11-29 Beren Millidge , Anil Seth , Christopher Buckley

Path-planning for autonomous vehicles in threat-laden environments is a fundamental challenge. While traditional optimal control methods can find ideal paths, the computational time is often too slow for real-time decision-making. To solve…

最优化与控制 · 数学 2026-04-15 Qiang Le , Yaguang Yang , Isaac E. Weintraub

The ability to deal with systems parametric uncertainties is an essential issue for heavy self-driving vehicles in unconfined environments. In this sense, robust controllers prove to be efficient for autonomous navigation. However,…

Augmenting mechanistic ordinary differential equation (ODE) models with machine-learnable structures is an novel approach to create highly accurate, low-dimensional models of engineering systems incorporating both expert knowledge and…

动力系统 · 数学 2022-06-22 Sandor Beregi , David A. W. Barton , Djamel Rezgui , Simon A. Neild

The atomic cluster expansion (ACE) was proposed recently as a new class of data-driven interatomic potentials with a formally complete basis set. Since the development of any interatomic potential requires a careful selection of training…

材料科学 · 物理学 2022-12-20 Yury Lysogorskiy , Anton Bochkarev , Matous Mrovec , Ralf Drautz

We consider a stochastic impulse control problem that is motivated by applications such as the optimal exploitation of a natural resource. In particular, we consider a stochastic system whose uncontrolled state dynamics are modelled by a…

最优化与控制 · 数学 2024-08-27 Zhesheng Liu , Mihail Zervos

This paper investigates parameter learning problems under deficient excitation (DE). The DE condition is a rank-deficient, and therefore, a more general evolution of the well-known persistent excitation condition. Under the DE condition, a…

系统与控制 · 电气工程与系统科学 2025-05-29 Ganghui Cao , Shimin Wang , Martin Guay , Jinzhi Wang , Zhisheng Duan , Marios M. Polycarpou

The balance of exploration versus exploitation (EvE) is a key issue on evolutionary computation. In this paper we will investigate how an adaptive controller aimed to perform Operator Selection can be used to dynamically manage the EvE…

神经与进化计算 · 计算机科学 2014-09-08 Giacomo di Tollo , Frédéric Lardeux , Jorge Maturana , Frédéric Saubion

We propose a framework based on distributional reinforcement learning and recent attempts to combine Bayesian parameter updates with deep reinforcement learning. We show that our proposed framework conceptually unifies multiple previous…

机器学习 · 计算机科学 2018-06-22 Yunhao Tang , Shipra Agrawal

Model-based reinforcement learning is a powerful tool, but collecting data to fit an accurate model of the system can be costly. Exploring an unknown environment in a sample-efficient manner is hence of great importance. However, the…

机器学习 · 计算机科学 2023-04-27 Matthieu Blanke , Marc Lelarge

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

系统与控制 · 电气工程与系统科学 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

This paper presents a scheme for dual robust control of batch processes under parametric uncertainty. The dual-control paradigm arises in the context of adaptive control. A trade-off should be decided between the control actions that…

系统与控制 · 电气工程与系统科学 2019-06-21 Radoslav Paulen , Miroslav Fikar

Efficient robotic exploration of unknown, sensor limited, global-information-deficient environments poses unique challenges to path planning algorithms. In these difficult environments, no deterministic guarantees on path completion and…

机器人学 · 计算机科学 2017-05-01 Alexander Ivanov , Mark Campbell