中文
相关论文

相关论文: Dual Control of Exploration and Exploitation for A…

200 篇论文

Exploration and mapping of unknown environments is a fundamental task in applications for autonomous robots. In this article, we present a complete framework for deploying MAVs in autonomous exploration missions in unknown subterranean…

The goal of meta-reinforcement learning (meta-RL) is to build agents that can quickly learn new tasks by leveraging prior experience on related tasks. Learning a new task often requires both exploring to gather task-relevant information and…

机器学习 · 计算机科学 2021-11-15 Evan Zheran Liu , Aditi Raghunathan , Percy Liang , Chelsea Finn

The main objective of this paper is to outline a theoretical framework to analyse how humans' decision-making strategies under uncertainty manage the trade-off between information gathering (exploration) and reward seeking (exploitation). A…

人工智能 · 计算机科学 2021-02-16 Antonio Candelieri , Andrea Ponti , Francesco Archetti

Trajectory optimization is a fundamental stochastic optimal control problem. This paper deals with a trajectory optimization approach for dynamical systems subject to measurement noise that can be fitted into linear time-varying stochastic…

系统与控制 · 电气工程与系统科学 2021-08-24 Prakash Mallick , Zhiyong Chen

Meta-Reinforcement learning approaches aim to develop learning procedures that can adapt quickly to a distribution of tasks with the help of a few examples. Developing efficient exploration strategies capable of finding the most useful…

机器学习 · 计算机科学 2019-11-12 Swaminathan Gurumurthy , Sumit Kumar , Katia Sycara

We present a novel strategy for robust dual control of linear time-invariant systems based on gain scheduling with performance guarantees. This work relies on prior results of determining uncertainty bounds of system parameters estimated…

系统与控制 · 电气工程与系统科学 2021-05-14 Janani Venkatasubramanian , Johannes Köhler , Julian Berberich , Frank Allgöwer

Calibration of neural networks is a topical problem that is becoming more and more important as neural networks increasingly underpin real-world applications. The problem is especially noticeable when using modern neural networks, for which…

机器学习 · 计算机科学 2023-08-29 Ondrej Bohdal , Yongxin Yang , Timothy Hospedales

Data-Enabled Predictive Control (DeePC) bypasses the need for system identification by directly leveraging raw data to formulate optimal control policies. However, the size of the optimization problem in DeePC grows linearly with respect to…

系统与控制 · 电气工程与系统科学 2024-09-12 Yihan Zhou , Yiwen Lu , Zishuo Li , Jiaqi Yan , Yilin Mo

Reinforcement learning in sparse-reward navigation environments with expensive and limited interactions is challenging and poses a need for effective exploration. Motivated by complex navigation tasks that require real-world training (when…

最优化与控制 · 数学 2023-10-13 Yijia Wang , Matthias Poloczek , Daniel R. Jiang

Reinforcement learning algorithms commonly seek to optimize policies for solving one particular task. How should we explore an unknown dynamical system such that the estimated model globally approximates the dynamics and allows us to solve…

机器学习 · 计算机科学 2023-10-31 Bhavya Sukhija , Lenart Treven , Cansu Sancaktar , Sebastian Blaes , Stelian Coros , Andreas Krause

Most recent advances in machine learning and analytics for process control pose the question of how to naturally integrate new data-driven methods with classical process models and control. We propose a process modeling framework enabling…

神经与进化计算 · 计算机科学 2025-08-08 Michael R. Wartmann , B. Erik Ydstie

Existing multi-strategy adaptive differential evolution (DE) commonly involves trials of multiple strategies and then rewards better-performing ones with more resources. However, the trials of an exploitative or explorative strategy may…

神经与进化计算 · 计算机科学 2021-12-03 Sheng Xin Zhang , Wing Shing Chan , Kit Sang Tang , Shao Yong Zheng

Machines of all kinds from vehicles to industrial equipment are increasingly instrumented with hundreds of sensors. Using such data to detect anomalous behaviour is critical for safety and efficient maintenance. However, anomalies occur…

人工智能 · 计算机科学 2016-05-06 Mohit Yadav , Pankaj Malhotra , Lovekesh Vig , K Sriram , Gautam Shroff

Nonlinear model predictive control (MPC) is a flexible and increasingly popular framework used to synthesize feedback control strategies that can satisfy both state and control input constraints. In this framework, an optimization problem,…

系统与控制 · 电气工程与系统科学 2023-05-17 Kong Yao Chee , M. Ani Hsieh , Nikolai Matni

A quantum control landscape is defined as the expectation value of a target observable $\Theta$ as a function of the control variables. In this work control landscapes for open quantum systems governed by Kraus map evolution are analyzed.…

This paper presents an approach to trajectory-centric learning control based on contraction metrics and disturbance estimation for nonlinear systems subject to matched uncertainties. The approach uses deep neural networks to learn uncertain…

系统与控制 · 电气工程与系统科学 2024-07-25 Pan Zhao , Ziyao Guo , Yikun Cheng , Aditya Gahlawat , Hyungsoo Kang , Naira Hovakimyan

Learning is a complex dynamical process shaped by a range of interconnected decisions. Careful design of hyperparameter schedules for artificial neural networks or efficient allocation of cognitive resources by biological learners can…

无序系统与神经网络 · 物理学 2025-07-11 Francesca Mignacco , Francesco Mori

This paper presents a novel framework for goal-oriented optimal static sensor placement and dynamic sensor steering in PDE-constrained inverse problems, utilizing a Bayesian approach accelerated by low-rank approximations. The framework is…

数值分析 · 数学 2025-07-09 Marco Mattuschka , Noah An der Lan , Max von Danwitz , Daniel Wolff , Alexander Popp

The Centralized Training with Decentralized Execution (CTDE) paradigm is widely used in cooperative multi-agent reinforcement learning. However, conventional methods based on CTDE can suffer from value underestimation and converge to…

多智能体系统 · 计算机科学 2026-05-05 Ruoning Zhang , Siying Wang , Wenyu Chen , Yang Zhou , Zhitong Zhao , Zixuan Zhang , Ruijie Zhang , Stefano V. Albrecht

This work provides a rigorous framework for studying continuous time control problems in uncertain environments. The framework considered models uncertainty in state dynamics as a measure on the space of functions. This measure is…

最优化与控制 · 数学 2018-02-22 Ryan Murray , Michele Palladino