English
Related papers

Related papers: Multi-step dual control for exploration and exploi…

200 papers

This paper presents a novel framework for goal-oriented optimal static sensor placement and dynamic sensor steering in PDE-constrained inverse problems, utilizing a Bayesian approach accelerated by low-rank approximations. The framework is…

Numerical Analysis · Mathematics 2025-07-09 Marco Mattuschka , Noah An der Lan , Max von Danwitz , Daniel Wolff , Alexander Popp

This paper proposes an iterative distributionally robust model predictive control (MPC) scheme to solve a risk-constrained infinite-horizon optimal control problem. In each iteration, the algorithm generates a trajectory from the starting…

Optimization and Control · Mathematics 2023-08-23 Alireza Zolanvari , Ashish Cherukuri

This paper presents a novel decentralized control strategy for a multi-robot system that enables parallel multi-target exploration while ensuring a time-varying connected topology in cluttered 3D environments. Flexible continuous…

Robotics · Computer Science 2017-03-17 Thomas Nestmeyer , Paolo Robuffo Giordano , Heinrich H. Bülthoff , Antonio Franchi

This paper proposes a push and pull search (PPS) framework for solving constrained multi-objective optimization problems (CMOPs). To be more specific, the proposed PPS divides the search process into two different stages, including the push…

Neural and Evolutionary Computing · Computer Science 2017-09-19 Zhun Fan , Wenji Li , Xinye Cai , Hui Li , Caimin Wei , Qingfu Zhang , Kalyanmoy Deb , Erik D. Goodman

We introduce and analyse two algorithms for exploration-exploitation in discrete and continuous Markov Decision Processes (MDPs) based on exploration bonuses. SCAL$^+$ is a variant of SCAL (Fruit et al., 2018) that performs efficient…

Machine Learning · Computer Science 2018-12-12 Jian Qian , Ronan Fruit , Matteo Pirotta , Alessandro Lazaric

We propose MDP-GapE, a new trajectory-based Monte-Carlo Tree Search algorithm for planning in a Markov Decision Process in which transitions have a finite support. We prove an upper bound on the number of calls to the generative models…

Machine Learning · Computer Science 2020-06-11 Anders Jonsson , Emilie Kaufmann , Pierre Ménard , Omar Darwiche Domingues , Edouard Leurent , Michal Valko

Distributed algorithms for solving coupled semidefinite programs (SDPs) commonly require many iterations to converge. They also put high computational demand on the computational agents. In this paper we show that in case the coupled…

Optimization and Control · Mathematics 2015-04-30 Sina Khoshfetrat Pakazad , Anders Hansson , Martin S. Andersen , Anders Rantzer

Efficient robotic exploration of unknown, sensor limited, global-information-deficient environments poses unique challenges to path planning algorithms. In these difficult environments, no deterministic guarantees on path completion and…

Robotics · Computer Science 2017-05-01 Alexander Ivanov , Mark Campbell

Despite the close connection between exploration and sample efficiency, most state of the art reinforcement learning algorithms include no considerations for exploration beyond maximizing the entropy of the policy. In this work we address…

Model-based deep reinforcement learning has achieved success in various domains that require high sample efficiencies, such as Go and robotics. However, there are some remaining issues, such as planning efficient explorations to learn more…

Machine Learning · Computer Science 2021-07-06 Yao Yao , Li Xiao , Zhicheng An , Wanpeng Zhang , Dijun Luo

To address the problem of combined heat and power economic emission dispatch (CHPEED), a two-stage approach is proposed by combining multi-objective optimization (MOO) with integrated decision making (IDM). First, a practical CHPEED model…

Optimization and Control · Mathematics 2018-08-22 Yang Li , Jinlong Wang , Dongbo Zhao , Guoqing Li , Chen Chen

We present MBAPPE, a novel approach to motion planning for autonomous driving combining tree search with a partially-learned model of the environment. Leveraging the inherent explainable exploration and optimization capabilities of the…

Robotics · Computer Science 2023-09-18 Raphael Chekroun , Thomas Gilles , Marin Toromanoff , Sascha Hornauer , Fabien Moutarde

Data-enabled predictive control (DeePC) is a recently proposed approach that combines system identification, estimation and control in a single optimization problem, for which only recorded input/output data of the examined system is…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Felix Fiedler , Sergio Lucia

Early Exiting (EE) is a promising technique for speeding up inference by adaptively allocating compute resources to data points based on their difficulty. The approach enables predictions to exit at earlier layers for simpler samples while…

Machine Learning · Computer Science 2024-12-30 Mehrnaz Mofakhami , Reza Bayat , Ioannis Mitliagkas , Joao Monteiro , Valentina Zantedeschi

We consider the joint design and control of discrete-time stochastic dynamical systems over a finite time horizon. We formulate the problem as a multi-step optimization problem under uncertainty seeking to identify a system design and a…

Machine Learning · Computer Science 2022-01-07 Adrien Bolland , Ioannis Boukas , Mathias Berger , Damien Ernst

A dual adaptive model predictive control (MPC) algorithm is presented for linear, time-invariant systems subject to bounded disturbances and parametric uncertainty in the state-space matrices. Online set-membership identification is…

Systems and Control · Electrical Eng. & Systems 2021-02-23 Anilkumar Parsi , Andrea Iannelli , Roy S. Smith

Stochastic differential equations (SDEs) provide a natural framework for modelling intrinsic stochasticity inherent in many continuous-time physical processes. When such processes are observed in multiple individuals or experimental units,…

Computation · Statistics 2016-05-19 Gavin A. Whitaker , Andrew Golightly , Richard J. Boys , Chris Sherlock

In this paper, a maximum torque per ampere (MTPA) control strategy for the interior permanent magnet synchronous motor (IPMSM) using dual control for exploration and exploitation (DCEE). In the proposed method, the permanent magnet flux and…

Systems and Control · Electrical Eng. & Systems 2024-04-30 Yuefei Zuo , Yalei Yu , Jun Yang , Wen-Hua Chen

This paper introduces a novel concept, fuzzy-logic-based model predictive control (FLMPC), along with a multi-robot control approach for exploring unknown environments and locating targets. Traditional model predictive control (MPC) methods…

Robotics · Computer Science 2025-03-28 Filip Surma , Anahita Jamshidnejad

Automated vehicles require efficient and safe planning to maneuver in uncertain environments. Largely this uncertainty is caused by other traffic participants, e.g., surrounding vehicles. Future motion of surrounding vehicles is often…

Systems and Control · Electrical Eng. & Systems 2022-06-09 Tim Brüdigam , Michael Olbrich , Dirk Wollherr , Marion Leibold