English
Related papers

Related papers: Simultaneous active parameter estimation and contr…

200 papers

The aim of multi-task reinforcement learning is two-fold: (1) efficiently learn by training against multiple tasks and (2) quickly adapt, using limited samples, to a variety of new tasks. In this work, the tasks correspond to reward…

Machine Learning · Computer Science 2019-11-05 Nicholas C. Landolfi , Garrett Thomas , Tengyu Ma

Model free reinforcement learning suffers from the high sampling complexity inherent to robotic manipulation or locomotion tasks. Most successful approaches typically use random sampling strategies which leads to slow policy convergence. In…

Robotics · Computer Science 2019-08-13 Miroslav Bogdanovic , Ludovic Righetti

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years. One of the key challenges in manipulation is the exploration of the dynamics of the environment when…

Robotics · Computer Science 2022-10-25 Tim Schneider , Boris Belousov , Georgia Chalvatzaki , Diego Romeres , Devesh K. Jha , Jan Peters

Inventory management is a fundamental challenge in supply chain management. The challenge is compounded when the associated products have unpredictable demands. This study proposes an innovative optimization approach combining…

Optimization and Control · Mathematics 2024-02-20 Sarit Maitra

This paper proposes a new optimal control synthesis algorithm for multi-robot systems under global temporal logic tasks. Existing planning approaches under global temporal goals rely on graph search techniques applied to a product automaton…

Robotics · Computer Science 2018-06-21 Yiannis Kantaros , Michael M. Zavlanos

Achieving ultimate bounds in estimation processes is the main objective of quantum metrology. In this context, several problems require measurement of multiple parameters by employing only a limited amount of resources. To this end,…

Active search refers to the problem of efficiently locating targets in an unknown environment by actively making data-collection decisions, and has many applications including detecting gas leaks, radiation sources or human survivors of…

Machine Learning · Computer Science 2020-06-29 Ramina Ghods , Arundhati Banerjee , Jeff Schneider

Models of biological systems often have many unknown parameters that must be determined in order for model behavior to match experimental observations. Commonly-used methods for parameter estimation that return point estimates of the…

Quantitative Methods · Quantitative Biology 2018-01-31 Sanjana Gupta , Liam Hainsworth , Justin S. Hogg , Robin E. C. Lee , James R. Faeder

Using Kalman techniques, it is possible to perform optimal estimation in linear Gaussian state-space models. We address here the case where the noise probability density functions are of unknown functional form. A flexible Bayesian…

Statistics Theory · Mathematics 2009-11-13 François Caron , Manuel Davy , Arnaud Doucet , Emmanuel Duflos , Philippe Vanheeghe

Prosumer operators are dealing with extensive challenges to participate in short-term electricity markets while taking uncertainties into account. Challenges such as variation in demand, solar energy, wind power, and electricity prices as…

Machine Learning · Computer Science 2022-03-14 Saeed Mohammadi , Mohammad Reza Hesamzadeh

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

Computation · Statistics 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

Combining model-based and model-free learning systems has been shown to improve the sample efficiency of learning to perform complex robotic tasks. However, dual-system approaches fail to consider the reliability of the learned model when…

Machine Learning · Computer Science 2020-11-03 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

Modeling of physical human-robot collaborations is generally a challenging problem due to the unpredictive nature of human behavior. To address this issue, we present a data-efficient reinforcement learning framework which enables a robot…

Robotics · Computer Science 2016-07-28 Ali Ghadirzadeh , Judith Bütepage , Atsuto Maki , Danica Kragic , Mårten Björkman

Pre-trained generalist policies are rapidly gaining relevance in robot learning due to their promise of fast adaptation to novel, in-domain tasks. This adaptation often relies on collecting new demonstrations for a specific task of interest…

Machine Learning · Computer Science 2025-06-24 Marco Bagatella , Jonas Hübotter , Georg Martius , Andreas Krause

In practice, the parameters of control policies are often tuned manually. This is time-consuming and frustrating. Reinforcement learning is a promising alternative that aims to automate this process, yet often requires too many experiments…

This investigation presents novel adaptive control algorithms specifically designed to address and mitigate thermoacoustic instabilities. Two control strategies are available to alleviate this issue: active and passive. Active control…

Optimization and Control · Mathematics 2024-07-02 Bayu Dharmaputra , Pit Reckinger , Bruno Schuermans , Nicolas Noiray

Multi-robot task allocation is a ubiquitous problem in robotics due to its applicability in a variety of scenarios. Adaptive task-allocation algorithms account for unknown disturbances and unpredicted phenomena in the environment where…

Robotics · Computer Science 2020-11-11 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Magnus Egerstedt

This paper proposes a new randomized strategy for adaptive MCMC using Bayesian optimization. This approach applies to non-differentiable objective functions and trades off exploration and exploitation to reduce the number of potentially…

Computation · Statistics 2011-11-01 Nimalan Mahendran , Ziyu Wang , Firas Hamze , Nando de Freitas

Motivated by many application problems, we consider Markov decision processes (MDPs) with a general loss function and unknown parameters. To mitigate the epistemic uncertainty associated with unknown parameters, we take a Bayesian approach…

Machine Learning · Computer Science 2025-10-02 Xiaoshuang Wang , Yifan Lin , Enlu Zhou