English
Related papers

Related papers: Accelerated Multi-objective Task Learning using Mo…

200 papers

We develop methodology for a multistage decision problem with flexible number of stages in which the rewards are survival times that are subject to censoring. We present a novel Q-learning algorithm that is adjusted for censored data and…

Statistics Theory · Mathematics 2012-05-31 Yair Goldberg , Michael R. Kosorok

Extracting a known target object from a pile of other objects in a cluttered environment is a challenging robotic manipulation task encountered in many robotic applications. In such conditions, the target object touches or is covered by…

Robotics · Computer Science 2020-02-28 Iason Sarantopoulos , Marios Kiatos , Zoe Doulgeri , Sotiris Malassiotis

The optimistic nature of the Q-learning target leads to an overestimation bias, which is an inherent problem associated with standard $Q-$learning. Such a bias fails to account for the possibility of low returns, particularly in risky…

Machine Learning · Computer Science 2021-11-05 Thommen George Karimpanal , Hung Le , Majid Abdolshah , Santu Rana , Sunil Gupta , Truyen Tran , Svetha Venkatesh

Q-learning is widely used algorithm in reinforcement learning community. Under the lookup table setting, its convergence is well established. However, its behavior is known to be unstable with the linear function approximation case. This…

Machine Learning · Computer Science 2025-02-11 Han-Dong Lim , Donghwan Lee

Q-learning suffers from overestimation bias, because it approximates the maximum action value using the maximum estimated action value. Algorithms have been proposed to reduce overestimation bias, but we lack an understanding of how bias…

Machine Learning · Computer Science 2021-08-10 Qingfeng Lan , Yangchen Pan , Alona Fyshe , Martha White

Quality Diversity (QD) algorithms are a recent family of optimization algorithms that search for a large set of diverse but high-performing solutions. In some specific situations, they can solve multiple tasks at once. For instance, they…

Neural and Evolutionary Computing · Computer Science 2020-04-20 Jean-Baptiste Mouret , Glenn Maguire

Q-learning is widely used to optimize wireless networks with unknown system dynamics. Recent advancements include ensemble multi-environment hybrid Q-learning algorithms, which utilize multiple Q-learning algorithms across structurally…

Signal Processing · Electrical Eng. & Systems 2024-09-02 Talha Bozkus , Urbashi Mitra

Communication efficiency is a major bottleneck in the applications of distributed networks. To address the problem, the problem of quantized distributed optimization has attracted a lot of attention. However, most of the existing quantized…

Optimization and Control · Mathematics 2022-11-01 Yongyang Xiong , Ligang Wu , Keyou You , Lihua Xie

The numerous deployed Artificial Intelligence systems need to be aligned with our ethical considerations. However, such ethical considerations might change as time passes: our society is not fixed, and our social mores evolve. This makes it…

Machine Learning · Computer Science 2023-07-04 Rémy Chaput , Olivier Boissier , Mathieu Guillermin

In many real-world scenarios involving high-stakes and safety implications, a human decision-maker (HDM) may receive recommendations from an artificial intelligence while holding the ultimate responsibility of making decisions. In this…

Machine Learning · Computer Science 2024-07-18 Ioannis Faros , Aditya Dave , Andreas A. Malikopoulos

Despite recent progress in robot learning, it still remains a challenge to program a robot to deal with open-ended object manipulation tasks. One approach that was recently used to autonomously generate a repertoire of diverse skills is a…

Artificial Intelligence · Computer Science 2020-08-12 Leon Keller , Daniel Tanneberg , Svenja Stark , Jan Peters

This study evaluates the application of a discrete action space reinforcement learning method (Q-learning) to the continuous control problem of robot inverted pendulum balancing. To speed up the learning process and to overcome technical…

Robotics · Computer Science 2023-12-06 Mohammad Safeea , Pedro Neto

Learning algorithms, like Quality-Diversity (QD), can be used to acquire repertoires of diverse robotics skills. This learning is commonly done via computer simulation due to the large number of evaluations required. However, training in a…

Robotics · Computer Science 2023-04-25 Simón C. Smith , Bryan Lim , Hannah Janmohamed , Antoine Cully

This paper studies distributed Q-learning for Linear Quadratic Regulator (LQR) in a multi-agent network. The existing results often assume that agents can observe the global system state, which may be infeasible in large-scale systems due…

Multiagent Systems · Computer Science 2020-12-24 Hang Wang , Sen Lin , Hamid Jafarkhani , Junshan Zhang

We consider the problem of federated Q-learning, where $M$ agents aim to collaboratively learn the optimal Q-function of an unknown infinite-horizon Markov decision process with finite state and action spaces. We investigate the trade-off…

Machine Learning · Computer Science 2024-10-31 Sudeep Salgia , Yuejie Chi

Efficient learning from demonstration for long-horizon tasks remains an open challenge in robotics. While significant effort has been directed toward learning trajectories, a recent resurgence of object-centric approaches has demonstrated…

Robotics · Computer Science 2025-12-01 Adrian Röfer , Russell Buchanan , Max Argus , Sethu Vijayakumar , Abhinav Valada

The ongoing rise in cyberattacks and the lack of skilled professionals in the cybersecurity domain to combat these attacks show the need for automated tools capable of detecting an attack with good performance. Attackers disguise their…

Artificial Intelligence · Computer Science 2023-03-13 Arti Bandhana , Ondřej Lukáš , Sebastian Garcia , Tomáš Kroupa

In many real world applications, reinforcement learning agents have to optimize multiple objectives while following certain rules or satisfying a list of constraints. Classical methods based on reward shaping, i.e. a weighted combination of…

Machine Learning · Computer Science 2020-09-15 Gabriel Kalweit , Maria Huegle , Moritz Werling , Joschka Boedecker

In this paper, we present a synergic learning algorithm to address the task of indirect manipulation of an unknown deformable tissue. Tissue manipulation is a common yet challenging task in various surgical interventions, which makes it a…

Meta-learning empowers artificial intelligence to increase its efficiency by learning how to learn. Unlocking this potential involves overcoming a challenging meta-optimisation problem. We propose an algorithm that tackles this problem by…

Machine Learning · Computer Science 2022-03-17 Sebastian Flennerhag , Yannick Schroecker , Tom Zahavy , Hado van Hasselt , David Silver , Satinder Singh