English
Related papers

Related papers: Intrinsic Robotic Introspection: Learning Internal…

200 papers

In this paper, we propose actor-director-critic, a new framework for deep reinforcement learning. Compared with the actor-critic framework, the director role is added, and action classification and action evaluation are applied…

Machine Learning · Computer Science 2023-01-11 Zongwei Liu , Yonghong Song , Yuanlin Zhang

This work presents an architecture that generates curiosity-driven goal-directed exploration behaviours for an image sensor of a microfarming robot. A combination of deep neural networks for offline unsupervised learning of low-dimensional…

Artificial Intelligence · Computer Science 2020-06-09 Guido Schillaci , Antonio Pico Villalpando , Verena Vanessa Hafner , Peter Hanappe , David Colliaux , Timothée Wintz

In this work, we propose Behavior-Guided Actor-Critic (BAC), an off-policy actor-critic deep RL algorithm. BAC mathematically formulates the behavior of the policy through autoencoders by providing an accurate estimation of how frequently…

Machine Learning · Computer Science 2021-04-12 Ammar Fayad , Majd Ibrahim

In a robot-centered smart home, the robot observes the home states with its own sensors, and then it can change certain object states according to an operator's commands for remote operations, or imitate the operator's behaviors in the…

Robotics · Computer Science 2015-04-21 Kun Li , Max Q. -H. Meng

In this paper we present a fully autonomous and intrinsically motivated robot usable for HRI experiments. We argue that an intrinsically motivated approach based on the Predictive Information formalism, like the one presented here, could…

Human-Computer Interaction · Computer Science 2019-07-19 Marcus M. Scheunemann , Christoph Salge , Kerstin Dautenhahn

Infants are experts at playing, with an amazing ability to generate novel structured behaviors in unstructured environments that lack clear extrinsic reward signals. We seek to mathematically formalize these abilities using a neural network…

Machine Learning · Computer Science 2018-11-01 Nick Haber , Damian Mrowca , Li Fei-Fei , Daniel L. K. Yamins

Neurons can display highly variable dynamics. While such variability presumably supports the wide range of behaviors generated by the organism, their gene expressions are relatively stable in the adult brain. This suggests that neuronal…

Neurons and Cognition · Quantitative Biology 2023-11-07 Lu Mi , Trung Le , Tianxing He , Eli Shlizerman , Uygar Sümbül

Explainable reinforcement learning allows artificial agents to explain their behavior in a human-like manner aiming at non-expert end-users. An efficient alternative of creating explanations is to use an introspection-based method that…

Machine Learning · Computer Science 2021-08-23 Angel Ayala , Francisco Cruz , Bruno Fernandes , Richard Dazeley

In recent years many methods have been developed to understand the internal workings of neural networks, often by describing the function of individual neurons in the model. However, these methods typically only focus on explaining the very…

Machine Learning · Computer Science 2024-05-14 Tuomas Oikarinen , Tsui-Wei Weng

Reinforcement learning methods require careful design involving a reward function to obtain the desired action policy for a given task. In the absence of hand-crafted reward functions, prior work on the topic has proposed several methods…

Machine Learning · Computer Science 2018-10-16 Daiki Kimura , Subhajit Chaudhury , Ryuki Tachibana , Sakyasingha Dasgupta

We focus on a simulation-based optimization problem of choosing the best design from the feasible space. Although the simulation model can be queried with finite samples, its internal processing rule cannot be utilized in the optimization…

Machine Learning · Computer Science 2021-11-02 Kuo Li , Qing-Shan Jia , Jiaqi Yan

Neural nets are powerful function approximators, but the behavior of a given neural net, once trained, cannot be easily modified. We wish, however, for people to be able to influence neural agents' actions despite the agents never training…

Machine Learning · Computer Science 2022-02-01 Mycal Tucker , William Kuhl , Khizer Shahid , Seth Karten , Katia Sycara , Julie Shah

Recurrent neural networks (RNNs) for reinforcement learning (RL) have shown distinct advantages, e.g., solving memory-dependent tasks and meta-learning. However, little effort has been spent on improving RNN architectures and on…

Machine Learning · Computer Science 2019-11-27 Dongqi Han , Kenji Doya , Jun Tani

Learning about many things can provide numerous benefits to a reinforcement learning system. For example, learning many auxiliary value functions, in addition to optimizing the environmental reward, appears to improve both exploration and…

Machine Learning · Computer Science 2020-08-25 Cam Linke , Nadia M. Ady , Martha White , Thomas Degris , Adam White

One effective approach for equipping artificial agents with sensorimotor skills is to use self-exploration. To do this efficiently is critical, as time and data collection are costly. In this study, we propose an exploration mechanism that…

Robotics · Computer Science 2021-02-18 Melisa Sener , Yukie Nagai , Erhan Oztop , Emre Ugur

Humans acquire knowledge by observing the external world, but also by introspection. Introspection gives a person privileged access to their current state of mind (e.g., thoughts and feelings) that is not accessible to external observers.…

Computation and Language · Computer Science 2024-10-18 Felix J Binder , James Chua , Tomek Korbak , Henry Sleight , John Hughes , Robert Long , Ethan Perez , Miles Turpin , Owain Evans

Vision-based deep learning perception fulfills a paramount role in robotics, facilitating solutions to many challenging scenarios, such as acrobatic maneuvers of autonomous unmanned aerial vehicles (UAVs) and robot-assisted high-precision…

Robotics · Computer Science 2024-08-06 Elia Cereda , Stefano Bonato , Mirko Nava , Alessandro Giusti , Daniele Palossi

Humans integrate multiple sensory modalities (e.g. visual and audio) to build a causal understanding of the physical world. In this work, we propose a novel type of intrinsic motivation for Reinforcement Learning (RL) that encourages the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Chuang Gan , Xiaoyu Chen , Phillip Isola , Antonio Torralba , Joshua B. Tenenbaum

This paper contributes a first study into how different human users deliver simultaneous control and feedback signals during human-robot interaction. As part of this work, we formalize and present a general interactive learning framework…

Artificial Intelligence · Computer Science 2017-03-16 Kory W. Mathewson , Patrick M. Pilarski

Recent advances in robot learning have enabled robots to become increasingly better at mastering a predefined set of tasks. On the other hand, as humans, we have the ability to learn a growing set of tasks over our lifetime. Continual robot…

Robotics · Computer Science 2021-12-21 Muhammad Burhan Hafez , Stefan Wermter