English
Related papers

Related papers: An Entropy-Based Model for Hierarchical Learning

200 papers

Empirical data can often be considered as samples from a set of probability distributions. Kernel methods have emerged as a natural approach for learning to classify these distributions. Although numerous kernels between distributions have…

Machine Learning · Computer Science 2024-12-02 Oleksii Kachaiev , Stefano Recanatesi

Sequence models in reinforcement learning require task knowledge to estimate the task policy. This paper presents a hierarchical algorithm for learning a sequence model from demonstrations. The high-level mechanism guides the low-level…

Machine Learning · Computer Science 2022-09-22 André Correia , Luís A. Alexandre

Hierarchical reinforcement learning has been a compelling approach for achieving goal directed behavior over long sequences of actions. However, it has been challenging to implement in realistic or open-ended environments. A main challenge…

Machine Learning · Computer Science 2023-09-22 Arun Ahuja , Kavya Kopparapu , Rob Fergus , Ishita Dasgupta

Much effort has been devoted to evaluate whether multi-task learning can be leveraged to learn rich representations that can be used in various Natural Language Processing (NLP) down-stream applications. However, there is still a lack of…

Computation and Language · Computer Science 2018-11-27 Victor Sanh , Thomas Wolf , Sebastian Ruder

In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization…

Probability · Mathematics 2018-03-30 C. Soizea , R. Ghanem , C. Safta , X. Huan , Z. P. Vane , J. Oefelein , G. Lacaz , H. N. Najm , Q. Tang , X. Chen

Assisted by the availability of data and high performance computing, deep learning techniques have achieved breakthroughs and surpassed human performance empirically in difficult tasks, including object recognition, speech recognition, and…

Machine Learning · Computer Science 2019-01-23 Shaeke Salman , Xiuwen Liu

Deep learning achieves remarkable generalization capability with overwhelming number of model parameters. Theoretical understanding of deep learning generalization receives recent attention yet remains not fully explored. This paper…

Machine Learning · Computer Science 2017-11-22 Guanhua Zheng , Jitao Sang , Changsheng Xu

E-learning systems are capable of providing more adaptive and efficient learning experiences for students than the traditional classroom setting. A key component of such systems is the learning strategy, the algorithm that designs the…

Machine Learning · Computer Science 2018-10-15 Xiao Li , Hanchen Xu , Jinming Zhang , Hua-hua Chang

Hierarchy in reinforcement learning agents allows for control at multiple time scales yielding improved sample efficiency, the ability to deal with long time horizons and transferability of sub-policies to tasks outside the training…

Machine Learning · Computer Science 2019-06-27 Zach Dwiel , Madhavun Candadai , Mariano Phielipp , Arjun K. Bansal

A mainstream type of current self-supervised learning methods pursues a general-purpose representation that can be well transferred to downstream tasks, typically by optimizing on a given pretext task such as instance discrimination. In…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Xin Liu , Zhongdao Wang , Yali Li , Shengjin Wang

Machine learning is usually defined in behaviourist terms, where external validation is the primary mechanism of learning. In this paper, I argue for a more holistic interpretation in which finding more probable, efficient and abstract…

Artificial Intelligence · Computer Science 2017-11-07 Johan Loeckx

The goal of meta-learning is to train a model on a variety of learning tasks, such that it can adapt to new problems within only a few iterations. Here we propose a principled information-theoretic model that optimally partitions the…

Machine Learning · Statistics 2020-09-10 Heinke Hihn , Daniel A. Braun

A learning algorithm based on primary school teaching and learning is presented. The methodology is to continuously evaluate a student and to give them training on the examples for which they repeatedly fail, until, they can correctly…

Artificial Intelligence · Computer Science 2010-12-14 Ninan Sajeeth Philip

Generalization and adaptation of learned skills to novel situations is a core requirement for intelligent autonomous robots. Although contextual reinforcement learning provides a principled framework for learning and generalization of…

Machine Learning · Computer Science 2019-10-08 Pascal Klink , Hany Abdulsamad , Boris Belousov , Jan Peters

Well-calibrated probabilistic regression models are a crucial learning component in robotics applications as datasets grow rapidly and tasks become more complex. Unfortunately, classical regression models are usually either probabilistic…

Machine Learning · Computer Science 2023-09-12 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

A typical way in which a machine acquires knowledge from humans is by programming. Compared to learning from demonstrations or experiences, programmatic learning allows the machine to acquire a novel skill as soon as the program is written,…

Artificial Intelligence · Computer Science 2023-10-19 Leonardo Hernandez Cano , Yewen Pu , Robert D. Hawkins , Josh Tenenbaum , Armando Solar-Lezama

Over the past decade, deep neural networks have proven to be adept in image classification tasks, often surpassing humans in terms of accuracy. However, standard neural networks often fail to understand the concept of hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Amitangshu Mukherjee , Isha Garg , Kaushik Roy

We address the problem of learning hierarchical deep neural network policies for reinforcement learning. In contrast to methods that explicitly restrict or cripple lower layers of a hierarchy to force them to use higher-level modulating…

Machine Learning · Computer Science 2018-09-05 Tuomas Haarnoja , Kristian Hartikainen , Pieter Abbeel , Sergey Levine

Educators teaching entry-level university engineering modules face the challenge of identifying which topics students find most difficult and how to support diverse student needs effectively. This study demonstrates a rigorous yet…

Computers and Society · Computer Science 2025-06-03 Yiwei Sun

How do people decide how long to continue in a task, when to switch, and to which other task? Understanding the mechanisms that underpin task interleaving is a long-standing goal in the cognitive sciences. Prior work suggests greedy…

Artificial Intelligence · Computer Science 2020-01-08 Christoph Gebhardt , Antti Oulasvirta , Otmar Hilliges