English
Related papers

Related papers: Injecting Prior Knowledge for Transfer Learning in…

200 papers

Multi-agent robotic systems are increasingly operating in real-world environments in close proximity to humans, yet are largely controlled by policy models with inscrutable deep neural network representations. We introduce a method for…

Machine Learning · Computer Science 2023-02-24 Renos Zabounidis , Joseph Campbell , Simon Stepputtis , Dana Hughes , Katia Sycara

Recent advances in reinforcement learning have shown its potential to tackle complex real-life tasks. However, as the dimensionality of the task increases, reinforcement learning methods tend to struggle. To overcome this, we explore…

Computation and Language · Computer Science 2020-02-06 Erez Schwartz , Guy Tennenholtz , Chen Tessler , Shie Mannor

Logical Neural Networks (LNNs) are a type of architecture which combine a neural network's abilities to learn and systems of formal logic's abilities to perform symbolic reasoning. LLNs provide programmers the ability to implicitly modify…

Artificial Intelligence · Computer Science 2022-08-15 Aidan Evans , Jorge Blanco

Neural network-based systems can now learn to locate the referents of words and phrases in images, answer questions about visual scenes, and execute symbolic instructions as first-person actors in partially-observable worlds. To achieve…

Computation and Language · Computer Science 2019-10-02 Felix Hill , Stephen Clark , Karl Moritz Hermann , Phil Blunsom

Deep reinforcement learning (DRL) has achieved significant breakthroughs in various tasks. However, most DRL algorithms suffer a problem of generalizing the learned policy which makes the learning performance largely affected even by minor…

Machine Learning · Computer Science 2019-07-11 Zhengyao Jiang , Shan Luo

Text adventure games, in which players must make sense of the world through text descriptions and declare actions through text descriptions, provide a stepping stone toward grounding action in language. Prior work has demonstrated that…

Computation and Language · Computer Science 2019-08-20 Prithviraj Ammanabrolu , Mark O. Riedl

In this paper, we consider the recent trend of evaluating progress on reinforcement learning technology by using text-based environments and games as evaluation environments. This reliance on text brings advances in natural language…

Artificial Intelligence · Computer Science 2020-05-05 Keerthiram Murugesan , Mattia Atzeni , Pushkar Shukla , Mrinmaya Sachan , Pavan Kapanipathi , Kartik Talamadupula

Language Models and Vision Language Models have recently demonstrated unprecedented capabilities in terms of understanding human intentions, reasoning, scene understanding, and planning-like behaviour, in text form, among many others. In…

Driving in a dynamic, multi-agent, and complex urban environment is a difficult task requiring a complex decision-making policy. The learning of such a policy requires a state representation that can encode the entire environment. Mid-level…

Machine Learning · Computer Science 2021-12-23 Eshagh Kargar , Ville Kyrki

The ability to model the mental states of others is crucial to human social intelligence, and can offer similar benefits to artificial agents with respect to the social dynamics induced in multi-agent settings. We present a method of…

Machine Learning · Computer Science 2023-07-20 Ini Oguntola , Joseph Campbell , Simon Stepputtis , Katia Sycara

We propose a probabilistic framework to directly insert prior knowledge in reinforcement learning (RL) algorithms by defining the behaviour policy as a Bayesian posterior distribution. Such a posterior combines task specific information…

Machine Learning · Computer Science 2018-10-02 Michalis K. Titsias , Sotirios Nikoloutsopoulos

Reinforcement Learning (RL) can enable agents to learn complex tasks. However, it is difficult to interpret the knowledge and reuse it across tasks. Inductive biases can address such issues by explicitly providing generic yet useful…

Artificial Intelligence · Computer Science 2022-12-13 Thomas Schnürer , Malte Probst , Horst-Michael Gross

When training data is scarce, the incorporation of additional prior knowledge can assist the learning process. While it is common to initialize neural networks with weights that have been pre-trained on other large data sets, pre-training…

Machine Learning · Computer Science 2022-05-24 Laura von Rueden , Sebastian Houben , Kostadin Cvejoski , Christian Bauckhage , Nico Piatkowski

Semantic image interpretation can vastly benefit from approaches that combine sub-symbolic distributed representation learning with the capability to reason at a higher level of abstraction. Logic Tensor Networks (LTNs) are a class of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Simone Martone , Francesco Manigrasso , Lamberti Fabrizio , Lia Morra

Humans can quickly learn new behaviors by leveraging background world knowledge. In contrast, agents trained with reinforcement learning (RL) typically learn behaviors from scratch. We thus propose a novel approach that uses the vast…

Machine Learning · Computer Science 2024-05-24 William Chen , Oier Mees , Aviral Kumar , Sergey Levine

Many paralinguistic tasks are closely related and thus representations learned in one domain can be leveraged for another. In this paper, we investigate how knowledge can be transferred between three paralinguistic tasks: speaker, emotion,…

Machine Learning · Computer Science 2017-06-13 John Gideon , Soheil Khorram , Zakaria Aldeneh , Dimitrios Dimitriadis , Emily Mower Provost

How do humans navigate to target objects in novel scenes? Do we use the semantic/functional priors we have built over years to efficiently search and navigate? For example, to search for mugs, we search cabinets near the coffee machine and…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Wei Yang , Xiaolong Wang , Ali Farhadi , Abhinav Gupta , Roozbeh Mottaghi

A crucial challenge in reinforcement learning is to reduce the number of interactions with the environment that an agent requires to master a given task. Transfer learning proposes to address this issue by re-using knowledge from previously…

Machine Learning · Computer Science 2023-04-28 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

Today, the dominant paradigm for training neural networks involves minimizing task loss on a large dataset. Using world knowledge to inform a model, and yet retain the ability to perform end-to-end training remains an open question. In this…

Machine Learning · Computer Science 2020-08-21 Tao Li , Vivek Srikumar

In parallel to their overwhelming success across NLP tasks, language ability of deep Transformer networks, pretrained via language modeling (LM) objectives has undergone extensive scrutiny. While probing revealed that these models encode a…

Computation and Language · Computer Science 2021-10-19 Olga Majewska , Ivan Vulić , Goran Glavaš , Edoardo M. Ponti , Anna Korhonen