English
Related papers

Related papers: Refactoring Policy for Compositional Generalizabil…

200 papers

We propose a framework that learns to execute natural language instructions in an environment consisting of goal-reaching tasks that share components of their task descriptions. Our approach leverages the compositionality of both value…

Machine Learning · Computer Science 2021-10-12 Vanya Cohen , Geraud Nangue Tasse , Nakul Gopalan , Steven James , Matthew Gombolay , Benjamin Rosman

A key feature of human intelligence is the ability to generalize beyond the training distribution, for instance, parsing longer sentences than seen in the past. Currently, deep neural networks struggle to generalize robustly to such shifts…

Machine Learning · Computer Science 2022-02-22 Soham Dan , Osbert Bastani , Dan Roth

We present a new approach to learning for planning, where knowledge acquired while solving a given set of planning problems is used to plan faster in related, but new problem instances. We show that a deep neural network can be used to…

Artificial Intelligence · Computer Science 2018-07-26 Edward Groshev , Maxwell Goldstein , Aviv Tamar , Siddharth Srivastava , Pieter Abbeel

We develop a new class of model-free deep reinforcement learning algorithms for data-driven, learning-based control. Our Generalized Policy Improvement algorithms combine the policy improvement guarantees of on-policy methods with the…

Machine Learning · Computer Science 2024-10-15 James Queeney , Ioannis Ch. Paschalidis , Christos G. Cassandras

Recently, incorporating natural language instructions into reinforcement learning (RL) to learn semantically meaningful representations and foster generalization has caught many concerns. However, the semantical information in language…

Computation and Language · Computer Science 2022-02-02 Yihan Li , Jinsheng Ren , Tianrun Xu , Tianren Zhang , Haichuan Gao , Feng Chen

Combinatorial methods for learning general policies that solve large collections of planning problems have been recently developed. One of their strengths, in relation to deep learning approaches, is that the resulting policies can be…

Artificial Intelligence · Computer Science 2025-09-04 Blai Bonet , Hector Geffner

Compositional generalization-a key open challenge in modern machine learning-requires models to predict unknown combinations of known concepts. However, assessing compositional generalization remains a fundamental challenge due to the lack…

Machine Learning · Computer Science 2025-11-06 Giacomo Camposampiero , Pietro Barbiero , Michael Hersche , Roger Wattenhofer , Abbas Rahimi

In recent years, it has been shown empirically that standard disentangled latent variable models do not support robust compositional learning in the visual domain. Indeed, in spite of being designed with the goal of factorising datasets…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Milton L. Montero , Jeffrey S. Bowers , Gaurav Malhotra

GNN-based approaches for learning general policies across planning domains are limited by the expressive power of $C_2$, namely; first-order logic with two variables and counting. This limitation can be overcame by transitioning to…

Artificial Intelligence · Computer Science 2025-02-19 Simon Ståhlberg , Blai Bonet , Hector Geffner

Compositional generalization is a basic mechanism in human language learning, which current neural networks struggle with. A recently proposed Disentangled sequence-to-sequence model (Dangle) shows promising generalization capability by…

Computation and Language · Computer Science 2022-12-13 Hao Zheng , Mirella Lapata

Compositional generalization, the ability to generate novel combinations of known concepts, is a key ingredient for visual generative models. Yet, not all mechanisms that enable or inhibit it are fully understood. In this work, we conduct a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Karim Farid , Rajat Sahay , Yumna Ali Alnaggar , Simon Schrodi , Volker Fischer , Cordelia Schmid , Thomas Brox

Reinforcement learning presents an attractive paradigm to reason about several distinct aspects of sequential decision making, such as specifying complex goals, planning future observations and actions, and critiquing their utilities.…

Machine Learning · Computer Science 2023-10-31 Siyan Zhao , Aditya Grover

Generalized planning is concerned with the computation of plans that solve not one but multiple instances of a planning domain. Recently, it has been shown that generalized plans can be expressed as mappings of feature values into actions,…

Artificial Intelligence · Computer Science 2018-11-20 Blai Bonet , Guillem Francès , Hector Geffner

Supervised approaches for text summarisation suffer from the problem of mismatch between the target labels/scores of individual sentences and the evaluation score of the final summary. Reinforcement learning can solve this problem by…

Computation and Language · Computer Science 2017-11-15 Diego Molla

Can we learn policies in reinforcement learning without rewards? Can we learn a policy just by trying to reach a goal state? We answer these questions positively by proposing a multi-step procedure that first learns a world model that goes…

Machine Learning · Computer Science 2024-04-16 Marc Höftmann , Jan Robine , Stefan Harmeling

Deep learning models struggle with compositional generalization, i.e. the ability to recognize or generate novel combinations of observed elementary concepts. In hopes of enabling compositional generalization, various unsupervised learning…

Machine Learning · Computer Science 2022-10-07 Zhenlin Xu , Marc Niethammer , Colin Raffel

Subgraph GNNs are provably expressive neural architectures that learn graph representations from sets of subgraphs. Unfortunately, their applicability is hampered by the computational complexity associated with performing message passing on…

Machine Learning · Computer Science 2024-03-22 Beatrice Bevilacqua , Moshe Eliasof , Eli Meirom , Bruno Ribeiro , Haggai Maron

A goal of artificial intelligence is to construct an agent that can solve a wide variety of tasks. Recent progress in text-guided image synthesis has yielded models with an impressive ability to generate complex novel images, exhibiting…

Artificial Intelligence · Computer Science 2023-11-21 Yilun Du , Mengjiao Yang , Bo Dai , Hanjun Dai , Ofir Nachum , Joshua B. Tenenbaum , Dale Schuurmans , Pieter Abbeel

Training a team to complete a complex task via multi-agent reinforcement learning can be difficult due to challenges such as policy search in a large joint policy space, and non-stationarity caused by mutually adapting agents. To facilitate…

Multiagent Systems · Computer Science 2024-02-16 Elliot Fosong , Arrasy Rahman , Ignacio Carlucho , Stefano V. Albrecht

Generalized planning is concerned with the characterization and computation of plans that solve many instances at once. In the standard formulation, a generalized plan is a mapping from feature or observation histories into actions,…

Artificial Intelligence · Computer Science 2018-06-15 Blai Bonet , Hector Geffner