English
Related papers

Related papers: Learning Planning Abstractions from Language

200 papers

The transition kernel of a continuous-state-action Markov decision process (MDP) admits a natural tensor structure. This paper proposes a tensor-inspired unsupervised learning method to identify meaningful low-dimensional state and action…

Machine Learning · Statistics 2023-02-21 Chengzhuo Ni , Yaqi Duan , Munther Dahleh , Anru Zhang , Mengdi Wang

Active learning is a machine learning approach for reducing the data labeling effort. Given a pool of unlabeled samples, it tries to select the most useful ones to label so that a model built from them can achieve the best possible…

Machine Learning · Computer Science 2020-03-31 Dongrui Wu

This work leverages adaptive social learning to estimate partially observable global states in multi-agent reinforcement learning (MARL) problems. Unlike existing methods, the proposed approach enables the concurrent operation of social…

Multiagent Systems · Computer Science 2025-08-11 Ainur Zhaikhan , Malek Khammassi , Ali H. Sayed

Meta-planning, or learning to guide planning from experience, is a promising approach to improving the computational cost of planning. A general meta-planning strategy is to learn to impose constraints on the states considered and actions…

Machine Learning · Computer Science 2020-11-10 Rohan Chitnis , Tom Silver , Beomjoon Kim , Leslie Pack Kaelbling , Tomas Lozano-Perez

Exploration capacity shapes both inference-time performance and reinforcement learning (RL) training for large (vision-) language models, as stochastic sampling often yields redundant reasoning paths with little high-level diversity. This…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Rujiao Long , Yang Li , Xingyao Zhang , Weixun Wang , Tianqianjin Lin , Xi Zhao , Yuchi Xu , Wenbo Su , Junchi Yan , Bo Zheng

Temporal action abstractions, along with belief state representations, are a powerful knowledge sharing mechanism for sequential decision making. In this work, we propose a novel view that treats inducing temporal action abstractions as a…

Machine Learning · Computer Science 2024-06-07 Ruijie Zheng , Ching-An Cheng , Hal Daumé , Furong Huang , Andrey Kolobov

Abstraction is a fundamental part when learning behavioral models of systems. Usually the process of abstraction is manually defined by domain experts. This paper presents a method to perform automatic abstraction for network protocols. In…

Machine Learning · Computer Science 2018-06-05 Tobias Schrank , Franz Pernkopf

Goals express agents' intentions and allow them to organize their behavior based on low-dimensional abstractions of high-dimensional world states. How can agents develop such goals autonomously? This paper proposes a detailed conceptual and…

Machine Learning · Computer Science 2014-10-22 Matthias Rolf , Minoru Asada

Accuracy and generalization of dynamics models is key to the success of model-based reinforcement learning (MBRL). As the complexity of tasks increases, so does the sample inefficiency of learning accurate dynamics models. However, many…

Machine Learning · Computer Science 2021-06-08 Manan Tomar , Amy Zhang , Roberto Calandra , Matthew E. Taylor , Joelle Pineau

While humans readily generalize abstract concepts to more complex or larger tasks, building Reinforcement Learning (RL) systems with this ability remains elusive. Here, we present the first theoretical model of how such Out-of-Distribution…

Machine Learning · Computer Science 2026-05-21 Nasehatul Mustakim , Lucas Lehnert

Point-Level temporal action localization (PTAL) aims to localize actions in untrimmed videos with only one timestamp annotation for each action instance. Existing methods adopt the frame-level prediction paradigm to learn from the sparse…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Chen Ju , Peisen Zhao , Ya Zhang , Yanfeng Wang , Qi Tian

Large language model (LLM)-based agents have recently gained considerable attention due to the powerful reasoning capabilities of LLMs. Existing research predominantly focuses on enhancing the task performance of these agents in diverse…

Multiagent Systems · Computer Science 2026-04-02 Dayong Ye , Tainqing Zhu , Congcong Zhu , Feng He , Qi He , Shang Wang , Bo Liu , Wanlei Zhou

A central problem in artificial intelligence is that of planning to maximize future reward under uncertainty in a partially observable environment. In this paper we propose and demonstrate a novel algorithm which accurately learns a model…

Machine Learning · Computer Science 2009-12-15 Byron Boots , Sajid M. Siddiqi , Geoffrey J. Gordon

Intelligent agents can learn to represent the action spaces of other agents simply by observing them act. Such representations help agents quickly learn to predict the effects of their own actions on the environment and to plan complex…

Machine Learning · Computer Science 2019-02-13 Oleh Rybkin , Karl Pertsch , Konstantinos G. Derpanis , Kostas Daniilidis , Andrew Jaegle

Decision making via sequence modeling aims to mimic the success of language models, where actions taken by an embodied agent are modeled as tokens to predict. Despite their promising performance, it remains unclear if embodied sequence…

Machine Learning · Computer Science 2023-11-08 Tian Yun , Zilai Zeng , Kunal Handa , Ashish V. Thapliyal , Bo Pang , Ellie Pavlick , Chen Sun

Humans tame the complexity of mathematical reasoning by developing hierarchies of abstractions. With proper abstractions, solutions to hard problems can be expressed concisely, thus making them more likely to be found. In this paper, we…

Artificial Intelligence · Computer Science 2022-11-17 Zhening Li , Gabriel Poesia , Omar Costilla-Reyes , Noah Goodman , Armando Solar-Lezama

Robot motion planning involves computing a sequence of valid robot configurations that take the robot from its initial state to a goal state. Solving a motion planning problem optimally using analytical methods is proven to be PSPACE-Hard.…

Robotics · Computer Science 2021-07-26 Naman Shah , Abhyudaya Srinet , Siddharth Srivastava

Process-Mining techniques aim to use event data about past executions to gain insight into how processes are executed. While these techniques are proven to be very valuable, they are less successful to reach their goal if the process is…

Artificial Intelligence · Computer Science 2019-06-04 Massimiliano de Leoni , Safa Dundar

Despite significant progress in Visual-Language-Action (VLA), in highly complex and dynamic environments that involve real-time unpredictable interactions (such as 3D open worlds and large-scale PvP games), existing approaches remain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Zheyuan Zhou , Liang Du , Zixun Sun , Xiaoyu Zhou , Ruimin Ye , Qihao Chen , Yinda Chen , Lemiao Qiu

We describe the algorithms used by the ALEKS computer learning system for manipulating combinatorial descriptions of human learners' states of knowledge, generating all states that are possible according to a description of a learning space…

Discrete Mathematics · Computer Science 2008-03-31 David Eppstein