English
Related papers

Related papers: World Model as a Graph: Learning Latent Landmarks …

200 papers

The Aircraft Landing Problem (ALP) is one of the challenging problems in aircraft transportation and management. The challenge is to schedule the arriving aircraft in a sequence so that the cost and delays are optimized. There are various…

Machine Learning · Computer Science 2025-03-19 Vatsal Maru

Offline Reinforcement learning (RL) has shown potent in many safe-critical tasks in robotics where exploration is risky and expensive. However, it still struggles to acquire skills in temporally extended tasks. In this paper, we study the…

Robotics · Computer Science 2022-05-25 Jinning Li , Chen Tang , Masayoshi Tomizuka , Wei Zhan

Reinforcement Learning (RL) has emerged as a powerful paradigm in Artificial Intelligence (AI), enabling agents to learn optimal behaviors through interactions with their environments. Drawing from the foundations of trial and error, RL…

Artificial Intelligence · Computer Science 2025-02-04 Majid Ghasemi , Amir Hossein Moosavi , Dariush Ebrahimi

In planning and reinforcement learning, the identification of common subgoal structures across problems is important when goals are to be achieved over long horizons. Recently, it has been shown that such structures can be expressed as…

Artificial Intelligence · Computer Science 2025-08-18 Michael Aichmüller , Hector Geffner

Robust coordination is critical for effective decision-making in multi-agent systems, especially under partial observability. A central question in Multi-Agent Reinforcement Learning (MARL) is whether to engineer communication protocols or…

Multiagent Systems · Computer Science 2025-11-25 Brennen A. Hill , Mant Koh En Wei , Thangavel Jishnuanandh

We study multi-agent reinforcement learning (MARL) for tasks in complex high-dimensional environments, such as autonomous driving. MARL is known to suffer from the \textit{partial observability} and \textit{non-stationarity} issues. To…

Robotics · Computer Science 2025-06-11 Hang Wang , Dechen Gao , Junshan Zhang

To achieve scenario intelligence, humans must transfer knowledge to robots by developing goal-oriented algorithms, which are sometimes insensitive to dynamically changing environments. While deep reinforcement learning achieves significant…

Artificial Intelligence · Computer Science 2018-07-31 Tingguang Li , Jin Pan , Delong Zhu , Max Q. -H. Meng

Graph learning is a popular approach for performing machine learning on graph-structured data. It has revolutionized the machine learning ability to model graph data to address downstream tasks. Its application is wide due to the…

Machine Learning · Computer Science 2022-11-07 Falih Gozi Febrinanto , Feng Xia , Kristen Moore , Chandra Thapa , Charu Aggarwal

Methods of deep machine learning enable to to reuse low-level representations efficiently for generating more abstract high-level representations. Originally, deep learning has been applied passively (e.g., for classification purposes).…

Machine Learning · Computer Science 2014-12-22 Mark Wernsdorfer , Ute Schmid

Mission planning for a fleet of cooperative autonomous drones in applications that involve serving distributed target points, such as disaster response, environmental monitoring, and surveillance, is challenging, especially under partial…

Multiagent Systems · Computer Science 2025-04-14 Michael Elrod , Niloufar Mehrabi , Rahul Amin , Manveen Kaur , Long Cheng , Jim Martin , Abolfazl Razi

We propose a new framework for discovering landmarks that automatically generalize across a domain. These generalized landmarks are learned from a set of solved instances and describe intermediate goals for planning problems where…

Artificial Intelligence · Computer Science 2025-09-01 Issa Hanou , Sebastijan Dumančić , Mathijs de Weerdt

Real-time traffic prediction from high-fidelity spatiotemporal traffic sensor datasets is an important problem for intelligent transportation systems and sustainability. However, it is challenging due to the complex topological dependencies…

Social and Information Networks · Computer Science 2016-07-22 Dingxiong Deng , Cyrus Shahabi , Ugur Demiryurek , Linhong Zhu , Rose Yu , Yan Liu

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

Machine Learning · Computer Science 2023-04-04 Marc Rigter

Random delays weaken the temporal correspondence between actions and subsequent state feedback, making it difficult for agents to identify the true propagation process of action effects. In cross-task scenarios, changes in task objectives…

Machine Learning · Computer Science 2026-05-13 Chenran Zhao , Dianxi Shi , Yaowen Zhang , Chunping Qiu , Shaowu Yang

We present a two-step hybrid reinforcement learning (RL) policy that is designed to generate interpretable and robust hierarchical policies on the RL problem with graph-based input. Unlike prior deep reinforcement learning policies…

Machine Learning · Computer Science 2022-10-20 Tongzhou Mu , Kaixiang Lin , Feiyang Niu , Govind Thattai

Learning robust and generalizable world models is crucial for enabling efficient and scalable robotic control in real-world environments. In this work, we introduce a novel framework for learning world models that accurately capture…

Robotics · Computer Science 2025-12-16 Chenhao Li , Andreas Krause , Marco Hutter

World models enable robots to conduct counterfactual reasoning in physical environments by predicting future world states. While conventional approaches often prioritize pixel-level reconstruction of future scenes, such detailed rendering…

Robotics · Computer Science 2025-12-22 Zhiwei Zhang , Hui Zhang , Kaihong Huang , Chenghao Shi , Huimin Lu

Inverse reinforcement learning (IRL) offers a powerful and general framework for learning humans' latent preferences in route recommendation, yet no approach has successfully addressed planetary-scale problems with hundreds of millions of…

Machine Learning · Computer Science 2024-03-07 Matt Barnes , Matthew Abueg , Oliver F. Lange , Matt Deeds , Jason Trader , Denali Molitor , Markus Wulfmeier , Shawn O'Banion

The ability to plan actions on multiple levels of abstraction enables intelligent agents to solve complex tasks effectively. However, learning the models for both low and high-level planning from demonstrations has proven challenging,…

Artificial Intelligence · Computer Science 2023-05-30 Kalle Kujanpää , Joni Pajarinen , Alexander Ilin

We consider the problem of indoor building-scale social navigation, where the robot must reach a point goal as quickly as possible without colliding with humans who are freely moving around. Factors such as varying crowd densities,…

Robotics · Computer Science 2025-06-04 Arnab Debnath , Gregory J. Stein , Jana Kosecka