English
Related papers

Related papers: Spatio-Temporal Transformer-Based Reinforcement Le…

200 papers

Spatiotemporal predictive learning aims to generate future frames by learning from historical frames. In this paper, we investigate existing methods and present a general framework of spatiotemporal predictive learning, in which the spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Cheng Tan , Zhangyang Gao , Lirong Wu , Yongjie Xu , Jun Xia , Siyuan Li , Stan Z. Li

Neural-based motion planning methods have achieved remarkable progress for robotic manipulators, yet a fundamental challenge lies in simultaneously accounting for both the robot's physical shape and the surrounding environment when…

Robotics · Computer Science 2025-09-16 Kai Chen , Zhihai Bi , Guoyang Zhao , Chunxin Zheng , Yulin Li , Hang Zhao , Jun Ma

In this paper we consider the problem of robot navigation in simple maze-like environments where the robot has to rely on its onboard sensors to perform the navigation task. In particular, we are interested in solutions to this problem that…

Robotics · Computer Science 2017-07-25 Jingwei Zhang , Jost Tobias Springenberg , Joschka Boedecker , Wolfram Burgard

Reinforcement learning is a promising paradigm for solving sequential decision-making problems, but low data efficiency and weak generalization across tasks are bottlenecks in real-world applications. Model-based meta reinforcement learning…

Machine Learning · Computer Science 2021-02-17 Qi Wang , Herke van Hoof

This paper investigates the application of reinforcement learning (RL) to multi-robot social formation navigation, a critical capability for enabling seamless human-robot coexistence. While RL offers a promising paradigm, the inherent…

Robotics · Computer Science 2025-12-17 Hao Fu , Wei Liu , Shuai Zhou

Humans are excellent at understanding language and vision to accomplish a wide range of tasks. In contrast, creating general instruction-following embodied agents remains a difficult challenge. Prior work that uses pure language-only models…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hao Liu , Lisa Lee , Kimin Lee , Pieter Abbeel

In this paper, we focus on the modification of policies that can lead to movement patterns and directional guidance of occupants, which are represented as agents in a 3D simulation engine. We demonstrate an optimization method that improves…

Multiagent Systems · Computer Science 2022-07-20 Xun Zhang , Mathew Schwartz , Muhammad Usman , Petros Faloutsos , Mubbasir Kapadia

Existing multi-agent deep reinforcement learning (MADRL) methods for multi-UAV navigation face challenges in generalization, particularly when applied to unseen complex environments. To address these limitations, we propose a…

Multiagent Systems · Computer Science 2024-10-22 Anning Wei , Jintao Liang , Kaiyuan Lin , Ziyue Li , Rui Zhao

In real-world applications, GPS trajectories often suffer from low sampling rates, with large and irregular intervals between consecutive GPS points. This sparse characteristic presents challenges for their direct use in GPS-based systems.…

Machine Learning · Computer Science 2025-05-21 Tian Sun , Yuqi Chen , Baihua Zheng , Weiwei Sun

Robotic navigation concerns the task in which a robot should be able to find a safe and feasible path and traverse between two points in a complex environment. We approach the problem of robotic navigation using reinforcement learning and…

Robotics · Computer Science 2019-06-18 Muhammad Usama , Dong Eui Chang

We consider the problem of localizing a spatio-temporal tube in a video corresponding to a given text query. This is a challenging task that requires the joint and efficient modeling of temporal, spatial and multi-modal interactions. To…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Antoine Yang , Antoine Miech , Josef Sivic , Ivan Laptev , Cordelia Schmid

Time-evolving traffic flow forecasting are playing a vital role in intelligent transportation systems and smart cities. However, the dynamic traffic flow forecasting is a highly nonlinear problem with complex temporal-spatial dependencies.…

Machine Learning · Computer Science 2025-08-05 Zhenan Lin , Yuni Lai , Wai Lun Lo , Richard Tai-Chiu Hsung , Harris Sik-Ho Tsang , Xiaoyu Xue , Kai Zhou , Yulin Zhu

In this paper, we consider the problem of deploying a robot from a specification given as a temporal logic statement about some properties satisfied by the regions of a large, partitioned environment. We assume that the robot has noisy…

Robotics · Computer Science 2012-02-24 Xu Chu Ding , Jing Wang , Morteza Lahijanian , Ioannis Ch. Paschalidis , Calin A. Belta

We present a relational graph learning approach for robotic crowd navigation using model-based deep reinforcement learning that plans actions by looking into the future. Our approach reasons about the relations between all agents based on…

Robotics · Computer Science 2020-08-05 Changan Chen , Sha Hu , Payam Nikdel , Greg Mori , Manolis Savva

Mining massive spatio-temporal data can help a variety of real-world applications such as city capacity planning, event management, and social network analysis. The tensor representation can be used to capture the correlation between space…

Machine Learning · Computer Science 2020-06-23 Jing Ma , Qiuchen Zhang , Joyce C. Ho , Li Xiong

The common approach for local navigation on challenging environments with legged robots requires path planning, path following and locomotion, which usually requires a locomotion control policy that accurately tracks a commanded velocity.…

Robotics · Computer Science 2022-09-27 Nikita Rudin , David Hoeller , Marko Bjelonic , Marco Hutter

In this paper, we propose a novel Deep Reinforcement Learning approach to address the mapless navigation problem, in which the locomotion actions of a humanoid robot are taken online based on the knowledge encoded in learned models.…

Robotics · Computer Science 2021-08-10 Andre Brandenburger , Diego Rodriguez , Sven Behnke

Policy optimization in high-dimensional continuous control for robotics remains a challenging problem. Predominant methods are inherently local and often require extensive tuning and carefully chosen initial guesses for good performance,…

Robotics · Computer Science 2026-05-01 Buqing Ou , Frederike Dümbgen

Fast and efficient sampling-based motion planning (SMP) is an integral component of many robotic systems, such as autonomous cars. A popular technique to improve the efficiency of these planners is to restrict search space in the planning…

Robotics · Computer Science 2022-11-15 Jacob J. Johnson , Uday S. Kalra , Ankit Bhatia , Linjun Li , Ahmed H. Qureshi , Michael C. Yip

Robots are increasingly integrated across industries, particularly in healthcare. However, many valuable applications for quadrupedal robots remain overlooked. This research explores the effectiveness of three reinforcement learning…

Robotics · Computer Science 2025-07-18 Emma M. A. Harrison