English
Related papers

Related papers: Spatio-Temporal Transformer-Based Reinforcement Le…

200 papers

Numerous locomotion controllers have been designed based on Reinforcement Learning (RL) to facilitate blind quadrupedal locomotion traversing challenging terrains. Nevertheless, locomotion control is still a challenging task for quadruped…

Robotics · Computer Science 2024-07-08 Zhiyuan Xiao , Xinyu Zhang , Xiang Zhou , Qingrui Zhang

Learning how to navigate among humans in an occluded and spatially constrained indoor environment, is a key ability required to embodied agent to be integrated into our society. In this paper, we propose an end-to-end architecture that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Enrico Cancelli , Tommaso Campari , Luciano Serafini , Angel X. Chang , Lamberto Ballan

In the near future, more and more machines will perform tasks in the vicinity of human spaces or support them directly in their spatially bound activities. In order to simplify the verbal communication and the interaction between robotic…

Machine Learning · Computer Science 2020-04-14 Sebastian Feld , Steffen Illium , Andreas Sedlmeier , Lenz Belzner

This study addresses the challenge of integrating social norms into robot navigation, which is essential for ensuring that robots operate safely and efficiently in human-centric environments. Social norms, often unspoken and implicitly…

Robotics · Computer Science 2024-10-14 Junwoo Jang , Maani Ghaffari

Existing works typically treat spatial-temporal prediction as the task of learning a function $F$ to transform historical observations to future observations. We further decompose this cross-time transformation into three processes: (1)…

Artificial Intelligence · Computer Science 2024-12-05 Silu He , Peng Shen , Pingzhen Xu , Qinyao Luo , Haifeng Li

Accurate spatiotemporal pattern analysis is critical in fields such as urban traffic, meteorology, and public health monitoring. However, existing methods face performance bottlenecks, typically yielding only incremental gains and often…

Machine Learning · Computer Science 2026-05-20 Jing Chen , Shixiang Pan , Yujie Fan , Haocheng Ye , Haitao Xu , Wenqiang Xu

Localization in topological maps is essential for image-based navigation using an RGB camera. Localization using only one camera can be challenging in medium-to-large-sized environments because similar-looking images are often observed…

Robotics · Computer Science 2022-04-29 Takahiro Niwa , Shun Taguchi , Noriaki Hirose

Autonomous mobile robots need to perceive the environments with their onboard sensors (e.g., LiDARs and RGB cameras) and then make appropriate navigation decisions. In order to navigate human-inhabited public spaces, such a navigation task…

Robotics · Computer Science 2023-09-25 Bhabaranjan Panigrahi , Amir Hossain Raj , Mohammad Nazeri , Xuesu Xiao

Integrating intelligent systems, such as robots, into dynamic group settings poses challenges due to the mutual influence of human behaviors and internal states. A robust representation of social interaction dynamics is essential for…

Human-Computer Interaction · Computer Science 2024-06-11 J. Taery Kim , Archit Naik , Isuru Jayarathne , Sehoon Ha , Jouh Yeong Chew

Socially aware robot navigation is a planning paradigm where the robot navigates in human environments and tries to adhere to social constraints while interacting with the humans in the scene. These navigation strategies were further…

Robotics · Computer Science 2025-09-01 Hariharan Arunachalam , Phani Teja Singamaneni , Rachid Alami

Mobile robots are being used on a large scale in various crowded situations and become part of our society. The socially acceptable navigation behavior of a mobile robot with individual human consideration is an essential requirement for…

Robotics · Computer Science 2024-07-29 Daniel Flögel , Lars Fischer , Thomas Rudolf , Tobias Schürmann , Sören Hohmann

Traffic prediction is a challenging spatio-temporal forecasting problem that involves highly complex spatio-temporal correlations. This paper proposes a Multi-level Multi-view Augmented Spatio-temporal Transformer (LVSTformer) for traffic…

Machine Learning · Computer Science 2024-06-19 Jiaqi Lin , Qianqian Ren

Achieving high-performance in multi-object tracking algorithms heavily relies on modeling spatio-temporal relationships during the data association stage. Mainstream approaches encompass rule-based and deep learning-based methods for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhonglin Liu , Shujie Chen , Jianfeng Dong , Xun Wang , Di Zhou

This paper presents a reinforcement learning-based quadrotor navigation method that leverages efficient differentiable simulation, novel loss functions, and privileged information to navigate around large obstacles. Prior learning-based…

Robotics · Computer Science 2026-03-06 Jonathan Lee , Abhishek Rathod , Kshitij Goel , John Stecklein , Wennie Tabib

Random delays weaken the temporal correspondence between actions and subsequent state feedback, making it difficult for agents to identify the true propagation process of action effects. In cross-task scenarios, changes in task objectives…

Machine Learning · Computer Science 2026-05-13 Chenran Zhao , Dianxi Shi , Yaowen Zhang , Chunping Qiu , Shaowu Yang

In this paper, we study distributed prime-dual flows for multi-agent optimization with spatio-temporal compressions. The central aim of multi-agent optimization is for a network of agents to collaboratively solve a system-level optimization…

Systems and Control · Electrical Eng. & Systems 2024-11-18 Zihao Ren , Lei Wang , Deming Yuan , Hongye Su , Guodong Shi

This paper presents a reinforcement learning framework that incorporates a Contextual Reward Machine for task-oriented grasping. The Contextual Reward Machine reduces task complexity by decomposing grasping tasks into manageable sub-tasks.…

Robotics · Computer Science 2025-12-12 Hui Li , Akhlak Uz Zaman , Fujian Yan , Hongsheng He

Context plays a significant role in the generation of motion for dynamic agents in interactive environments. This work proposes a modular method that utilises a learned model of the environment for motion prediction. This modularity…

Machine Learning · Computer Science 2021-01-05 Todor Davchev , Michael Burke , Subramanian Ramamoorthy

Reward specification is one of the most tricky problems in Reinforcement Learning, which usually requires tedious hand engineering in practice. One promising approach to tackle this challenge is to adopt existing expert video demonstrations…

Artificial Intelligence · Computer Science 2024-11-05 Yuwei Fu , Haichao Zhang , Di Wu , Wei Xu , Benoit Boulet

We study the policy evaluation problem in multi-agent reinforcement learning where a group of agents, with jointly observed states and private local actions and rewards, collaborate to learn the value function of a given policy via local…

Optimization and Control · Mathematics 2021-11-08 Dongsheng Ding , Xiaohan Wei , Zhuoran Yang , Zhaoran Wang , Mihailo R. Jovanović