English
Related papers

Related papers: Spatially-Aware Transformer for Embodied Agents

200 papers

Vision-centric hierarchical embodied models have demonstrated strong potential. However, existing methods lack spatial awareness capabilities, limiting their effectiveness in bridging visual plans to actionable control in complex…

Robotics · Computer Science 2025-11-19 Yijun Liu , Yuwei Liu , Yuan Meng , Jieheng Zhang , Yuwei Zhou , Ye Li , Jiacheng Jiang , Kangye Ji , Shijia Ge , Zhi Wang , Wenwu Zhu

Memory is an important aspect of intelligence and plays a role in many deep reinforcement learning models. However, little progress has been made in understanding when specific memory systems help more than others and how well they…

Recent techniques in dynamical scheduling and resource management have found applications in warehouse environments due to their ability to organize and prioritize tasks in a higher temporal resolution. The rise of deep reinforcement…

Machine Learning · Computer Science 2022-03-08 Stelios Stavroulakis , Biswa Sengupta

Attention mechanisms have become a popular component in deep neural networks, yet there has been little examination of how different influencing factors and methods for computing attention from these factors affect performance. Toward a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Xizhou Zhu , Dazhi Cheng , Zheng Zhang , Stephen Lin , Jifeng Dai

In the context of visual navigation, the capacity to map a novel environment is necessary for an agent to exploit its observation history in the considered place and efficiently reach known goals. This ability can be associated with spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Pierre Marza , Laetitia Matignon , Olivier Simonin , Christian Wolf

Modeling episodic memory (EM) remains a significant challenge in both neuroscience and AI, with existing models either lacking interpretability or struggling with practical applications. This paper proposes the Vision-Language Episodic…

Neurons and Cognition · Quantitative Biology 2025-05-09 Chong Li , Taiping Zeng , Xiangyang Xue , Jianfeng Feng

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

In this paper, we share our reflections and insights on understanding Transformer architectures through the lens of associative memory--a classic psychological concept inspired by human cognition. We start with the basics of associative…

Machine Learning · Computer Science 2025-05-27 Shu Zhong , Mingyu Xu , Tenglong Ao , Guang Shi

In cooperative multi-agent reinforcement learning (MARL), agents aim to achieve a common goal, such as defeating enemies or scoring a goal. Existing MARL algorithms are effective but still require significant learning time and often get…

Machine Learning · Computer Science 2024-03-08 Hyungho Na , Yunkyeong Seo , Il-chul Moon

State of the art deep reinforcement learning algorithms take many millions of interactions to attain human-level performance. Humans, on the other hand, can very quickly exploit highly rewarding nuances of an environment upon first…

We present Portable Agent Memory, an open protocol and reference implementation for transferring persistent memory state across heterogeneous AI agents. Modern AI agents accumulate rich context -- episodic events,semantic knowledge,…

Cryptography and Security · Computer Science 2026-05-13 Santhosh Kumar Ravindran

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder impacting social and behavioral development. Resting-state fMRI, a non-invasive tool for capturing brain connectivity patterns, aids in early ASD diagnosis and differentiation…

Machine Learning · Computer Science 2025-02-27 Ziqiao Weng , Weidong Cai , Bo Zhou

Emerging from the pairwise attention in conventional Transformers, there is a growing interest in sparse attention mechanisms that align more closely with localized, contextual learning in the biological brain. Existing studies such as the…

Machine Learning · Computer Science 2025-03-12 Yuwei Sun , Hideya Ochiai , Zhirong Wu , Stephen Lin , Ryota Kanai

Traffic time series forecasting is challenging due to complex spatio-temporal dynamics time series from different locations often have distinct patterns; and for the same time series, patterns may vary across time, where, for example, there…

Machine Learning · Computer Science 2022-04-06 Razvan-Gabriel Cirstea , Bin Yang , Chenjuan Guo , Tung Kieu , Shirui Pan

Recent advances in agentic AI have led to systems capable of autonomous task execution and language-based reasoning, yet their spatial reasoning abilities remain limited and underexplored, largely constrained to symbolic and sequential…

Artificial Intelligence · Computer Science 2025-09-12 Bui Duc Manh , Soumyaratna Debnath , Zetong Zhang , Shriram Damodaran , Arvind Kumar , Yueyi Zhang , Lu Mi , Erik Cambria , Lin Wang

Storing knowledge of an agent's environment in the form of a probabilistic generative model has been established as a crucial ingredient in a multitude of cognitive tasks. Perception has been formalised as probabilistic inference over the…

Neurons and Cognition · Quantitative Biology 2018-06-22 David G. Nagy , Balázs Török , Gergő Orbán

In video analysis, understanding the temporal context is crucial for recognizing object interactions, event patterns, and contextual changes over time. The proposed model leverages adjacency and semantic similarities between objects from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Ahnaf Farhan , M. Shahriar Hossain

A longstanding goal in reinforcement learning is to build intelligent agents that show fast learning and a flexible transfer of skills akin to humans and animals. This paper investigates the integration of two frameworks for tackling those…

Machine Learning · Computer Science 2023-08-04 David Emukpere , Xavier Alameda-Pineda , Chris Reinke

Understanding visual scenes requires not only recognizing objects but also reasoning about their spatial relationships. Unlike general vision-language tasks, spatial reasoning requires integrating multiple inductive biases, such as 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Chan Yeong Hwang , Miso Choi , Sunghyun On , Jinkyu Kim , Jungbeom Lee

Accurate vehicle trajectory prediction is crucial for ensuring safe and efficient autonomous driving. This work explores the integration of Transformer based model with Long Short-Term Memory (LSTM) based technique to enhance spatial and…

Robotics · Computer Science 2024-12-19 Chandra Raskoti , Weizi Li