English
Related papers

Related papers: Beyond Attention: Learning Spatio-Temporal Dynamic…

200 papers

Detecting driver fatigue is critical for road safety, as drowsy driving remains a leading cause of traffic accidents. Many existing solutions rely on computationally demanding deep learning models, which result in high latency and are…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jing Ren , Suyu Ma , Hong Jia , Xiwei Xu , Ivan Lee , Haytham Fayek , Xiaodong Li , Feng Xia

Graph representation learning methods have been widely adopted in financial applications to enhance company representations by leveraging inter-firm relationships. However, current approaches face three key challenges: (1) The advantages of…

Statistical Finance · Quantitative Finance 2025-07-04 Yingjie Niu , Mingchuan Zhao , Valerio Poti , Ruihai Dong

Spatio-temporal graphs such as traffic networks or gene regulatory systems present challenges for the existing deep learning methods due to the complexity of structural changes over time. To address these issues, we introduce…

Machine Learning · Computer Science 2019-04-15 Felix L. Opolka , Aaron Solomon , Cătălina Cangea , Petar Veličković , Pietro Liò , R Devon Hjelm

Dynamic demand prediction is crucial for the efficient operation and management of urban transportation systems. Extensive research has been conducted on single-mode demand prediction, ignoring the fact that the demands for different…

Machine Learning · Computer Science 2022-09-02 Yuebing Liang , Guan Huang , Zhan Zhao

Effective interaction modeling and behavior prediction of dynamic agents play a significant role in interactive motion planning for autonomous robots. Although existing methods have improved prediction accuracy, few research efforts have…

Robotics · Computer Science 2024-01-09 Victoria M. Dax , Jiachen Li , Enna Sachdeva , Nakul Agarwal , Mykel J. Kochenderfer

Accurate real-time traffic forecasting is a core technological problem against the implementation of the intelligent transportation system. However, it remains challenging considering the complex spatial and temporal dependencies among…

Machine Learning · Computer Science 2020-06-23 Jiawei Zhu , Yujiao Song , Ling Zhao , Haifeng Li

Attention Deficit Hyperactivity Disorder (ADHD) is a prevalent neurodevelopmental disorder whose neuroimaging-based diagnosis remains challenging due to complex time-varying disruptions in brain connectivity. Functional MRI (fMRI) provides…

Machine Learning · Computer Science 2026-03-30 Qurat Ul Ain , Alptekin Temizel , Soyiba Jawed

Graph Attention Networks (GATs) are one of the most popular GNN architectures and are considered as the state-of-the-art architecture for representation learning with graphs. In GAT, every node attends to its neighbors given its own…

Machine Learning · Computer Science 2022-02-01 Shaked Brody , Uri Alon , Eran Yahav

Predicting the motion of surrounding vehicles is essential for autonomous vehicles, as it governs their own motion plan. Current state-of-the-art vehicle prediction models heavily rely on map information. In reality, however, this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Julian Schmidt , Julian Jordan , Franz Gritschneder , Klaus Dietmayer

Accurately identifying the underlying graph structures of multi-agent systems remains a difficult challenge. Our work introduces a novel machine learning-based solution that leverages the attention mechanism to predict future states of…

Multiagent Systems · Computer Science 2024-10-29 Akshay Kolli , Reza Azadeh , Kshitj Jerath

Graph Attention Network (GAT) and GraphSAGE are neural network architectures that operate on graph-structured data and have been widely studied for link prediction and node classification. One challenge raised by GraphSAGE is how to smartly…

Machine Learning · Computer Science 2020-06-09 Anderson de Andrade , Chen Liu

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning methods have become…

Artificial Intelligence · Computer Science 2021-04-13 Haoyang Yan , Xiaolei Ma

We present an attention mechanism inspired from definition of screened Coulomb potential. This attention mechanism was used to interpret the Graph Attention (GAT) model layers and training dataset by using a flexible and scalable framework…

Machine Learning · Computer Science 2019-12-19 Burc Gokden

The analysis of spatiotemporal data is increasingly utilized across diverse domains, including transportation, healthcare, and meteorology. In real-world settings, such data often contain missing elements due to issues like sensor…

Machine Learning · Computer Science 2023-11-27 Yakun Chen , Xianzhi Wang , Guandong Xu

Accurately modelling human attention is essential for numerous computer vision applications, particularly in the domain of automotive safety. Existing methods typically collapse gaze into saliency maps or scanpaths, treating gaze dynamics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Luke Palmer , Petar Palasek , Hazem Abdelkawy

The paradigm of Transformers using the self-attention mechanism has manifested its advantage in learning graph-structured data. Yet, Graph Transformers are capable of modeling full range dependencies but are often deficient in extracting…

Machine Learning · Computer Science 2024-09-11 Minhong Zhu , Zhenhao Zhao , Weiran Cai

Managing microservice architectures in distributed systems is complex and resource intensive due to the high frequency and dynamic nature of inter service interactions. Accurate prediction of these future interactions can enhance adaptive…

Machine Learning · Computer Science 2025-01-28 Ghazal Khodabandeh , Alireza Ezaz , Majid Babaei , Naser Ezzati-Jivan

Auto-encoders have emerged as a successful framework for unsupervised learning. However, conventional auto-encoders are incapable of utilizing explicit relations in structured data. To take advantage of relations in graph-structured data,…

Machine Learning · Computer Science 2019-05-28 Amin Salehi , Hasan Davulcu

Graph Neural Networks (GNNs) are deep learning methods which provide the current state of the art performance in node classification tasks. GNNs often assume homophily -- neighboring nodes having similar features and labels--, and therefore…

Machine Learning · Computer Science 2021-10-26 Liheng Ma , Reihaneh Rabbany , Adriana Romero-Soriano

The cues needed to detect spoofing attacks against automatic speaker verification are often located in specific spectral sub-bands or temporal segments. Previous works show the potential to learn these using either spectral or temporal…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-09 Hemlata Tak , Jee-weon Jung , Jose Patino , Massimiliano Todisco , Nicholas Evans