English
Related papers

Related papers: ADFormer: Aggregation Differential Transformer for…

200 papers

Accurate 3D object detection is essential for ensuring the safety of autonomous vehicles. Cooperative perception, which leverages vehicle-to-everything (V2X) communication to share perceptual data, enhances detection but is vulnerable to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Xi Zhou , Tao Huang , Qing-Long Han , Rana Abbas , Mostafa Rahimi Azghadi

In the hyperspectral image classification (HSIC) task, the most commonly used model validation paradigm is partitioning the training-test dataset through pixel-wise random sampling. By training on a small amount of data, the deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Enzhe Zhao , Zhichang Guo , Shengzhu Shi , Yao Li , Jia Li , Dazhi Zhang

Transformer is a powerful model for text understanding. However, it is inefficient due to its quadratic complexity to input sequence length. Although there are many methods on Transformer acceleration, they are still either inefficient on…

Computation and Language · Computer Science 2021-09-07 Chuhan Wu , Fangzhao Wu , Tao Qi , Yongfeng Huang , Xing Xie

Unsupervised anomaly detection of multivariate time series is a challenging task, given the requirements of deriving a compact detection criterion without accessing the anomaly points. The existing methods are mainly based on reconstruction…

Machine Learning · Computer Science 2026-05-26 Qingxiang Liu , Xiaoliang Luo , Chenghao Liu , Sheng Sun , Di Yao , Lvchun Wang , Wei Yu , Yuxuan Liang

Trajectory prediction is fundamental to various intelligent technologies, such as autonomous driving and robotics. The motion prediction of pedestrians and vehicles helps emergency braking, reduces collisions, and improves traffic safety.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Yao Liu , Binghao Li , Xianzhi Wang , Claude Sammut , Lina Yao

Motion prediction is an important aspect for Autonomous Driving (AD) and Advance Driver Assistance Systems (ADAS). Current state-of-the-art motion prediction methods rely on High Definition (HD) maps for capturing the surrounding context of…

Machine Learning · Computer Science 2025-04-15 Harsh Yadav , Maximilian Schaefer , Kun Zhao , Tobias Meisen

Autonomous navigation in marine environments can be extremely challenging, especially in the presence of spatially varying flow disturbances and dynamic and static obstacles. In this work, we demonstrate that incorporating local flow field…

Robotics · Computer Science 2025-07-11 Ehsan Kazemi , Dechen Gao , Iman Soltani

As a crucial component in intelligent transportation systems, traffic flow prediction has recently attracted widespread research interest in the field of artificial intelligence (AI) with the increasing availability of massive traffic…

Machine Learning · Computer Science 2020-06-17 Lingbo Liu , Jiajie Zhen , Guanbin Li , Geng Zhan , Zhaocheng He , Bowen Du , Liang Lin

Group activity recognition is a crucial yet challenging problem, whose core lies in fully exploring spatial-temporal interactions among individuals and generating reasonable group representations. However, previous methods either model…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Shuaicheng Li , Qianggang Cao , Lingbo Liu , Kunlin Yang , Shinan Liu , Jun Hou , Shuai Yi

Multivariate time series forecasting tasks are usually conducted in a channel-dependent (CD) way since it can incorporate more variable-relevant information. However, it may also involve a lot of irrelevant variables, and this even leads to…

Machine Learning · Computer Science 2024-05-15 Qinshuo Liu , Yanwen Fang , Pengtao Jiang , Guodong Li

In this paper, we introduce \texttt{IAFormer}, a novel Transformer-based architecture that efficiently integrates pairwise particle interactions through a dynamic sparse attention mechanism. \texttt{IAFormer} has two new mechanisms within…

High Energy Physics - Phenomenology · Physics 2026-04-21 W. Esmail , A. Hammad , M. Nojiri

Flight trajectory prediction for multiple aircraft is essential and provides critical insights into how aircraft navigate within current air traffic flows. However, predicting multi-agent flight trajectories is inherently challenging. One…

Machine Learning · Computer Science 2026-02-06 Seokbin Yoon , Keumjin Lee

Predicting the future behavior of agents is a fundamental task in autonomous vehicle domains. Accurate prediction relies on comprehending the surrounding map, which significantly regularizes agent behaviors. However, existing methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Chen Feng , Hangning Zhou , Huadong Lin , Zhigang Zhang , Ziyao Xu , Chi Zhang , Boyu Zhou , Shaojie Shen

Transformer-based models have significantly advanced time series forecasting. Recent work, like the Cross-Attention-only Time Series transformer (CATS), shows that removing self-attention can make the model more accurate and efficient.…

Machine Learning · Computer Science 2025-09-08 Jiajun Song , Xiaoou Liu

With the emergence of VR and AR, 360{\deg} data attracts increasing attention from the computer vision and multimedia communities. Typically, 360{\deg} data is projected into 2D ERP (equirectangular projection) images for feature…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yinjie Zhao , Lichen Zhao , Qian Yu , Jing Zhang , Lu Sheng , Dong Xu

Traffic forecasting has emerged as a crucial research area in the development of smart cities. Although various neural networks with intricate architectures have been developed to address this problem, they still face two key challenges: i)…

Machine Learning · Computer Science 2024-08-27 Jianxiang Zhou , Erdong Liu , Wei Chen , Siru Zhong , Yuxuan Liang

Long-term weather forecasting is critical for socioeconomic planning and disaster preparedness. While recent approaches employ finetuning to extend prediction horizons, they remain constrained by the issues of catastrophic forgetting, error…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Hao Chen , Tao Han , Jie Zhang , Song Guo , Fenghua Ling , Lei Bai

Although Transformer-based methods have significantly improved state-of-the-art results for long-term series forecasting, they are not only computationally expensive but more importantly, are unable to capture the global view of time series…

Machine Learning · Computer Science 2022-06-17 Tian Zhou , Ziqing Ma , Qingsong Wen , Xue Wang , Liang Sun , Rong Jin

A core issue in multi-agent federated reinforcement learning is defining how to aggregate insights from multiple agents. This is commonly done by taking the average of each participating agent's model weights into one common model (FedAvg).…

Machine Learning · Computer Science 2023-07-19 Liam Hebert , Lukasz Golab , Pascal Poupart , Robin Cohen

Self-attention has become a defacto choice for capturing global context in various vision applications. However, its quadratic computational complexity with respect to image resolution limits its use in real-time applications, especially…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Abdelrahman Shaker , Muhammad Maaz , Hanoona Rasheed , Salman Khan , Ming-Hsuan Yang , Fahad Shahbaz Khan