English
Related papers

Related papers: TrAISformer -- A Transformer Network with Sparse A…

200 papers

Recently, the superiority of Transformer for long-term time series forecasting (LTSF) tasks has been challenged, particularly since recent work has shown that simple models can outperform numerous Transformer-based approaches. This suggests…

Machine Learning · Computer Science 2023-10-10 Shengsheng Lin , Weiwei Lin , Wentai Wu , Songbo Wang , Yongxiang Wang

Motion forecasting plays a pivotal role in autonomous driving systems, enabling vehicles to execute collision warnings and rational local-path planning based on predictions of the surrounding vehicles. However, prevalent methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zhanwen Liu , Chao Li , Nan Yang , Yang Wang , Jiaqi Ma , Guangliang Cheng , Xiangmo Zhao

Deep neural networks are often applied to medical images to automate the problem of medical diagnosis. However, a more clinically relevant question that practitioners usually face is how to predict the future trajectory of a disease.…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Huy Hoang Nguyen , Matthew B. Blaschko , Simo Saarakkala , Aleksei Tiulpin

Reliable and efficient trajectory optimization methods are a fundamental need for autonomous dynamical systems, effectively enabling applications including rocket landing, hypersonic reentry, spacecraft rendezvous, and docking. Within such…

Robotics · Computer Science 2024-01-09 Tommaso Guffanti , Daniele Gammelli , Simone D'Amico , Marco Pavone

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

Machine Learning · Computer Science 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

Machine Learning · Computer Science 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan

Multivariate time series forecasting is crucial across a wide range of domains. While presenting notable progress for the Transformer architecture, iTransformer still lags behind the latest MLP-based models. We attribute this performance…

Machine Learning · Computer Science 2025-11-12 Zhiwei Zhang , Xinyi Du , Xuanchi Guo , Weihao Wang , Wenjuan Han

Time series data is ubiquitous in research as well as in a wide variety of industrial applications. Effectively analyzing the available historical data and providing insights into the far future allows us to make effective decisions. Recent…

Machine Learning · Computer Science 2022-10-24 Kiran Madhusudhanan , Johannes Burchert , Nghia Duong-Trung , Stefan Born , Lars Schmidt-Thieme

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning methods have become…

Artificial Intelligence · Computer Science 2021-04-13 Haoyang Yan , Xiaolei Ma

Currently, iTransformer is one of the most popular and effective models for multivariate time series (MTS) forecasting. Thanks to its inverted framework, iTransformer effectively captures multivariate correlation. However, the inverted…

Machine Learning · Computer Science 2025-07-17 Hongming Tan , Ting Chen , Ruochong Jin , Wai Kin Chan

Despite the success of Transformer-based models in the time-series prediction (TSP) tasks, the existing Transformer architecture still face limitations and the literature lacks comprehensive explorations into alternative architectures. To…

Machine Learning · Computer Science 2025-02-20 Juyuan Zhang , Wei Zhu , Jiechao Gao

Understanding trajectory diversity is a fundamental aspect of addressing practical traffic tasks. However, capturing the diversity of trajectories presents challenges, particularly with traditional machine learning and recurrent neural…

Artificial Intelligence · Computer Science 2023-12-04 Ruyi Feng , Zhibin Li , Bowen Liu , Yan Ding

The performance of time series forecasting has recently been greatly improved by the introduction of transformers. In this paper, we propose a general multi-scale framework that can be applied to the state-of-the-art transformer-based time…

Machine Learning · Computer Science 2023-02-08 Amin Shabani , Amir Abdi , Lili Meng , Tristan Sylvain

Using data sources beyond the Automatic Identification System to represent the context a vessel is navigating in and consequently improve situation awareness is still rare in machine learning approaches to vessel trajectory prediction…

Machine Learning · Computer Science 2024-10-23 Kathrin Donandt , Dirk Söffker

This paper presents a novel framework to accelerate route prediction in Drone-as-a-Service operations through weather-aware deep learning models. While classical path-planning algorithms, such as A* and Dijkstra, provide optimal solutions,…

Machine Learning · Computer Science 2026-01-08 Kamal Mohamed , Lillian Wassim , Ali Hamdi , Khaled Shaban

The surge in real-time data collection across various industries has underscored the need for advanced anomaly detection in both univariate and multivariate time series data. This paper introduces TransNAS-TSAD, a framework that synergizes…

Machine Learning · Computer Science 2024-03-06 Ijaz Ul Haq , Byung Suk Lee , Donna M. Rizzo

Intrusion detection in IoT and industrial networks requires models that can detect rare attacks at low false-positive rates while remaining reliable under evolving traffic and limited labels. Existing IDS solutions often report strong…

Cryptography and Security · Computer Science 2026-03-03 Srikumar Nayak

Predicting multiple plausible future trajectories of the nearby vehicles is crucial for the safety of autonomous driving. Recent motion prediction approaches attempt to achieve such multimodal motion prediction by implicitly regularizing…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Yicheng Liu , Jinghuai Zhang , Liangji Fang , Qinhong Jiang , Bolei Zhou

Wireless communications at high-frequency bands with large antenna arrays face challenges in beam management, which can potentially be improved by multimodality sensing information from cameras, LiDAR, radar, and GPS. In this paper, we…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Yu Tian , Qiyang Zhao , Zine el abidine Kherroubi , Fouzi Boukhalfa , Kebin Wu , Faouzi Bader

Trajectory prediction is a crucial element of guidance, navigation, and control systems. This paper presents two novel trajectory-prediction methods based on real-time position measurements and adaptive input and state estimation (AISE).…

Systems and Control · Electrical Eng. & Systems 2025-01-09 Shashank Verma , Dennis S. Bernstein