English
Related papers

Related papers: FATE: Focal-modulated Attention Encoder for Multiv…

200 papers

Modern datasets are increasingly high-dimensional and multiway, often represented as tensor-valued data with multi-indexed variables. While Transformers excel in sequence modeling and high-dimensional tasks, their direct application to…

Machine Learning · Computer Science 2025-11-19 Soroush Omranpour , Guillaume Rabusseau , Reihaneh Rabbany

Time-Series Forecasting based on Cumulative Data (TSFCD) is a crucial problem in decision-making across various industrial scenarios. However, existing time-series forecasting methods often overlook two important characteristics of…

Machine Learning · Computer Science 2023-09-26 Zhichao Chen , Leilei Ding , Zhixuan Chu , Yucheng Qi , Jianmin Huang , Hao Wang

In this contribution we present the FAST, which is a comprehensive software suite that aims to streamline and automatically manage the forecast of atmospheric and astroclimatic parameters (provided respectively by Meso-Nh and Astro-Meso-Nh…

Instrumentation and Methods for Astrophysics · Physics 2024-12-09 A. Turchi , E. Masciadri , L. Fini

Accurate weather forecasting is crucial in various sectors, impacting decision-making processes and societal events. Data-driven approaches based on machine learning models have recently emerged as a promising alternative to numerical…

Machine Learning · Computer Science 2024-05-14 Zijie Li , Anthony Zhou , Saurabh Patil , Amir Barati Farimani

Real-world problems often involve complex and unstructured sets of measurements, which occur when sensors are sparsely placed in either space or time. Being able to model this irregular spatiotemporal data and extract meaningful forecasts…

Machine Learning · Computer Science 2024-04-17 Arnaud Pannatier , Kyle Matoba , François Fleuret

Multivariate time series classification is increasingly investigated in space weather research as a means to predict intense solar flare events, which can cause widespread disruptions across modern technological systems. Magnetic field…

Machine Learning · Computer Science 2025-11-18 Onur Vural , Shah Muhammad Hamdi , Soukaina Filali Boubrahimi

Although Transformers excel in natural language processing, their extension to time series forecasting remains challenging due to insufficient consideration of the differences between textual and temporal modalities. In this paper, we…

Machine Learning · Computer Science 2025-10-09 Zhipeng Liu , Peibo Duan , Xuan Tang , Baixin Li , Yongsheng Huang , Mingyang Geng , Changsheng Zhang , Bin Zhang , Binwu Wang

Multivariate time series forecasting has been widely used in various practical scenarios. Recently, Transformer-based models have shown significant potential in forecasting tasks due to the capture of long-range dependencies. However,…

Machine Learning · Computer Science 2023-02-10 Zhe Li , Zhongwen Rao , Lujia Pan , Zenglin Xu

We investigate a novel approach to time-series modeling, inspired by the successes of large pretrained foundation models. We introduce FAE (Foundation Auto-Encoders), a foundation generative-AI model for anomaly detection in time-series…

Machine Learning · Computer Science 2025-07-03 Gastón García González , Pedro Casas , Emilio Martínez , Alicia Fernández

Time series forecasting presents a significant challenge, particularly when its accuracy relies on external data sources rather than solely on historical values. This issue is prevalent in the financial sector, where the future behavior of…

Machine Learning · Computer Science 2024-03-22 Hajar Emami , Xuan-Hong Dang , Yousaf Shah , Petros Zerfos

Evaluating anomaly detection algorithms in time series data is critical as inaccuracies can lead to flawed decision-making in various domains where real-time analytics and data-driven strategies are essential. Traditional performance…

Machine Learning · Computer Science 2024-05-21 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

Earth Observatory is a growing research area that can capitalize on the powers of AI for short time forecasting, a Now-casting scenario. In this work, we tackle the challenge of weather forecasting using a video transformer network. Vision…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Alabi Bojesomo , Hasan Al Marzouqi , Panos Liatsis

Accurate prediction of driving intention is key to enhancing the safety and interactive efficiency of human-machine co-driving systems. It serves as a cornerstone for achieving high-level autonomous driving. However, current approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Sirui Wang , Zhou Guan , Bingxi Zhao , Tongjia Gu , Jie Liu

Large time series models (LTMs) have emerged as powerful tools for universal forecasting, yet they often struggle with the inherent diversity and nonstationarity of real-world time series data, leading to an unsatisfactory trade-off between…

Machine Learning · Computer Science 2026-03-03 Yunzhong Qiu , Zhiyao Cen , Zhongyi Pei , Chen Wang , Jianmin Wang

Transformers have shown great power in time series forecasting due to their global-range modeling ability. However, their performance can degenerate terribly on non-stationary real-world data in which the joint distribution changes over…

Machine Learning · Computer Science 2023-11-27 Yong Liu , Haixu Wu , Jianmin Wang , Mingsheng Long

Fault diagnosis in multimode processes plays a critical role in ensuring the safe operation of industrial systems across multiple modes. It faces a great challenge yet to be addressed - that is, the significant distributional differences…

Machine Learning · Computer Science 2025-07-24 Guangqiang Li , M. Amine Atoui , Xiangshun Li

Multi-Object Tracking (MOT) is one of the most fundamental computer vision tasks that contributes to various video analysis applications. Despite the recent promising progress, current MOT research is still limited to a fixed sampling frame…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Weitao Feng , Lei Bai , Yongqiang Yao , Fengwei Yu , Wanli Ouyang

Long-term time series forecasting (LTSF) is a crucial aspect of modern society, playing a pivotal role in facilitating long-term planning and developing early warning systems. While many Transformer-based models have recently been…

Machine Learning · Computer Science 2023-05-31 Jiaxin Gao , Wenbo Hu , Yuntian Chen

Forecasting multivariate time series data, such as prediction of electricity consumption, solar power production, and polyphonic piano pieces, has numerous valuable applications. However, complex and non-linear interdependencies between…

Machine Learning · Computer Science 2019-09-20 Shun-Yao Shih , Fan-Keng Sun , Hung-yi Lee

Traffic time series forecasting is challenging due to complex spatio-temporal dynamics time series from different locations often have distinct patterns; and for the same time series, patterns may vary across time, where, for example, there…

Machine Learning · Computer Science 2022-04-06 Razvan-Gabriel Cirstea , Bin Yang , Chenjuan Guo , Tung Kieu , Shirui Pan