English
Related papers

Related papers: An Attention Free Long Short-Term Memory for Time …

200 papers

Short-term rainfall forecasting, also known as precipitation nowcasting has become a potentially fundamental technology impacting significant real-world applications ranging from flight safety, rainstorm alerts to farm irrigation timings.…

Neural and Evolutionary Computing · Computer Science 2018-10-25 Maitreya Patel , Anery Patel , Dr. Ranendu Ghosh

This paper introduces FANTF (Fuzzy Attention Network-Based Transformers), a novel approach that integrates fuzzy logic with existing transformer architectures to advance time series forecasting, classification, and anomaly detection tasks.…

Machine Learning · Computer Science 2025-04-02 Sanjay Chakraborty , Fredrik Heintz

Lane detection is a crucial perception task for all levels of automated vehicles (AVs) and Advanced Driver Assistance Systems, particularly in mixed-traffic environments where AVs must interact with human-driven vehicles (HDVs) and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Sandeep Patil , Yongqi Dong , Haneen Farah , Hans Hellendoorn

In this paper, we propose a human trajectory prediction model that combines a Long Short-Term Memory (LSTM) network with an attention mechanism. To do that, we use attention scores to determine which parts of the input data the model should…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Amin Manafi Soltan Ahmadi , Samaneh Hoseini Semnani

In this paper, a method of prediction on continuous time series variables from the production or flow -- an LSTM algorithm based on multivariate tuning -- is proposed. The algorithm improves the traditional LSTM algorithm and converts the…

Machine Learning · Computer Science 2024-03-19 Hongzhi Wang , Yang Song , Shihan Tang

Multivariate time-series forecasting is vital in various domains, e.g., economic planning and weather prediction. Deep train-from-scratch models have exhibited effective performance yet require large amounts of data, which limits real-world…

Machine Learning · Computer Science 2025-02-21 Ching Chang , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen

Regression problems with time-series predictors are common in banking and many other areas of application. In this paper, we use multi-head attention networks to develop interpretable features and use them to achieve good predictive…

Machine Learning · Computer Science 2022-05-26 Tianjie Wang , Jie Chen , Joel Vaughan , Vijayan N. Nair

Time series analysis is crucial in fields like finance, transportation, and industry. However, traditional models often focus solely on temporal features, limiting their ability to capture underlying information. This paper proposes a novel…

Machine Learning · Computer Science 2025-03-12 Shule Hao , Junpeng Bao , Chuncheng Lu

Transparent models, which provide inherently interpretable predictions, are receiving significant attention in high-stakes domains. However, despite much real-world data being collected as time series, there is a lack of studies on…

Machine Learning · Computer Science 2025-12-17 Minkyu Kim , Suan Lee , Jinho Kim

Sequence models lie at the heart of modern deep learning. However, rapid advancements have produced a diversity of seemingly unrelated architectures, such as Transformers and recurrent alternatives. In this paper, we introduce a unifying…

Machine Learning · Computer Science 2025-05-05 Ke Alexander Wang , Jiaxin Shi , Emily B. Fox

This work contributes to the development of neural forecasting models with novel randomization-based learning methods. These methods improve the fitting abilities of the neural model, in comparison to the standard method, by generating…

Machine Learning · Computer Science 2021-07-06 Grzegorz Dudek

Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational…

Machine Learning · Computer Science 2023-01-06 Yan Li , Xinjiang Lu , Haoyi Xiong , Jian Tang , Jiantao Su , Bo Jin , Dejing Dou

Traffic prediction is necessary not only for management departments to dispatch vehicles but also for drivers to avoid congested roads. Many traffic forecasting methods based on deep learning have been proposed in recent years, and their…

Machine Learning · Computer Science 2020-05-12 Jichen Wang , Weiguo Zhu , Yongqi Sun , Chunzi Tian

Time series prediction is a widespread and well studied problem with applications in many domains (medical, geoscience, network analysis, finance, econometry etc.). In the case of multivariate time series, the key to good performances is to…

Machine Learning · Computer Science 2022-02-09 Darko Drakulic , Jean-Marc Andreoli

The last advances in sequence modeling are mainly based on deep learning approaches. The current state of the art involves the use of variations of the standard LSTM architecture, combined with several tricks that improve the final…

Computation and Language · Computer Science 2021-12-23 Christian Oliva , Luis F. Lago-Fernández

Existing research largely attributes the global sequence modeling capability of Transformers to the explicit computation of attention weights, a process that inherently incurs quadratic computational complexity. In this work, we offer a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Ruize He , Dongchen Han , Gao Huang

Time series forecasting plays a critical role in decision-making across many real-world applications. Unlike data in vision and language domains, time series data is inherently tied to the evolution of underlying processes and can only…

Machine Learning · Computer Science 2026-02-03 Suhan Guo , Bingxu Wang , Shaodan Zhang , Furao Shen

Introduction: Long-term time series forecasting (LTSF) has gained significant attention in recent years. While various specialized designs exist for capturing temporal dependency, recent studies have shown that even a single linear layer…

Machine Learning · Computer Science 2026-05-19 Zhe Li , Shiyi Qi , Yiduo Li , Zenglin Xu

With the advent of Big Data, nowadays in many applications databases containing large quantities of similar time series are available. Forecasting time series in these domains with traditional univariate forecasting procedures leaves great…

Machine Learning · Computer Science 2018-09-13 Kasun Bandara , Christoph Bergmeir , Slawek Smyl

The project aims to research on combining deep learning specifically Long-Short Memory (LSTM) and basic statistics in multiple multistep time series prediction. LSTM can dive into all the pages and learn the general trends of variation in a…

Machine Learning · Statistics 2017-10-13 Chuanyun Zang