English
Related papers

Related papers: Enhancing Time Series Forecasting with Fuzzy Atten…

200 papers

Fully convolutional neural networks (FCN) have been shown to achieve state-of-the-art performance on the task of classifying time series sequences. We propose the augmentation of fully convolutional networks with long short term memory…

Machine Learning · Computer Science 2018-03-20 Fazle Karim , Somshubra Majumdar , Houshang Darabi , Shun Chen

Time series prediction is crucial for understanding and forecasting complex dynamics in various domains, ranging from finance and economics to climate and healthcare. Based on Transformer architecture, one approach involves encoding…

Machine Learning · Computer Science 2024-05-24 Xin Cheng , Xiuying Chen , Shuqi Li , Di Luo , Xun Wang , Dongyan Zhao , Rui Yan

Accurate spectrum prediction is crucial for dynamic spectrum access (DSA) and resource allocation. However, due to the unique characteristics of spectrum data, existing methods based on the time or frequency domain often struggle to…

Machine Learning · Computer Science 2025-08-26 Yanghao Qin , Bo Zhou , Guangliang Pan , Qihui Wu , Meixia Tao

Link prediction is crucial for understanding complex networks but traditional Graph Neural Networks (GNNs) often rely on random negative sampling, leading to suboptimal performance. This paper introduces Fuzzy Graph Attention Networks…

Machine Learning · Computer Science 2025-02-04 Jinming Xing , Ruilin Xing , Chang Xue , Dongwen Luo

Transformer-based models have been widely adopted for sentiment analysis tasks due to their exceptional ability to capture contextual information. However, these methods often exhibit suboptimal accuracy in certain scenarios. By analyzing…

Artificial Intelligence · Computer Science 2025-12-25 Yawei Liu

An evolving weighted neuro-neo-fuzzy-ANARX model and its learning procedures are introduced in the article. This system is basically used for time series forecasting. This system may be considered as a pool of elements that process data in…

Artificial Intelligence · Computer Science 2016-10-21 Zhengbing Hu , Yevgeniy V. Bodyanskiy , Oleksii K. Tyshchenko , Olena O. Boiko

Traffic time series forecasting is challenging due to complex spatio-temporal dynamics time series from different locations often have distinct patterns; and for the same time series, patterns may vary across time, where, for example, there…

Machine Learning · Computer Science 2022-04-06 Razvan-Gabriel Cirstea , Bin Yang , Chenjuan Guo , Tung Kieu , Shirui Pan

In this paper we propose to extend the definition of fuzzy transform in order to consider an interpolation of models that are richer than the standard fuzzy transform. We focus on polynomial models, linear in particular, although the…

Data Analysis, Statistics and Probability · Physics 2017-05-08 Luigi Troiano , Pravesh Kriplani , Irene Diaz

The paradigm of Transformers using the self-attention mechanism has manifested its advantage in learning graph-structured data. Yet, Graph Transformers are capable of modeling full range dependencies but are often deficient in extracting…

Machine Learning · Computer Science 2024-09-11 Minhong Zhu , Zhenhao Zhao , Weiran Cai

In real-world time series forecasting tasks, category information plays a pivotal role in capturing inherent data patterns. This paper introduces QKCV (Query-Key-Category-Value) attention, an extension of the traditional QKV framework that…

Machine Learning · Computer Science 2025-10-24 Hao Wang , Baojun Ma

Attention is a core component of transformer architecture, whether encoder-only, decoder-only, or encoder-decoder model. However, the standard softmax attention often produces noisy probability distribution, which can impair effective…

Computation and Language · Computer Science 2025-11-11 Dhananjay Ram , Wei Xia , Stefano Soatto

Long-term time series forecasting (LTSF) is a critical task across diverse domains. Despite significant advancements in LTSF research, we identify a performance bottleneck in existing LTSF methods caused by the inadequate modeling of…

Machine Learning · Computer Science 2025-09-22 Qi Xiong , Kai Tang , Minbo Ma , Ji Zhang , Jie Xu , Tianrui Li

Accurate forecasting in financial markets requires integrating diverse data sources, from historical prices to macroeconomic indicators and financial news. However, existing models often fail to align these modalities effectively, limiting…

Machine Learning · Computer Science 2025-11-04 Yunhua Pei , John Cartlidge , Anandadeep Mandal , Daniel Gold , Enrique Marcilio , Riccardo Mazzon

As multimodal data proliferates across diverse real-world applications, leveraging heterogeneous information such as texts and timestamps for accurate time series forecasting (TSF) has become a critical challenge. While diffusion models…

Machine Learning · Computer Science 2025-12-09 Da Zhang , Bingyu Li , Zhuyuan Zhao , Junyu Gao , Feiping Nie , Xuelong Li

Time series forecasting is crucial for applications across multiple domains and various scenarios. Although Transformer models have dramatically advanced the landscape of forecasting, their effectiveness remains debated. Recent findings…

Machine Learning · Computer Science 2024-12-24 Dongbin Kim , Jinseong Park , Jaewook Lee , Hoki Kim

As Transformer-based models have achieved impressive performance on various time series tasks, Long-Term Series Forecasting (LTSF) tasks have also received extensive attention in recent years. However, due to the inherent computational…

Machine Learning · Computer Science 2024-02-06 Daojun Liang , Haixia Zhang , Dongfeng Yuan , Xiaoyan Ma , Dongyang Li , Minggao Zhang

Evaluating the contribution of individual data points to a model's prediction is critical for interpreting model predictions and improving model performance. Existing data contribution methods have been applied to various data types,…

Machine Learning · Computer Science 2025-06-17 Yizi Zhang , Jingyan Shen , Xiaoxue Xiong , Yongchan Kwon

Time Series Foundation Models (TSFMs) advance generalization and data efficiency in time series forecasting by unified large-scale pretraining. But TSFMs remain lacking when adapting to specific downstream forecasting tasks for two reasons.…

Signal Processing · Electrical Eng. & Systems 2026-05-04 Siyang Li , Yize Chen , Zijie Zhu , Yuxin Pan , Yan Guo , Ming Huang , Hui Xiong

To improve the problem that the parameter identification for fuzzy neural network has many time complexities in calculating, an improved T-S fuzzy inference method and an parameter identification method for fuzzy neural network are…

Neural and Evolutionary Computing · Computer Science 2014-12-30 Chol Man Ho , Son Il Gwak , Song Ho Pak , Jong Won Ha

Diffusion models have achieved state-of-the-art performance in generative modeling tasks across various domains. Prior works on time series diffusion models have primarily focused on developing conditional models tailored to specific…

Machine Learning · Computer Science 2023-11-23 Marcel Kollovieh , Abdul Fatir Ansari , Michael Bohlke-Schneider , Jasper Zschiegner , Hao Wang , Yuyang Wang