English
Related papers

Related papers: CSformer: Combining Channel Independence and Mixin…

200 papers

Anomaly detection on multivariate time-series is of great importance in both data mining research and industrial applications. Recent approaches have achieved significant progress in this topic, but there is remaining limitations. One major…

Machine Learning · Computer Science 2020-09-07 Hang Zhao , Yujing Wang , Juanyong Duan , Congrui Huang , Defu Cao , Yunhai Tong , Bixiong Xu , Jing Bai , Jie Tong , Qi Zhang

Deep multimodal fusion by using multiple sources of data for classification or regression has exhibited a clear advantage over the unimodal counterpart on various applications. Yet, current methods including aggregation-based and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Yikai Wang , Wenbing Huang , Fuchun Sun , Tingyang Xu , Yu Rong , Junzhou Huang

The self-attention mechanism in Transformer architecture, invariant to sequence order, necessitates positional embeddings to encode temporal order in time series prediction. We argue that this reliance on positional embeddings restricts the…

Machine Learning · Computer Science 2024-08-21 Yongbo Yu , Weizhong Yu , Feiping Nie , Xuelong Li

Time series analysis finds wide applications in fields such as weather forecasting, anomaly detection, and behavior recognition. Previous methods attempted to model temporal variations directly using 1D time series. However, this has been…

Machine Learning · Computer Science 2024-11-08 Qiang Wu , Gechang Yao , Zhixi Feng , Shuyuan Yang

In this paper, we introduce Masked Multi-Step Multivariate Forecasting (MMMF), a novel and general self-supervised learning framework for time series forecasting with known future information. In many real-world forecasting scenarios, some…

Machine Learning · Computer Science 2022-09-30 Yiwei Fu , Honggang Wang , Nurali Virani

Multitemporal hyperspectral image unmixing (MTHU) holds significant importance in monitoring and analyzing the dynamic changes of surface. However, compared to single-temporal unmixing, the multitemporal approach demands comprehensive…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Hang Li , Qiankun Dong , Xueshuo Xie , Xia Xu , Tao Li , Zhenwei Shi

Time series forecasting is essential for many practical applications, with the adoption of transformer-based models on the rise due to their impressive performance in NLP and CV. Transformers' key feature, the attention mechanism,…

Machine Learning · Computer Science 2024-02-09 PeiSong Niu , Tian Zhou , Xue Wang , Liang Sun , Rong Jin

In interference channels, channel state information (CSI) can be exploited to reduce the interference signal dimensions and thus achieve the optimal capacity scaling, i.e. degrees of freedom, promised by the interference alignment…

Information Theory · Computer Science 2017-01-03 Zhinan Xu , Markus Hofer , Thomas Zemen

Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting…

Machine Learning · Computer Science 2021-01-18 Kashif Rasul , Abdul-Saboor Sheikh , Ingmar Schuster , Urs Bergmann , Roland Vollgraf

Multivariate time series (MTS) forecasting is vital across various domains but remains challenging due to the need to simultaneously model temporal and inter-variate dependencies. Existing channel-dependent models, where Transformer-based…

Machine Learning · Computer Science 2025-02-03 Junwoo Ha , Hyukjae Kwon , Sungsoo Kim , Kisu Lee , Seungjae Park , Ha Young Kim

This paper presents a statistical block fading channel model for multiuser massive MIMO system. The proposed channel model is evolved from correlation based stochastic channel model (CBSCM) but in addition to the properties of CBSCM, it has…

Information Theory · Computer Science 2016-04-05 Suresh Dahiya

Extending the forecasting time is a critical demand for real applications, such as extreme weather early warning and long-term energy consumption planning. This paper studies the long-term forecasting problem of time series. Prior…

Machine Learning · Computer Science 2022-01-10 Haixu Wu , Jiehui Xu , Jianmin Wang , Mingsheng Long

In this paper, a novel time-based modulation scheme is proposed in the time-asynchronous channel for diffusion-based molecular communication systems with drift. Based on this modulation scheme, we demonstrate that the sample variance of…

Information Theory · Computer Science 2019-05-31 Qingchao Li

Imputing missing values in multivariate time series remains challenging, especially under diverse missing patterns and heavy missingness. Existing methods suffer from suboptimal performance as corrupted temporal features hinder effective…

Machine Learning · Computer Science 2026-04-07 Dongik Park , Hyunwoo Ryu , Suahn Bae , Keondo Park , Hyung-Sin Kim

In the context of increasing demands for long-term multi-energy load forecasting in real-world applications, this paper introduces Patchformer, a novel model that integrates patch embedding with encoder-decoder Transformer-based…

Machine Learning · Computer Science 2024-04-17 Qiuyi Hong , Fanlin Meng , Felipe Maldonado

Forecasting multivariate time series data, such as prediction of electricity consumption, solar power production, and polyphonic piano pieces, has numerous valuable applications. However, complex and non-linear interdependencies between…

Machine Learning · Computer Science 2019-09-20 Shun-Yao Shih , Fan-Keng Sun , Hung-yi Lee

Designing effective models for learning time series representations is foundational for time series analysis. Many previous works have explored time series representation modeling approaches and have made progress in this area. Despite…

Machine Learning · Computer Science 2024-12-17 Mingyue Cheng , Jiqian Yang , Tingyue Pan , Qi Liu , Zhi Li

Transformers have been actively studied for time-series forecasting in recent years. While often showing promising results in various scenarios, traditional Transformers are not designed to fully exploit the characteristics of time-series…

Machine Learning · Computer Science 2022-06-22 Gerald Woo , Chenghao Liu , Doyen Sahoo , Akshat Kumar , Steven Hoi

Multivariate time series (MTS) forecasting is vital in fields like weather, energy, and finance. However, despite deep learning advancements, traditional Transformer-based models often diminish the effect of crucial inter-variable…

Machine Learning · Computer Science 2025-03-03 Yanhong Li , David C. Anastasiu

Time series forecasting is a subject of significant scientific and industrial importance. Despite the widespread utilization of forecasting methods, there is a dearth of research aimed at comprehending the conditions under which these…

Machine Learning · Computer Science 2024-10-23 Moisés Santos , André de Carvalho , Carlos Soares