English
Related papers

Related papers: TSMixer: An All-MLP Architecture for Time Series F…

200 papers

Recent Transformer-based large language models (LLMs) demonstrate in-context learning ability to perform various functions based solely on the provided context, without updating model parameters. To fully utilize the in-context capabilities…

Machine Learning · Computer Science 2026-02-06 Jiecheng Lu , Yan Sun , Shihao Yang

The rapid development of time series forecasting research has brought many deep learning-based modules in this field. However, despite the increasing amount of new forecasting architectures, it is still unclear if we have leveraged the full…

Machine Learning · Computer Science 2025-10-24 Difan Deng , Marius Lindauer

Sequence and channel mixers, the core mechanism in sequence models, have become the de facto standard in time series analysis (TSA). However, recent studies have questioned the necessity of complex sequence mixers, such as attention…

Machine Learning · Computer Science 2025-08-14 TaekHyun Park , Yongjae Lee , Daesan Park , Dohee Kim , Hyerim Bae

Deep models have demonstrated remarkable performance in time series forecasting. However, due to the partially-observed nature of real-world applications, solely focusing on the target of interest, so-called endogenous variables, is usually…

Machine Learning · Computer Science 2024-11-12 Yuxuan Wang , Haixu Wu , Jiaxiang Dong , Guo Qin , Haoran Zhang , Yong Liu , Yunzhong Qiu , Jianmin Wang , Mingsheng Long

Time series forecasting (TSF) is critical in domains like energy, finance, healthcare, and logistics, requiring models that generalize across diverse datasets. Large pre-trained models such as Chronos and Time-MoE show strong zero-shot (ZS)…

Machine Learning · Computer Science 2026-05-25 Liran Nochumsohn , Raz Marshanski , Hedi Zisling , Omri Azencot

In the last few years, the success of Transformers in computer vision has stimulated the discovery of many alternative models that compete with Transformers, such as the MLP-Mixer. Despite their weak inductive bias, these models have…

Machine Learning · Computer Science 2024-04-02 Toshihiro Ota , Masato Taki

In the burgeoning ecosystem of Internet of Things, multivariate time series (MTS) data has become ubiquitous, highlighting the fundamental role of time series forecasting across numerous applications. The crucial challenge of long-term MTS…

Machine Learning · Computer Science 2024-11-06 Zhenwei Zhang , Linghang Meng , Yuantao Gu

Multivariate time series (MTS) forecasting is crucial in many real-world applications. To achieve accurate MTS forecasting, it is essential to simultaneously consider both intra- and inter-series relationships among time series data.…

Machine Learning · Computer Science 2024-02-26 Kun Yi , Qi Zhang , Hui He , Kaize Shi , Liang Hu , Ning An , Zhendong Niu

Large pre-trained language models based on transformer architecture have drastically changed the natural language processing (NLP) landscape. However, deploying those models for on-device applications in constrained devices such as smart…

Computation and Language · Computer Science 2023-05-26 Francesco Fusco , Damian Pascual , Peter Staar , Diego Antognini

Time series~(TS) modeling is essential in dynamic systems like weather prediction and anomaly detection. Recent studies utilize Large Language Models (LLMs) for TS modeling, leveraging their powerful pattern recognition capabilities. These…

Machine Learning · Computer Science 2024-10-23 Can Chen , Gabriel Oliveira , Hossein Sharifi Noghabi , Tristan Sylvain

Although many complex models were proposed to analyze time series data, some studies have demonstrated remarkable performance with simpler structures. A recent study proposed a non-parametric framework for 3D point cloud classification,…

Machine Learning · Computer Science 2026-05-12 Bowen Liu , Haijian Lai , Chan-Tong Lam , Junhao Dong , Benjamin Ng , Wei Ke , Sio-Kei Im

Multivariate Time Series forecasting has been an increasingly popular topic in various applications and scenarios. Recently, contrastive learning and Transformer-based models have achieved good performance in many long-term series…

Machine Learning · Computer Science 2023-01-24 Zhe Li , Zhongwen Rao , Lujia Pan , Pengyun Wang , Zenglin Xu

Multimodal time series forecasting has garnered significant attention for its potential to provide more accurate predictions than traditional single-modality models by leveraging rich information inherent in other modalities. However, due…

Machine Learning · Computer Science 2026-02-26 Jiafeng Lin , Yuxuan Wang , Huakun Luo , Zhongyi Pei , Jianmin Wang

Sequential recommendation, a critical task in recommendation systems, predicts the next user action based on the understanding of the user's historical behaviors. Conventional studies mainly focus on cross-behavior modeling with…

Information Retrieval · Computer Science 2025-06-23 Zhen Gong , Zhifang Fan , Hui Lu , Qiwei Chen , Chenbin Zhang , Lin Guan , Yuchao Zheng , Feng Zhang , Xiao Yang , Zuotao Liu

Traditional recurrent neural network architectures, such as long short-term memory neural networks (LSTM), have historically held a prominent role in time series forecasting (TSF) tasks. While the recently introduced sLSTM for Natural…

Machine Learning · Computer Science 2025-02-25 Yaxuan Kong , Zepu Wang , Yuqi Nie , Tian Zhou , Stefan Zohren , Yuxuan Liang , Peng Sun , Qingsong Wen

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

Machine Learning · Computer Science 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan

This study presents a novel time series prediction model, FPN-fusion, designed with linear computational complexity, demonstrating superior predictive performance compared to DLiner without increasing parameter count or computational…

Machine Learning · Computer Science 2024-06-12 Chu Li , Pingjia Xiao , Qiping Yuan

Time series analysis is crucial for understanding dynamics of complex systems. Recent advances in foundation models have led to task-agnostic Time Series Foundation Models (TSFMs) and Large Language Model-based Time Series Models (TSLLMs),…

Machine Learning · Computer Science 2025-03-17 Xu Liu , Taha Aksu , Juncheng Liu , Qingsong Wen , Yuxuan Liang , Caiming Xiong , Silvio Savarese , Doyen Sahoo , Junnan Li , Chenghao Liu

While previous research in multivariate time series forecasting has focused on developing complex holistic models, this work advocates for a shift toward a granular, component-level understanding of their impacts. We propose TSCOMP, the…

Machine Learning · Computer Science 2026-05-27 Shuang Liang , Chaochuan Hou , Xu Yao , Shiping Wang , Hailiang Huang , Songqiao Han , Minqi Jiang

Industrial recommender systems critically depend on high-quality ranking models. However, traditional pipelines still rely on manual feature engineering and scenario-specific architectures, which hinder cross-scenario transfer and…

Information Retrieval · Computer Science 2025-10-20 Xianyang Qi , Yuan Tian , Zhaoyu Hu , Zhirui Kuai , Chang Liu , Hongxiang Lin , Lei Wang