English
Related papers

Related papers: MixLinear: Extreme Low Resource Multivariate Time …

200 papers

Time series forecasting is a crucial task in various domains. Caused by factors such as trends, seasonality, or irregular fluctuations, time series often exhibits non-stationary. It obstructs stable feature propagation through deep layers,…

Machine Learning · Computer Science 2024-01-05 Xiang Ma , Xuemei Li , Lexin Fang , Tianlong Zhao , Caiming Zhang

We consider the problem of learning a mixture of linear regressions (MLRs). An MLR is specified by $k$ nonnegative mixing weights $p_1, \ldots, p_k$ summing to $1$, and $k$ unknown regressors $w_1,...,w_k\in\mathbb{R}^d$. A sample from the…

Data Structures and Algorithms · Computer Science 2019-12-18 Sitan Chen , Jerry Li , Zhao Song

Time series forecasting (TSF) plays a crucial role in various domains, including web data analysis, energy consumption prediction, and weather forecasting. While Multi-Layer Perceptrons (MLPs) are lightweight and effective for capturing…

Machine Learning · Computer Science 2026-03-05 Zhengnan Li , Haoxuan Li , Hao Wang , Jun Fang , Yuting Tan , Xilong Cheng Yunxiao Qin

Transformer-based models have recently become dominant in Long-term Time Series Forecasting (LTSF), yet the variations in their architecture, such as encoder-only, encoder-decoder, and decoder-only designs, raise a crucial question: What…

Machine Learning · Computer Science 2025-07-18 Lefei Shen , Mouxiang Chen , Han Fu , Xiaoxue Ren , Xiaoyun Joy Wang , Jianling Sun , Zhuo Li , Chenghao Liu

Time series forecasting is a fundamental problem with applications in climate, energy, healthcare, and finance. Many existing approaches require domain-specific feature engineering and substantial labeled data for each task. We introduce…

Machine Learning · Computer Science 2026-01-29 Olaf Yunus Laitinen Imanov , Derya Umut Kulali , Taner Yilmaz

Accurate forecasting of sequential data streams is a cornerstone of modern Web services, supporting applications such as traffic management, user behavior modeling, and online anomaly prevention. However, in many Web environments, new…

Machine Learning · Computer Science 2026-02-02 Shichao Ma , Zhengyang Zhou , Qihe Huang , Binwu Wang , Yang Wang

Short Term Load forecasting in this paper uses input data dependent on parameters such as load for current hour and previous two hours, temperature for current hour and previous two hours, wind for current hour and previous two hours, cloud…

Neural and Evolutionary Computing · Computer Science 2009-12-08 Mrs. J. P. Rothe , Dr. A. K. Wadhwani , Dr. Mrs. S. Wadhwani

While Transformers excel in language and vision-where inputs are semantically rich and exhibit univariate dependency structures-their architectural complexity leads to diminishing returns in time series forecasting. Time series data is…

Machine Learning · Computer Science 2025-06-09 Yash Vijay , Harini Subramanyan

Long-term time series forecasting (LTSF) is a challenging task that has been investigated in various domains such as finance investment, health care, traffic, and weather forecasting. In recent years, Linear-based LTSF models showed better…

Machine Learning · Computer Science 2023-11-13 Seonkyu Lim , Jaehyeon Park , Seojin Kim , Hyowon Wi , Haksoo Lim , Jinsung Jeon , Jeongwhan Choi , Noseong Park

Long-term weather forecasting is critical for socioeconomic planning and disaster preparedness. While recent approaches employ finetuning to extend prediction horizons, they remain constrained by the issues of catastrophic forgetting, error…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Hao Chen , Tao Han , Jie Zhang , Song Guo , Fenghua Ling , Lei Bai

Time series analysis provides essential insights for real-world system dynamics and informs downstream decision-making, yet most existing methods often overlook the rich contextual signals present in auxiliary modalities. To bridge this…

Machine Learning · Computer Science 2026-03-24 Yushan Jiang , Wenchao Yu , Geon Lee , Dongjin Song , Kijung Shin , Wei Cheng , Yanchi Liu , Haifeng Chen

Recently, large language models (LLMs) have demonstrated powerful capabilities in performing various tasks and thus are applied by recent studies to time series forecasting (TSF) tasks, which predict future values with the given historical…

Computation and Language · Computer Science 2025-07-15 Chen Su , Yuanhe Tian , Qinyu Liu , Jun Zhang , Yan Song

Tracking often uses a multi-stage pipeline of feature extraction, target information integration, and bounding box estimation. To simplify this pipeline and unify the process of feature extraction and target information integration, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yutao Cui , Cheng Jiang , Limin Wang , Gangshan Wu

Time series forecasting in specialized domains is often constrained by limited data availability, where conventional models typically require large-scale datasets to effectively capture underlying temporal dynamics. To tackle this few-shot…

Machine Learning · Computer Science 2026-02-03 Haonan Shi , Dehua Shuai , Liming Wang , Xiyang Liu , Long Tian

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

Machine Learning · Computer Science 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

Time series forecasting is crucial in many fields, yet current deep learning models struggle with noise, data sparsity, and capturing complex multi-scale patterns. This paper presents MFF-FTNet, a novel framework addressing these challenges…

Machine Learning · Computer Science 2024-11-27 Yangyang Shi , Qianqian Ren , Yong Liu , Jianguo Sun

This paper demonstrates the potentials of the long short-term memory (LSTM) when applyingwith macroeconomic time series data sampled at different frequencies. We first present how theconventional LSTM model can be adapted to the time series…

Econometrics · Economics 2021-09-29 Sarun Kamolthip

Time series forecasting is widely used in business intelligence, e.g., forecast stock market price, sales, and help the analysis of data trend. Most time series of interest are macroscopic time series that are aggregated from microscopic…

Machine Learning · Computer Science 2021-10-28 Zhibo Zhu , Ziqi Liu , Ge Jin , Zhiqiang Zhang , Lei Chen , Jun Zhou , Jianyong Zhou

Time-series forecasting often faces challenges due to data volatility, which can lead to inaccurate predictions. Variational Mode Decomposition (VMD) has emerged as a promising technique to mitigate volatility by decomposing data into…

Machine Learning · Computer Science 2024-09-05 Hafizh Raihan Kurnia Putra , Novanto Yudistira , Tirana Noor Fatyanosa

The long horizon forecasting (LHF) problem has come up in the time series literature for over the last 35 years or so. This review covers aspects of LHF in this period and how deep learning has incorporated variants of trend, seasonality,…

Machine Learning · Computer Science 2025-06-17 Hans Krupakar , Kandappan V A