English
Related papers

Related papers: Less Is More: Fast Multivariate Time Series Foreca…

200 papers

Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer knowledge and…

Machine Learning · Computer Science 2025-01-14 Malcolm L. Wolff , Shenghao Yang , Kari Torkkola , Michael W. Mahoney

Nowadays, with the rising number of sensors in sectors such as healthcare and industry, the problem of multivariate time series classification (MTSC) is getting increasingly relevant and is a prime target for machine and deep learning…

Machine Learning · Computer Science 2022-04-12 Leonardos Pantiskas , Kees Verstoep , Mark Hoogendoorn , Henri Bal

A Multi-Layer Perceptron (MLP) defines a family of artificial neural networks often used in TS modeling and forecasting. Because of its "black box" aspect, many researchers refuse to use it. Moreover, the optimization (often based on the…

Neural and Evolutionary Computing · Computer Science 2014-07-09 Cyril Voyant , Wani W. Tamas , Marie Laure Nivet , Gilles Notton , Christophe Paoli , Aurélia Balu , Marc Muselli

Time series forecasting plays a pivotal role in critical sectors such as finance, energy, transportation, and meteorology. However, Long-term Time Series Forecasting (LTSF) remains a significant challenge because real-world signals contain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Xiang Ao

Multi-variate time series (MTS) forecasting is crucial for various applications. Existing methods have shown promising results owing to their strong ability to capture intra- and inter-variate dependencies. However, these methods often…

Machine Learning · Computer Science 2025-09-05 Binqing Wu , Zongjiang Shang , Jianlong Huang , Ling Chen

How can short-term energy consumption be accurately forecasted when sensor data is noisy, incomplete, and lacks contextual richness? This question guided our participation in the \textit{2025 Competition on Electric Energy Consumption…

Machine Learning · Computer Science 2025-10-21 Sarah Al-Shareeda , Gulcihan Ozdemir , Heung Seok Jeon , Khaleel Ahmad

Atomistic simulation methods have evolved through successive computational levels, each building upon more fundamental approaches: from quantum mechanics to density functional theory (DFT), and subsequently, to machine learning interatomic…

Short-term load forecasting (STLF) is vital for the effective and economic operation of power grids and energy markets. However, the non-linearity and non-stationarity of electricity demand as well as its dependency on various external…

Precise load forecasting in buildings could increase the bill savings potential and facilitate optimized strategies for power generation planning. With the rapid evolution of computer science, data-driven techniques, in particular the Deep…

Machine Learning · Computer Science 2023-01-30 Menna Nawar , Moustafa Shomer , Samy Faddel , Huangjie Gong

This study proposes a behaviorally-informed multi-factor stock selection framework that integrates short-cycle technical alpha signals with deep learning. We design a dual-task multilayer perceptron (MLP) that jointly predicts five-day…

Trading and Market Microstructure · Quantitative Finance 2025-08-21 Yuqi Luan

Predicting future values in multivariate time series is vital across various domains. This work explores the use of large language models (LLMs) for this task. However, LLMs typically handle one-dimensional data. We introduce MultiCast, a…

Machine Learning · Computer Science 2024-05-24 Georgios Chatzigeorgakidis , Konstantinos Lentzos , Dimitrios Skoutas

Multivariate time-series (MTS) forecasting is a paramount and fundamental problem in many real-world applications. The core issue in MTS forecasting is how to effectively model complex spatial-temporal patterns. In this paper, we develop a…

Machine Learning · Computer Science 2024-02-16 Jinliang Deng , Xiusi Chen , Renhe Jiang , Du Yin , Yi Yang , Xuan Song , Ivor W. Tsang

Deep learning is playing an increasingly important role in time series analysis. We focused on time series forecasting using attention free mechanism, a more efficient framework, and proposed a new architecture for time series prediction…

Machine Learning · Computer Science 2022-09-21 Hugo Inzirillo , Ludovic De Villelongue

Deep learning methods have been exerting their strengths in long-term time series forecasting. However, they often struggle to strike a balance between expressive power and computational efficiency. Resorting to multi-layer perceptrons…

Machine Learning · Computer Science 2024-05-21 Nannan Bian , Minhong Zhu , Li Chen , Weiran Cai

Transformers have become one of the most important architectural innovations in deep learning and have enabled many breakthroughs over the past few years. Here we propose a simple network architecture, gMLP, based on MLPs with gating, and…

Machine Learning · Computer Science 2021-06-03 Hanxiao Liu , Zihang Dai , David R. So , Quoc V. Le

Graph neural networks (GNNs) have gained considerable attention in recent years for traffic flow prediction due to their ability to learn spatio-temporal pattern representations through a graph-based message-passing framework. Although GNNs…

Machine Learning · Computer Science 2025-03-12 Qianru Zhang , Xinyi Gao , Haixin Wang , Siu-Ming Yiu , Hongzhi Yin

Multi-modal large language models (MLLMs) have enabled numerous advances in understanding and reasoning in domains like vision, but we have not yet seen this broad success for time-series. Although prior works on time-series MLLMs have…

Machine Learning · Computer Science 2024-12-05 Winnie Chow , Lauren Gardiner , Haraldur T. Hallgrímsson , Maxwell A. Xu , Shirley You Ren

Patch-wise Transformer based time series forecasting achieves superior accuracy. However, this superiority relies heavily on intricate model design with massive parameters, rendering both training and inference expensive, thus preventing…

Machine Learning · Computer Science 2025-01-22 Meng Wang , Jintao Yang , Bin Yang , Hui Li , Tongxin Gong , Bo Yang , Jiangtao Cui

This paper presents LightLM, a lightweight Transformer-based language model for generative recommendation. While Transformer-based generative modeling has gained importance in various AI sub-fields such as NLP and vision, generative…

Information Retrieval · Computer Science 2023-10-31 Kai Mei , Yongfeng Zhang

Traffic forecasting is pivotal for intelligent transportation systems, where accurate and interpretable predictions can significantly enhance operational efficiency and safety. A key challenge stems from the heterogeneity of traffic…

Machine Learning · Computer Science 2025-11-17 Seyed Mohamad Moghadas , Bruno Cornelis , Alexandre Alahi , Adrian Munteanu