English
Related papers

Related papers: HPMixer: Hierarchical Patching for Multivariate Ti…

200 papers

Hierarchical forecasting problems arise when time series have a natural group structure, and predictions at multiple levels of aggregation and disaggregation across the groups are needed. In such problems, it is often desired to satisfy the…

Machine Learning · Computer Science 2023-04-12 Kin G. Olivares , O. Nganba Meetei , Ruijun Ma , Rohan Reddy , Mengfei Cao , Lee Dicker

In the context of increasing demands for long-term multi-energy load forecasting in real-world applications, this paper introduces Patchformer, a novel model that integrates patch embedding with encoder-decoder Transformer-based…

Machine Learning · Computer Science 2024-04-17 Qiuyi Hong , Fanlin Meng , Felipe Maldonado

Accurate forecasting of multivariate time series remains challenging due to the need to capture both short-term fluctuations and long-range temporal dependencies. Transformer-based models have emerged as a powerful approach, but their…

Machine Learning · Computer Science 2026-03-26 Aymane Harkati , Moncef Garouani , Olivier Teste , Julien Aligon , Mohamed Hamlich

Time series forecasting is a critical and challenging task in practical application. Recent advancements in pre-trained foundation models for time series forecasting have gained significant interest. However, current methods often overlook…

Machine Learning · Computer Science 2024-08-02 Shubao Zhao , Ming Jin , Zhaoxiang Hou , Chengyi Yang , Zengxiang Li , Qingsong Wen , Yi Wang

Transformers have established themselves as the leading neural network model in natural language processing and are increasingly foundational in various domains. In vision, the MLP-Mixer model has demonstrated competitive performance,…

Machine Learning · Computer Science 2024-06-19 Ryo Karakida , Toshihiro Ota , Masato Taki

Transformer-based time series forecasting has recently gained strong interest due to the ability of transformers to model sequential data. Most of the state-of-the-art architectures exploit either temporal or inter-channel dependencies,…

Machine Learning · Computer Science 2025-03-25 Davide Villaboni , Alberto Castellini , Ivan Luciano Danesi , Alessandro Farinelli

Financial time-series forecasting in real-world high-frequency markets is often hindered by delayed or partially stale observations caused by asynchronous data acquisition and transmission latency. To better reflect such practical…

Artificial Intelligence · Computer Science 2026-03-24 Tianyou Lai , Wentao Yue , Jiayi Zhou , Chaoyuan Hao , Lingke Chang , Qingyu Mao , Zhibo Niu , Qilei Li

In the last few years, the success of Transformers in computer vision has stimulated the discovery of many alternative models that compete with Transformers, such as the MLP-Mixer. Despite their weak inductive bias, these models have…

Machine Learning · Computer Science 2024-04-02 Toshihiro Ota , Masato Taki

Randomized neural networks for representation learning have consistently achieved prominent results in texture recognition tasks, effectively combining the advantages of both traditional techniques and learning-based approaches. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Ricardo T. Fares , Lucas C. Ribas

We introduce a framework to dynamically combine heterogeneous models called \texttt{DYCHEM}, which forecasts a set of time series that are related through an aggregation hierarchy. Different types of forecasting models can be employed as…

Machine Learning · Computer Science 2023-01-18 Xing Han , Jing Hu , Joydeep Ghosh

Long-term time series forecasting plays an important role in various real-world scenarios. Recent deep learning methods for long-term series forecasting tend to capture the intricate patterns of time series by decomposition-based or…

Machine Learning · Computer Science 2023-06-13 Xing Wang , Zhendong Wang , Kexin Yang , Junlan Feng , Zhiyan Song , Chao Deng , Lin zhu

The hierarchical Dirichlet process (HDP) has become an important Bayesian nonparametric model for grouped data, such as document collections. The HDP is used to construct a flexible mixed-membership model where the number of components is…

Machine Learning · Statistics 2012-01-10 Chong Wang , David M. Blei

Recently, there has been a growing interest in Long-term Time Series Forecasting (LTSF), which involves predicting long-term future values by analyzing a large amount of historical time-series data to identify patterns and trends. There…

Machine Learning · Computer Science 2026-02-17 Aitian Ma , Dongsheng Luo , Mo Sha

Coherently forecasting the behaviour of a target variable across both coarse and fine temporal scales is crucial for profit-optimized decision-making in several business applications, and remains an open research problem in temporal…

Machine Learning · Computer Science 2025-06-25 Alessandro Salatiello , Stefan Birr , Manuel Kunz

We present Hierarchical Memory Matching Network (HMMN) for semi-supervised video object segmentation. Based on a recent memory-based method [33], we propose two advanced memory read modules that enable us to perform memory reading in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Hongje Seong , Seoung Wug Oh , Joon-Young Lee , Seongwon Lee , Suhyeon Lee , Euntai Kim

Designing effective models for learning time series representations is foundational for time series analysis. Many previous works have explored time series representation modeling approaches and have made progress in this area. Despite…

Machine Learning · Computer Science 2024-12-17 Mingyue Cheng , Jiqian Yang , Tingyue Pan , Qi Liu , Zhi Li

Irregular multivariate time series forecasting (IMTSF) is challenging due to non-uniform sampling and variable asynchronicity. These irregularities violate the equidistant assumptions of standard models, hindering local temporal modeling…

Machine Learning · Computer Science 2026-02-03 Xiangfei Qiu , Kangjia Yan , Xvyuan Liu , Xingjian Wu , Jilin Hu

Multi-horizon forecasting problems often contain a complex mix of inputs -- including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed historically -- without any prior…

Machine Learning · Statistics 2020-09-29 Bryan Lim , Sercan O. Arik , Nicolas Loeff , Tomas Pfister

Traditional deep learning relies on end-to-end backpropagation for training, but it suffers from drawbacks such as high memory consumption and not aligning with biological neural networks. Recent advancements have introduced locally…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Junhao Su , Chenghao He , Feiyu Zhu , Xiaojie Xu , Dongzhi Guan , Chenyang Si

Data-driven weather models have advanced global medium-range forecasting, yet high-resolution regional prediction remains challenging due to unresolved multiscale interactions between large-scale dynamics and small-scale processes such as…

Machine Learning · Computer Science 2026-03-31 Weiqi Chen , Wenwei Wang , Qilong Yuan , Lefei Shen , Bingqing Peng , Jiawei Chen , Bo Wu , Liang Sun