English
Related papers

Related papers: Discovering Predictable Latent Factors for Time Se…

200 papers

Transformer-based methods have shown great potential in long-term time series forecasting. However, most of these methods adopt the standard point-wise self-attention mechanism, which not only becomes intractable for long-term forecasting…

Machine Learning · Computer Science 2022-02-24 Dazhao Du , Bing Su , Zhewei Wei

We present a new method for forecasting systems of multiple interrelated time series. The method learns the forecast models together with discovering leading indicators from within the system that serve as good predictors improving the…

Machine Learning · Statistics 2017-10-03 Magda Gregorova , Alexandros Kalousis , Stephane Marchand-Maillet

Many real-world time series exhibit strong periodic structures arising from physical laws, human routines, or seasonal cycles. However, modern deep forecasting models often fail to capture these recurring patterns due to spectral bias and a…

Machine Learning · Computer Science 2025-08-05 Menglin Kong , Vincent Zhihao Zheng , Lijun Sun

Time series forecasting is an important task in many fields ranging from supply chain management to weather forecasting. Recently, Transformer neural network architectures have shown promising results in forecasting on common time series…

Machine Learning · Computer Science 2024-08-08 Rares Cristian , Pavithra Harsha , Clemente Ocejo , Georgia Perakis , Brian Quanz , Ioannis Spantidakis , Hamza Zerhouni

Predictive linear and nonlinear models based on kernel machines or deep neural networks have been used to discover dependencies among time series. This paper proposes an efficient nonlinear modeling approach for multiple time series, with a…

Machine Learning · Computer Science 2023-10-02 Kevin Roy , Luis Miguel Lopez-Ramos , Baltasar Beferull-Lozano

Deep directed generative models have attracted much attention recently due to their expressive representation power and the ability of ancestral sampling. One major difficulty of learning directed models with many latent variables is the…

Machine Learning · Computer Science 2015-06-16 Siqi Nie , Qiang Ji

Reasoning models improve their problem-solving ability through inference-time scaling, allocating more compute via longer token budgets. Identifying which reasoning traces are likely to succeed remains a key opportunity: reliably predicting…

Artificial Intelligence · Computer Science 2025-10-14 Martina G. Vilas , Safoora Yousefi , Besmira Nushi , Eric Horvitz , Vidhisha Balachandran

The equations of complex dynamical systems may not be identified by expert knowledge, especially if the underlying mechanisms are unknown. Data-driven discovery methods address this challenge by inferring governing equations from…

Machine Learning · Computer Science 2026-02-05 Amit K. Chakraborty , Hao Wang , Pouria Ramazi

Transformers have demonstrated impressive strength in long-term series forecasting. Existing prediction research mostly focused on mapping past short sub-series (lookback window) to future series (forecast window). The longer training…

Machine Learning · Computer Science 2023-02-22 Julong Young , Junhui Chen , Feihu Huang , Jian Peng

Latent factor models are widely used to measure unobserved latent traits in social and behavioral sciences, including psychology, education, and marketing. When used in a confirmatory manner, design information is incorporated, yielding…

Methodology · Statistics 2019-06-14 Yunxiao Chen , Xiaoou Li , Siliang Zhang

Time series forecasting using historical data has been an interesting and challenging topic, especially when the data is corrupted by missing values. In many industrial problem, it is important to learn the inference function between the…

Machine Learning · Computer Science 2023-06-02 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Dzung Phan , Roman Vaculin , Jayant Kalagnanam

Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational…

Machine Learning · Computer Science 2023-01-06 Yan Li , Xinjiang Lu , Haoyi Xiong , Jian Tang , Jiantao Su , Bo Jin , Dejing Dou

This work considers estimation and forecasting in a multivariate, possibly high-dimensional count time series model constructed from a transformation of a latent Gaussian dynamic factor series. The estimation of the latent model parameters…

Methodology · Statistics 2025-04-07 Younghoon Kim , Marie-Christine Düker , Zachary F. Fisher , Vladas Pipiras

This paper develops the inferential theory for latent factor models estimated from large dimensional panel data with missing observations. We propose an easy-to-use all-purpose estimator for a latent factor model by applying principal…

Econometrics · Economics 2022-01-11 Ruoxuan Xiong , Markus Pelger

This paper is concerned with online time series forecasting, where unknown distribution shifts occur over time, i.e., latent variables influence the mapping from historical to future observations. To develop an automated way of online time…

Machine Learning · Computer Science 2025-10-22 Zijian Li , Changze Zhou , Minghao Fu , Sanjay Manjunath , Fan Feng , Guangyi Chen , Yingyao Hu , Ruichu Cai , Kun Zhang

We consider linear structural equation models with explicitly modelled latent variables. In such models, observed and latent variables solve linear equations including stochastic noise terms. The goal of our work is to identify the direct…

Methodology · Statistics 2026-05-28 Tom Hochsprung , Nils Sturma , Jakob Runge , Mathias Drton , Andreas Gerhardus

The paper develops a Transformer architecture for estimating dynamic factors from multivariate time series data under flexible identification assumptions. Performance on small datasets is improved substantially by using a conventional…

Econometrics · Economics 2026-01-21 Oliver Snellman

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

Time-series classification is an important domain of machine learning and a plethora of methods have been developed for the task. In comparison to existing approaches, this study presents a novel method which decomposes a time-series…

Machine Learning · Computer Science 2015-03-12 Josif Grabocka , Lars Schmidt-Thieme

Time-series forecasting plays an important role in many domains. Boosted by the advances in Deep Learning algorithms, it has for instance been used to predict wind power for eolic energy production, stock market fluctuations, or motor…

Machine Learning · Computer Science 2021-07-23 Luis P. Silvestrin , Leonardos Pantiskas , Mark Hoogendoorn