English
Related papers

Related papers: TACTiS-2: Better, Faster, Simpler Attentional Copu…

200 papers

Attention mechanisms have been extensively employed in various applications, including time series modeling, owing to their capacity to capture intricate dependencies; however, their utility is often constrained by quadratic computational…

Machine Learning · Computer Science 2025-11-06 Mingtao Zhang , Guoli Yang , Zhanxing Zhu , Mengzhu Wang , Xiaoying Bai

We introduce a neural network conformal prediction method for time series that enhances adaptivity in non-stationary environments. Our approach acts as a neural controller designed to achieve desired target coverage, leveraging auxiliary…

Machine Learning · Computer Science 2024-12-25 Ruipu Li , Alexander Rodríguez

This paper presents $\textbf{CAPS}$ (Clock-weighted Aggregation with Prefix-products and Softmax), a structured attention mechanism for time series forecasting that decouples three distinct temporal structures: global trends, local shocks,…

Machine Learning · Computer Science 2026-02-04 Viresh Pati , Yubin Kim , Vinh Pham , Jevon Twitty , Shihao Yang , Jiecheng Lu

Time series forecasting is a key component in many industrial and business decision processes and recurrent neural network (RNN) based models have achieved impressive progress on various time series forecasting tasks. However, most of the…

Machine Learning · Computer Science 2021-01-26 Zekai Chen , Jiaze E , Xiao Zhang , Hao Sheng , Xiuzheng Cheng

Copulas provide an attractive approach for constructing multivariate distributions with flexible marginal distributions and different forms of dependences. Of particular importance in many areas is the possibility of explicitly forecasting…

Methodology · Statistics 2018-05-22 Feng Li , Yanfei Kang

We study the forecasting problem for traffic with dynamic, possibly periodical, and joint spatial-temporal dependency between regions. Given the aggregated inflow and outflow traffic of regions in a city from time slots 0 to t-1, we predict…

Machine Learning · Computer Science 2022-05-05 Guanyao Li , Shuhan Zhong , S. -H. Gary Chan , Ruiyuan Li , Chih-Chieh Hung , Wen-Chih Peng

Modeling of longitudinal cohort data typically involves complex temporal dependencies between multiple variables. There, the transformer architecture, which has been highly successful in language and vision applications, allows us to…

Accurate analysis of medical time series (MedTS) data, such as electroencephalography (EEG) and electrocardiography (ECG), plays a pivotal role in healthcare applications, including the diagnosis of brain and heart diseases. MedTS data…

Machine Learning · Computer Science 2026-05-08 Guoqi Yu , Juncheng Wang , Chen Yang , Jing Qin , Angelica I. Aviles-Rivero , Shujun Wang

Recent research demonstrates that linear models achieve forecasting performance competitive with complex architectures, yet methodologies for enhancing linear models remain underexplored. Motivated by the hypothesis that distinct time…

Machine Learning · Computer Science 2025-10-13 Zipo Jibao , Yingyi Fu , Xinyang Chen , Guoting Chen

Probabilistic forecasting of multivariate time series is essential for various downstream tasks. Most existing approaches rely on the sequences being uniformly spaced and aligned across all variables. However, real-world multivariate time…

Machine Learning · Computer Science 2025-02-18 Yijun Li , Cheuk Hang Leung , Qi Wu

Conformal prediction has been explored as a general and efficient way to provide uncertainty quantification for time series. However, current methods struggle to handle time series data with change points - sudden shifts in the underlying…

Machine Learning · Computer Science 2025-12-02 Sophia Sun , Rose Yu

The imputation of the Multivariate time series (MTS) is particularly challenging since the MTS typically contains irregular patterns of missing values due to various factors such as instrument failures, interference from irrelevant data,…

Machine Learning · Computer Science 2025-04-04 Ye Su , Hezhe Qiao , Di Wu , Yuwen Chen , Lin Chen

Bayesian computation for filtering and forecasting analysis is developed for a broad class of dynamic models. The ability to scale-up such analyses in non-Gaussian, nonlinear multivariate time series models is advanced through the…

Methodology · Statistics 2022-06-07 Isaac Lavine , Andrew Cron , Mike West

Multivariate forecasting with Transformers faces a core scalability challenge: modeling cross-channel dependencies via attention compounds attention's quadratic sequence complexity with quadratic channel scaling, making full cross-channel…

Machine Learning · Computer Science 2026-05-12 Willa Potosnak , Nina Żukowska , Michał Wiliński , Dan Howarth , Ignacy Stępka , Mononito Goswami , Artur Dubrawski

Real-world time series often exhibit a non-stationary nature, degrading the performance of pre-trained forecasting models. Test-Time Adaptation (TTA) addresses this by adjusting models during inference, but existing methods typically update…

Machine Learning · Computer Science 2025-07-01 Heitor R. Medeiros , Hossein Sharifi-Noghabi , Gabriel L. Oliveira , Saghar Irandoust

Copulas, generalized estimating equations, and generalized linear mixed models promote the analysis of grouped data where non-normal responses are correlated. Unfortunately, parameter estimation remains challenging in these three…

Methodology · Statistics 2024-10-16 Sarah S. Ji , Benjamin B. Chu , Hua Zhou , Kenneth Lange

We introduce CopFITi, a copula model for probabilistic forecasting of irregular multivariate time series (IMTS). Our model combines the expressivity of normalizing flows for univariate marginals with the consistency and flexibility of a…

Machine Learning · Computer Science 2026-05-25 Christian Klötergens , Tom Hanika , Lars Schmidt-Thieme , Vijaya Krishna Yalavarthi

Test-Time Optimization enables models to adapt to new data during inference by updating parameters on-the-fly. Recent advances in Vision-Language Models (VLMs) have explored learning prompts at test time to improve performance in downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Dhruv Sarkar , Aprameyo Chakrabartty , Bibhudatta Bhanja

Continual Test-Time Adaptation (CTA) is a challenging task that aims to adapt a source pre-trained model to continually changing target domains. In the CTA setting, a model does not know when the target domain changes, thus facing a drastic…

Machine Learning · Computer Science 2024-03-05 Inseop Chung , Kyomin Hwang , Jayeon Yoo , Nojun Kwak

Irregular Multivariate Time Series (IMTS) are characterized by uneven intervals between consecutive timestamps, which carry sampling pattern information valuable and informative for learning temporal and variable dependencies. In addition,…

Machine Learning · Computer Science 2026-02-26 Boyuan Li , Zhen Liu , Yicheng Luo , Qianli Ma