English
Related papers

Related papers: FaCTR: Factorized Channel-Temporal Representation …

200 papers

We propose an efficient fine-tuning method for time series foundation models, termed TRACE: Time Series Parameter Efficient Fine-tuning. While pretrained time series foundation models are gaining popularity, they face the following…

Machine Learning · Computer Science 2025-11-24 Yuze Li , Wei Zhu

Survival analysis is a critical tool for modeling time-to-event data. Recent deep learning-based models have reduced various modeling assumptions including proportional hazard and linearity. However, a persistent challenge remains in…

Machine Learning · Computer Science 2025-12-30 Maxmillan Ries , Sohan Seth

Spatial and time-dependent data is of interest in many applications. This task is difficult due to its complex spatial dependency, long-range temporal dependency, data non-stationarity, and data heterogeneity. To address these challenges,…

Machine Learning · Computer Science 2021-01-11 Yang Li , José M. F. Moura

The rise of foundation models has revolutionized natural language processing and computer vision, yet their best practices to time series forecasting remains underexplored. Existing time series foundation models often adopt methodologies…

Machine Learning · Computer Science 2025-03-04 Xiaobin Hong , Jiawen Zhang , Wenzhong Li , Sanglu Lu , Jia Li

With the tremendous success of large transformer models in natural language understanding, down-sizing them for cost-effective deployments has become critical. Recent studies have explored the low-rank weight factorization techniques which…

Computation and Language · Computer Science 2023-12-21 Rahul Chand , Yashoteja Prabhu , Pratyush Kumar

Federated recommendations (FRs) have emerged as an on-device privacy-preserving paradigm, attracting considerable attention driven by rising demands for data security. Existing FRs predominantly adapt ID embeddings to represent items,…

Information Retrieval · Computer Science 2026-04-10 Kang Fu , Honglei Zhang , Zikai Zhang , Jundong Chen , Xin Zhou , Zhiqi Shen , Dusit Niyato , Yidong Li

Firms earning prediction plays a vital role in investment decisions, dividends expectation, and share price. It often involves multiple tensor-compatible datasets with non-linear multi-way relationships, spatiotemporal structures, and…

Machine Learning · Computer Science 2021-09-07 Ajim Uddin , Dan Zhou , Xinyuan Tao , Chia-Ching Chou , Dantong Yu

In recent years, live streaming platforms have gained immense popularity as they allow users to broadcast their videos and interact in real-time with hosts and peers. Due to the dynamic changes of live content, accurate recommendation…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jiaxin Deng , Dong Shen , Shiyao Wang , Xiangyu Wu , Fan Yang , Guorui Zhou , Gaofeng Meng

Transformers for time series forecasting mainly model time series from limited or fixed scales, making it challenging to capture different characteristics spanning various scales. We propose Pathformer, a multi-scale Transformer with…

Machine Learning · Computer Science 2024-09-17 Peng Chen , Yingying Zhang , Yunyao Cheng , Yang Shu , Yihang Wang , Qingsong Wen , Bin Yang , Chenjuan Guo

The Transformer architecture has shown significant success in many language processing and visual tasks. However, the method faces challenges in efficiently scaling to long sequences because the self-attention computation is quadratic with…

Machine Learning · Computer Science 2025-05-05 Edison Mucllari , Zachary Daniels , David Zhang , Qiang Ye

Self-supervised learning has garnered increasing attention in time series analysis for benefiting various downstream tasks and reducing reliance on labeled data. Despite its effectiveness, existing methods often struggle to comprehensively…

Machine Learning · Computer Science 2025-06-12 Daoyu Wang , Mingyue Cheng , Zhiding Liu , Qi Liu

In multivariate time series forecasting (MTSF), accurately modeling the intricate dependencies among multiple variables remains a significant challenge due to the inherent limitations of traditional approaches. Most existing models adopt…

Machine Learning · Computer Science 2025-11-19 Yuchen Luo , Xinyu Li , Liuhua Peng , Mingming Gong

We introduce Temporal Variational Implicit Neural Representations (TV-INRs), a probabilistic framework for modeling irregular multivariate time series that enables efficient individualized imputation and forecasting. By integrating implicit…

Machine Learning · Computer Science 2025-06-03 Batuhan Koyuncu , Rachael DeVries , Ole Winther , Isabel Valera

In this paper, we address the challenge of multivariate time-series forecasting using quantum machine learning techniques. We introduce adaptation strategies that extend variational quantum circuit models, traditionally limited to…

The massive generation of time-series data by largescale Internet of Things (IoT) devices necessitates the exploration of more effective models for multivariate time-series forecasting. In previous models, there was a predominant use of the…

Machine Learning · Computer Science 2024-03-15 Wenyong Han , Tao Zhu Member , Liming Chen , Huansheng Ning , Yang Luo , Yaping Wan

Time series data often contain latent temporal structure, transitions between locally stationary regimes, repeated motifs, and bursts of variability, that are rarely leveraged in standard representation learning pipelines. Existing models…

Machine Learning · Computer Science 2025-10-13 Disharee Bhowmick , Ranjith Ramanathan , Sathyanarayanan N. Aakur

Time series forecasting is extensively applied across diverse domains. Transformer-based models demonstrate significant potential in modeling cross-time and cross-variable interaction. However, we notice that the cross-variable correlation…

Machine Learning · Computer Science 2024-10-08 Ao Hu , Dongkai Wang , Yong Dai , Shiyi Qi , Liangjian Wen , Jun Wang , Zhi Chen , Xun Zhou , Zenglin Xu , Jiang Duan

In time series classification and regression, signals are typically mapped into some intermediate representation used for constructing models. Since the underlying task is often insensitive to time shifts, these representations are required…

Sound · Computer Science 2019-07-16 Joakim Andén , Vincent Lostanlen , Stéphane Mallat

Transformers have achieved superior performances in many tasks in natural language processing and computer vision, which also triggered great interest in the time series community. Among multiple advantages of Transformers, the ability to…

Machine Learning · Computer Science 2023-05-15 Qingsong Wen , Tian Zhou , Chaoli Zhang , Weiqi Chen , Ziqing Ma , Junchi Yan , Liang Sun

Accurate prediction of driving intention is key to enhancing the safety and interactive efficiency of human-machine co-driving systems. It serves as a cornerstone for achieving high-level autonomous driving. However, current approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Sirui Wang , Zhou Guan , Bingxi Zhao , Tongjia Gu , Jie Liu