English
Related papers

Related papers: PLanTS: Periodicity-aware Latent-state Representat…

200 papers

Despite significant advances in Large Reasoning Models (LRMs) driven by reinforcement learning with verifiable rewards (RLVR), this paradigm is fundamentally limited in specialized or novel domains where such supervision is prohibitively…

Machine Learning · Computer Science 2026-04-10 Sikai Bai , Haoxi Li , Jie Zhang , Yongjiang Liu , Song Guo

Contrastive learning methods have shown an impressive ability to learn meaningful representations for image or time series classification. However, these methods are less effective for time series forecasting, as optimization of instance…

Machine Learning · Computer Science 2024-11-13 Xiaochen Zheng , Xingyu Chen , Manuel Schürch , Amina Mollaysa , Ahmed Allam , Michael Krauthammer

This study proposes a unified forecasting framework for high-dimensional multi-task time series to meet the prediction demands of cloud native backend systems operating under highly dynamic loads, coupled metrics, and parallel tasks. The…

Machine Learning · Computer Science 2025-12-25 Zixiao Huang , Jixiao Yang , Sijia Li , Chi Zhang , Jinyu Chen , Chengda Xu

Irregular multivariate time series (IMTS) is characterized by the lack of synchronized observations across its different channels. In this paper, we point out that this channel-wise asynchrony can lead to poor channel-wise modeling of…

Machine Learning · Computer Science 2025-09-23 Shuhan Zhong , Weipeng Zhuo , Sizhe Song , Guanyao Li , Zhongyi Yu , S. -H. Gary Chan

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

Learning compressed representations of multivariate time series (MTS) facilitates data analysis in the presence of noise and redundant information, and for a large number of variates and time steps. However, classical dimensionality…

Neural and Evolutionary Computing · Computer Science 2019-07-17 Filippo Maria Bianchi , Lorenzo Livi , Karl Øyvind Mikalsen , Michael Kampffmeyer , Robert Jenssen

Multivariate Time-Series (MTS) clustering is crucial for signal processing and data analysis. Although deep learning approaches, particularly those leveraging Contrastive Learning (CL), are prominent for MTS representation, existing…

Machine Learning · Computer Science 2026-01-13 Zexi Tan , Tao Xie , Haoyi Xiao , Baoyao Yang , Yuzhu Ji , An Zeng , Xiang Zhang , Yiqun Zhang

Self-supervised learning (SSL) aims to eliminate one of the major bottlenecks in representation learning - the need for human annotations. As a result, SSL holds the promise to learn representations from data in-the-wild, i.e., without the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Senthil Purushwalkam , Pedro Morgado , Abhinav Gupta

The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens. The patch size controls…

Machine Learning · Computer Science 2024-03-25 Yitian Zhang , Liheng Ma , Soumyasundar Pal , Yingxue Zhang , Mark Coates

The lack of labeled data is a key challenge for learning useful representation from time series data. However, an unsupervised representation framework that is capable of producing high quality representations could be of great value. It is…

Machine Learning · Statistics 2022-03-18 Kristoffer Wickstrøm , Michael Kampffmeyer , Karl Øyvind Mikalsen , Robert Jenssen

Time series forecasting plays a pivotal role in critical sectors such as finance, energy, transportation, and meteorology. However, Long-term Time Series Forecasting (LTSF) remains a significant challenge because real-world signals contain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Xiang Ao

Latent linear dynamical systems with Bernoulli observations provide a powerful modeling framework for identifying the temporal dynamics underlying binary time series data, which arise in a variety of contexts such as binary decision-making…

Machine Learning · Statistics 2023-07-28 Iris R. Stone , Yotam Sagiv , Il Memming Park , Jonathan W. Pillow

Self-supervised learning (SSL) has recently achieved impressive performance on various time series tasks. The most prominent advantage of SSL is that it reduces the dependence on labeled data. Based on the pre-training and fine-tuning…

Machine Learning · Computer Science 2024-04-09 Kexin Zhang , Qingsong Wen , Chaoli Zhang , Rongyao Cai , Ming Jin , Yong Liu , James Zhang , Yuxuan Liang , Guansong Pang , Dongjin Song , Shirui Pan

In visual Reinforcement Learning (RL), learning from pixel-based observations poses significant challenges on sample efficiency, primarily due to the complexity of extracting informative state representations from high-dimensional data.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Jiarui Sun , M. Ugur Akcal , Wei Zhang , Girish Chowdhary

Multimodal Large Language Models (MLLMs) have demonstrated outstanding performance across a variety of domains. However, training MLLMs is often inefficient, as much of the computation is redundant due to the long input sequences from…

Machine Learning · Computer Science 2026-05-19 Kean Shi , Liang Chen , Haozhe Zhao , Baobao Chang

Partially Supervised Multi-Task Learning (PS-MTL) aims to leverage knowledge across tasks when annotations are incomplete. Existing approaches, however, have largely focused on the simpler setting of homogeneous, dense prediction tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Fangzhou Lin , Yuping Wang , Yuliang Guo , Zixun Huang , Xinyu Huang , Haichong Zhang , Kazunori Yamada , Zhengzhong Tu , Liu Ren , Ziming Zhang

Stripe-like space target detection (SSTD) is crucial for space situational awareness. Traditional unsupervised methods often fail in low signal-to-noise ratio and variable stripe-like space targets scenarios, leading to weak generalization.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Zijian Zhu , Ali Zia , Xuesong Li , Bingbing Dan , Yuebo Ma , Hongfeng Long , Kaili Lu , Enhai Liu , Rujin Zhao

The success of self-supervised learning (SSL) in vision and NLP has motivated its rapid adoption for time series. However, research has focused primarily on Generative paradigms and forecasting tasks, leaving the broader utility of learned…

Machine Learning · Computer Science 2026-05-20 Noam Major , Kathy Razmadze , Yoli Shavit

Although pre-trained transformers and reprogrammed text-based LLMs have shown strong performance on time series tasks, the best-performing architectures vary widely across tasks, with most models narrowly focused on specific areas, such as…

Machine Learning · Computer Science 2024-11-27 Shanghua Gao , Teddy Koker , Owen Queen , Thomas Hartvigsen , Theodoros Tsiligkaridis , Marinka Zitnik

Anomaly detection in multi-variate time series (MVTS) data is a huge challenge as it requires simultaneous representation of long term temporal dependencies and correlations across multiple variables. More often, this is solved by breaking…

Machine Learning · Computer Science 2022-02-09 Theivendiram Pranavan , Terence Sim , Arulmurugan Ambikapathi , Savitha Ramasamy