English
Related papers

Related papers: MTS-JEPA: Multi-Resolution Joint-Embedding Predict…

200 papers

Multivariate time series anomaly detection is a very common problem in the field of failure prevention. Fast prevention means lower repair costs and losses. The amount of sensors in novel industry systems makes the anomaly detection process…

Machine Learning · Computer Science 2021-11-24 Kamil Faber , Dominik Żurek , Marcin Pietroń , Kamil Piętak

In this short report, we introduce joint multi-token prediction (JTP), a lightweight modification of standard next-token prediction designed to enrich hidden state representations by jointly predicting multiple future tokens. Unlike…

Machine Learning · Computer Science 2025-03-31 Kwangjun Ahn , Alex Lamb , John Langford

This work proposes a novel approach for multiple time series forecasting. At first, multi-way delay embedding transform (MDT) is employed to represent time series as low-rank block Hankel tensors (BHT). Then, the higher-order tensors are…

Machine Learning · Computer Science 2020-02-28 Qiquan Shi , Jiaming Yin , Jiajun Cai , Andrzej Cichocki , Tatsuya Yokota , Lei Chen , Mingxuan Yuan , Jia Zeng

Existing backdoor attacks on multivariate time series (MTS) forecasting enforce strict temporal and dimensional coupling between triggers and target patterns, requiring synchronous activation at fixed positions across variables. However,…

Cryptography and Security · Computer Science 2026-01-09 Zhixin Liu , Xuanlin Liu , Sihan Xu , Yaqiong Qiao , Ying Zhang , Xiangrui Cai

Video Joint Embedding Predictive Architectures (V-JEPA) learn generalizable off-the-shelf video representation by predicting masked regions in latent space with an exponential moving average (EMA)-updated teacher. While EMA prevents…

Machine Learning · Computer Science 2025-09-30 Xianhang Li , Chen Huang , Chun-Liang Li , Eran Malach , Josh Susskind , Vimal Thilak , Etai Littwin

Reservoir simulation workflows face a fundamental data asymmetry: input parameter fields (geostatistical permeability realizations, porosity distributions) are free to generate in arbitrary quantities, yet existing neural operator…

Machine Learning · Computer Science 2026-04-10 Brandon Yee , Pairie Koh

Multivariate time-series (MTS) forecasting is a paramount and fundamental problem in many real-world applications. The core issue in MTS forecasting is how to effectively model complex spatial-temporal patterns. In this paper, we develop a…

Machine Learning · Computer Science 2024-02-16 Jinliang Deng , Xiusi Chen , Renhe Jiang , Du Yin , Yi Yang , Xuan Song , Ivor W. Tsang

Multivariate time series forecasting, which analyzes historical time series to predict future trends, can effectively help decision-making. Complex relations among variables in MTS, including static, dynamic, predictable, and latent…

Machine Learning · Computer Science 2021-12-16 Yueyang Wang , Ziheng Duan , Yida Huang , Haoyan Xu , Jie Feng , Anni Ren

Accurate forecasting of multivariate time series remains challenging due to the need to capture both short-term fluctuations and long-range temporal dependencies. Transformer-based models have emerged as a powerful approach, but their…

Machine Learning · Computer Science 2026-03-26 Aymane Harkati , Moncef Garouani , Olivier Teste , Julien Aligon , Mohamed Hamlich

Recent progress in time-series forecasting has led to rapidly increasing architectural complexity, yet many reported State-of-the-Art gains are statistically fragile or misattributed. We argue that progress requires a shift from model…

We propose a transformer architecture for time series forecasting with a focus on time series tokenisation and apply it to a real-world prediction problem from the pricing domain. Our architecture aims to learn effective representations at…

Machine Learning · Computer Science 2025-04-22 Egon Peršak , Miguel F. Anjos , Sebastian Lautz , Aleksandar Kolev

Video representation learning is an increasingly important topic in machine learning research. We present Video JEPA with Variance-Covariance Regularization (VJ-VCR): a joint-embedding predictive architecture for self-supervised video…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Katrina Drozdov , Ravid Shwartz-Ziv , Yann LeCun

Multivariate time series(MTS) is a universal data type related to many practical applications. However, MTS suffers from missing data problems, which leads to degradation or even collapse of the downstream tasks, such as prediction and…

Machine Learning · Computer Science 2022-09-19 Kai Zhang , Qinmin Yang , Chao Li

Real-world multivariate time series can exhibit intricate multi-scale structures, including global trends, local periodicities, and non-stationary regimes, which makes long-horizon forecasting challenging. Although sparse Mixture-of-Experts…

Machine Learning · Computer Science 2026-03-16 Evandro S. Ortigossa , Guy Lutsker , Eran Segal

Irregularly sampled time series forecasting, characterized by non-uniform intervals, is prevalent in practical applications. However, previous research have been focused on regular time series forecasting, typically relying on transformer…

Machine Learning · Computer Science 2024-10-01 Byunghyun Kim , Jae-Gil Lee

Irregular multivariate time series (IMTS), characterized by uneven sampling and inter-variate asynchrony, fuel many forecasting applications yet remain challenging to model efficiently. Canonical Pre-Alignment (CPA) has been widely adopted…

Machine Learning · Computer Science 2025-12-02 Ziyu Zhou , Yiming Huang , Yanyun Wang , Yuankai Wu , James Kwok , Yuxuan Liang

Anomaly Detection in multivariate time series is a major problem in many fields. Due to their nature, anomalies sparsely occur in real data, thus making the task of anomaly detection a challenging problem for classification algorithms to…

Machine Learning · Computer Science 2023-08-08 Anastasios Iliopoulos , John Violos , Christos Diou , Iraklis Varlamis

Time series forecasting is a critical task that provides key information for decision-making. After traditional statistical and machine learning approaches, various fundamental deep learning architectures such as MLPs, CNNs, RNNs, and GNNs…

Machine Learning · Computer Science 2025-05-02 Jongseon Kim , Hyungjoon Kim , HyunGi Kim , Dongjun Lee , Sungroh Yoon

Learning predictive world models from unlabelled video is a foundational challenge in artificial intelligence. While Joint Embedding Predictive Architectures (JEPA) have set new benchmarks in semantic classification, they often remain…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Santosh Kumar Paidi

We introduce a class of specially structured linear programming (LP) problems, which has favorable modeling capability for important application problems in different areas such as optimal transport, discrete tomography and economics. To…

Optimization and Control · Mathematics 2022-04-26 Hong T. M. Chu , Ling Liang , Kim-Chuan Toh , Lei Yang