English
Related papers

Related papers: Compatible Transformer for Irregularly Sampled Mul…

200 papers

Reliable uncertainty quantification is critical in multivariate time series forecasting problems arising in domains such as energy systems and transportation networks, among many others. Although Transformer-based architectures have…

Machine Learning · Computer Science 2026-03-13 Rajdeep Pathak , Rahul Goswami , Madhurima Panja , Palash Ghosh , Tanujit Chakraborty

Long-term weather forecasting is critical for socioeconomic planning and disaster preparedness. While recent approaches employ finetuning to extend prediction horizons, they remain constrained by the issues of catastrophic forgetting, error…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Hao Chen , Tao Han , Jie Zhang , Song Guo , Fenghua Ling , Lei Bai

In exploring Predictive Health Management (PHM) strategies for Proton Exchange Membrane Fuel Cells (PEMFC), the Transformer model, widely used in data-driven approaches, excels in many fields but struggles with time series analysis due to…

Machine Learning · Computer Science 2025-04-15 Zezhi Tang , Xiaoyu Chen , Xin Jin , Benyuan Zhang , Wenyu Liang

Multivariate time series are ubiquitous objects in signal processing. Measuring a distance or similarity between two such objects is of prime interest in a variety of applications, including machine learning, but can be very difficult as…

Machine Learning · Statistics 2022-11-02 Titouan Vayer , Romain Tavenard , Laetitia Chapel , Nicolas Courty , Rémi Flamary , Yann Soullard

Transformers have achieved great success in several domains, including Natural Language Processing and Computer Vision. However, its application to real-world graphs is less explored, mainly due to its high computation cost and its poor…

Machine Learning · Computer Science 2023-01-31 Weilin Cong , Yanhong Wu , Yuandong Tian , Mengting Gu , Yinglong Xia , Chun-cheng Jason Chen , Mehrdad Mahdavi

Multivariate time series (MTS) data are becoming increasingly ubiquitous in diverse domains, e.g., IoT systems, health informatics, and 5G networks. To obtain an effective representation of MTS data, it is not only essential to consider…

Machine Learning · Computer Science 2020-10-06 Yang Jiao , Kai Yang , Shaoyu Dou , Pan Luo , Sijia Liu , Dongjin Song

In this work, we investigate the time series representation learning problem using self-supervised techniques. Contrastive learning is well-known in this area as it is a powerful method for extracting information from the series and…

Machine Learning · Computer Science 2024-10-08 Duy A. Nguyen , Trang H. Tran , Huy Hieu Pham , Phi Le Nguyen , Lam M. Nguyen

This paper considers a time-varying vector error-correction model that allows for different time series behaviours (e.g., unit-root and locally stationary processes) to interact with each other to co-exist. From practical perspectives, this…

Econometrics · Economics 2023-05-30 Jiti Gao , Bin Peng , Yayi Yan

Exploring sample relationships within each mini-batch has shown great potential for learning image representations. Existing works generally adopt the regular Transformer to model the visual content relationships, ignoring the cues of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Xixi Wang , Bo Jiang , Xiao Wang , Bin Luo

Training semantic segmentation models with few annotated samples has great potential in various real-world applications. For the few-shot segmentation task, the main challenge is how to accurately measure the semantic correspondence between…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Zhitong Xiong , Haopeng Li , Xiao Xiang Zhu

Recently, there has been a surge of Transformer-based solutions for the long-term time series forecasting (LTSF) task. Despite the growing performance over the past few years, we question the validity of this line of research in this work.…

Artificial Intelligence · Computer Science 2022-08-18 Ailing Zeng , Muxi Chen , Lei Zhang , Qiang Xu

Although transformer-based methods have achieved great success in multi-scale temporal pattern interaction modeling, two key challenges limit their further development: (1) Individual time points contain less semantic information, and…

Machine Learning · Computer Science 2024-11-01 Zongjiang Shang , Ling Chen , Binqing wu , Dongliang Cui

We introduce Contrastive Multivariate Singular Spectrum Analysis, a novel unsupervised method for dimensionality reduction and signal decomposition of time series data. By utilizing an appropriate background dataset, the method transforms a…

Machine Learning · Statistics 2018-11-01 Abdi-Hakin Dirie , Abubakar Abid , James Zou

The accurate prediction of survival times for patients with severe diseases remains a critical challenge despite recent advances in artificial intelligence. This study introduces "SurvTimeSurvival: Survival Analysis On Patients With…

Machine Learning · Computer Science 2023-11-17 Hung Le , Ong Eng-Jon , Bober Miroslaw

Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting…

Machine Learning · Computer Science 2021-01-18 Kashif Rasul , Abdul-Saboor Sheikh , Ingmar Schuster , Urs Bergmann , Roland Vollgraf

Adaptive tracking-by-detection approaches are popular for tracking arbitrary objects. They treat the tracking problem as a classification task and use online learning techniques to update the object model. However, these approaches are…

Computer Vision and Pattern Recognition · Computer Science 2017-04-04 Kourosh Meshgi , Maryam Sadat Mirzaei , Shigeyuki Oba , Shin Ishii

Accurate detection and diagnosis of abnormal behaviors such as network attacks from multivariate time series (MTS) are crucial for ensuring the stable and effective operation of industrial cyber-physical systems (CPS). However, existing…

Machine Learning · Computer Science 2024-03-06 Haili Sun , Yan Huang , Lansheng Han , Cai Fu , Chunjie Zhou

Achieving resilient and high-quality manufacturing requires reliable data-driven anomaly detection methods that are capable of addressing differences in behaviors among different individual machines which are nominally the same and are…

Machine Learning · Computer Science 2026-04-08 Yangmeng Li , Kei Sano , Toshihiro Kitao , Ryoji Anzaki , Yukiya Saitoh , Hironori Moki , Dragan Djurdjanovic

Entropy modeling is a key component for high-performance image compression algorithms. Recent developments in autoregressive context modeling helped learning-based methods to surpass their classical counterparts. However, the performance of…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 A. Burakhan Koyuncu , Han Gao , Atanas Boev , Georgii Gaikov , Elena Alshina , Eckehard Steinbach

The widespread availability of complex time series data in various domains such as environmental science, epidemiology, and economics demands robust causal discovery methods that can identify intricate contemporaneous and lagged…

Machine Learning · Computer Science 2026-05-12 Omar Faruque , Sahara Ali , Xue Zheng , Jianwu Wang