English
Related papers

Related papers: TILDE-Q: A Transformation Invariant Loss Function …

200 papers

Real-world time series exhibit temporally structured uncertainty: volatility clusters in turbulent regimes, dissipates in stable periods, and shifts abruptly around structural breaks. Yet many probabilistic forecasting methods estimate…

Machine Learning · Computer Science 2026-05-26 Yijun Wang , Qiyuan Zhuang , Xiu-Shen Wei

In deep learning theory, the covariance matrix of the representations serves as a proxy to examine the network's trainability. Motivated by the success of Transformers, we study the covariance matrix of a modified Softmax-based attention…

Machine Learning · Statistics 2023-12-12 Lorenzo Noci , Chuning Li , Mufan Bill Li , Bobby He , Thomas Hofmann , Chris Maddison , Daniel M. Roy

Deep learning has emerged as a powerful tool for solving inverse problems in imaging, including computed tomography (CT). However, most approaches require paired training data with ground truth images, which can be difficult to obtain,…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Tatiana A. Bubba , Matteo Santacesaria , Andrea Sebastiani

Many scientific prediction problems have spatiotemporal data- and modeling-related challenges in handling complex variations in space and time using only sparse and unevenly distributed observations. This paper presents a novel deep…

Machine Learning · Computer Science 2021-12-13 Yijun Lin , Yao-Yi Chiang , Meredith Franklin , Sandrah P. Eckel , José Luis Ambite

Time Series Forecasting plays a crucial role in various fields such as industrial equipment maintenance, meteorology, energy consumption, traffic flow and financial investment. However, despite their considerable advantages over traditional…

Machine Learning · Computer Science 2024-07-02 Ruiqi Li , Maowei Jiang , Kai Wang , Kaiduo Feng , Quangao Liu , Yue Sun , Xiufang Zhou

Time serie classification is used in a diverse range of domain such as meteorology, medicine and physics. It aims to classify chronological data. Many accurate approaches have been built during the last decade and shapelet transformation is…

Machine Learning · Computer Science 2019-12-20 Michael Mbouopda , Engelbert Mephu Nguifo

Prediction models can perform poorly when deployed to target distributions different from the training distribution. To understand these operational failure modes, we develop a method, called DIstribution Shift DEcomposition (DISDE), to…

Machine Learning · Statistics 2023-07-12 Tiffany Tianhui Cai , Hongseok Namkoong , Steve Yadlowsky

Time-series forecasting finds broad applications in real-world scenarios. Due to the dynamic nature of time series data, it is important for time-series forecasting models to handle potential distribution shifts over time. In this paper, we…

Machine Learning · Computer Science 2026-03-26 Zhiyuan Zhao , Haoxin Liu , B. Aditya Prakash

Multivariate time series (MTS) forecasting is crucial for decision-making in domains such as weather, energy, and finance. It remains challenging because real-world sequences intertwine slow trends, multi-rate seasonalities, and irregular…

Machine Learning · Computer Science 2026-02-06 Shunya Nagashima , Shuntaro Suzuki , Shuitsu Koyama , Shinnosuke Hirano

Topological data analysis (TDA) has emerged as one of the most promising techniques to reconstruct the unknown shapes of high-dimensional spaces from observed data samples. TDA, thus, yields key shape descriptors in the form of persistent…

Machine Learning · Statistics 2017-11-15 Wei Guo , Krithika Manohar , Steven L. Brunton , Ashis G. Banerjee

Data-driven machine learning (ML) models are reshaping weather forecasting and have shown the potential to accelerate and surpass traditional physics-based approaches, leading to a second revolution in the field after data assimilation.…

Machine Learning · Computer Science 2026-05-19 Hang Fan , Yi Xiao , Yongquan Qu , Juan Nathaniel , Fenghua Ling , Ben Fei , Lei Bai , Pierre Gentine

Linear time-invariant systems are very popular models in system theory and applications. A fundamental problem in system identification that remains rather unaddressed in extant literature is to leverage commonalities amongst related linear…

Machine Learning · Statistics 2024-01-03 Aditya Modi , Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

Forecasting irregularly sampled time series with missing values is a crucial task for numerous real-world applications such as healthcare, astronomy, and climate sciences. State-of-the-art approaches to this problem rely on Ordinary…

Handling anomalies is a critical preprocessing step in multivariate time series prediction. However, existing approaches that separate anomaly preprocessing from model training for multivariate time series prediction encounter significant…

Machine Learning · Computer Science 2025-01-15 Yuanyuan Liang , Tianhao Zhang , Tingyu Xie

Time-series anomaly detection plays an important role in engineering processes, like development, manufacturing and other operations involving dynamic systems. These processes can greatly benefit from advances in the field, as…

Machine Learning · Computer Science 2024-11-22 Lucas Correia , Jan-Christoph Goos , Philipp Klein , Thomas Bäck , Anna V. Kononova

Spatiotemporal data is ubiquitous, and forecasting it has important applications in many domains. However, its complex cross-component dependencies and non-linear temporal dynamics can be challenging for traditional techniques. Existing…

Machine Learning · Computer Science 2025-03-27 Hao Yuan Bai , Xue Liu

Forecasting complex time series is an important yet challenging problem that involves various industrial applications. Recently, masked time-series modeling has been proposed to effectively model temporal dependencies for forecasting by…

Machine Learning · Computer Science 2025-07-02 Hyunwoo Seo , Chiehyeon Lim

The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens. The patch size controls…

Machine Learning · Computer Science 2024-03-25 Yitian Zhang , Liheng Ma , Soumyasundar Pal , Yingxue Zhang , Mark Coates

Popular rotated detection methods usually use five parameters (coordinates of the central point, width, height, and rotation angle) to describe the rotated bounding box and l1-loss as the loss function. In this paper, we argue that the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Wen Qian , Xue Yang , Silong Peng , Yue Guo , Junchi Yan

Sufficiently modeling the correlations among variables (aka channels) is crucial for achieving accurate multivariate time series forecasting (MTSF). In this paper, we propose a novel technique called Temporal Query (TQ) to more effectively…

Machine Learning · Computer Science 2025-09-12 Shengsheng Lin , Haojun Chen , Haijie Wu , Chunyun Qiu , Weiwei Lin