English
Related papers

Related papers: Toto: Time Series Optimized Transformer for Observ…

200 papers

Time series forecasting is important in many fields that require accurate predictions for decision-making. Patching techniques, commonly used and effective in time series modeling, help capture temporal dependencies by dividing the data…

Machine Learning · Computer Science 2026-02-03 Xiangfei Qiu , Xvyuan Liu , Tianen Shen , Xingjian Wu , Hanyin Cheng , Bin Yang , Jilin Hu

We propose a learning framework for calibrating predictive models to make loss-controlling prediction for exchangeable data, which extends our recently proposed conformal loss-controlling prediction for more general cases. By comparison,…

Machine Learning · Computer Science 2024-01-24 Di Wang , Junzhi Shi , Pingping Wang , Shuo Zhuang , Hongyue Li

Extrapolation remains a grand challenge in deep neural networks across all application domains. We propose an operator learning method to solve time-dependent partial differential equations (PDEs) continuously and with extrapolation in time…

Machine Learning · Computer Science 2023-12-12 Oded Ovadia , Vivek Oommen , Adar Kahana , Ahmad Peyvan , Eli Turkel , George Em Karniadakis

Time series foundation models excel at diverse time series forecasting tasks, but their capacity for continuous improvement through incremental learning remains unexplored. We present the first comprehensive study investigating these…

Machine Learning · Computer Science 2025-04-22 Jia Liu , Cheng Jinguo , Xia Fang , Zhenyuan Ma , Yuankai Wu

Accurate forecasting of transportation dynamics is essential for urban mobility and infrastructure planning. Although recent work has achieved strong performance with deep learning models, these methods typically require dataset-specific…

Machine Learning · Computer Science 2026-05-19 Javier Yanes-Pulido , Filipe Rodrigues

As "a new frontier in evolutionary computation research", evolutionary transfer optimization(ETO) will overcome the traditional paradigm of zero reuse of related experience and knowledge from solved past problems in researches of…

Neural and Evolutionary Computing · Computer Science 2023-06-29 Xu Wendi , Wang Xianpeng , Guo Qingxin , Song Xiangman , Zhao Ren , Zhao Guodong , Yang Yang , Xu Te , He Dakuo

Although we have witnessed great success of pre-trained models in natural language processing (NLP) and computer vision (CV), limited progress has been made for general time series analysis. Unlike NLP and CV where a unified model can be…

Machine Learning · Computer Science 2023-10-17 Tian Zhou , PeiSong Niu , Xue Wang , Liang Sun , Rong Jin

In many real-world scenarios, we often deal with streaming data that is sequentially collected over time. Due to the non-stationary nature of the environment, the streaming data distribution may change in unpredictable ways, which is known…

Machine Learning · Computer Science 2022-06-07 Wendi Li , Xiao Yang , Weiqing Liu , Yingce Xia , Jiang Bian

This work investigates the zero-shot forecasting capability of time series foundation models for Leaf Area Index (LAI) forecasting in agricultural monitoring. Using the HiQ dataset (U.S., 2000-2022), we systematically compare statistical…

Machine Learning · Computer Science 2026-01-19 Peining Zhang , Hongchen Qin , Haochen Zhang , Ziqi Guo , Guiling Wang , Jinbo Bi

Encountering shifted data at test time is a ubiquitous challenge when deploying predictive models. Test-time adaptation (TTA) methods address this issue by continuously adapting a deployed model using only unlabeled test data. While TTA can…

Machine Learning · Computer Science 2025-11-11 Mona Schirmer , Metod Jazbec , Christian A. Naesseth , Eric Nalisnick

Temporal misalignment (time offset) between sensors is common in low cost visual-inertial odometry (VIO) systems. Such temporal misalignment introduces inconsistent constraints for state estimation, leading to a significant positioning…

Robotics · Computer Science 2024-03-20 Chaoran Xiong , Guoqing Liu , Qi Wu , Songpengcheng Xia , Tong Hua , Kehui Ma , Zhen Sun , Yan Xiang , Ling Pei

Satellite image time series (SITS) provide continuous observations of the Earth's surface, making them essential for applications such as environmental management and disaster assessment. However, existing spatiotemporal foundation models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Xiaolei Qin , Di Wang , Jing Zhang , Fengxiang Wang , Xin Su , Bo Du , Liangpei Zhang

In the manufacturing process, sensor data collected from equipment is crucial for building predictive models to manage processes and improve productivity. However, in the field, it is challenging to gather sufficient data to build robust…

Machine Learning · Computer Science 2024-07-10 Gyeong Taek Lee , Oh-Ran Kwon

Most time series foundation models are pretrained by directly predicting future observations, which often yields weakly structured latent representations that capture surface noise rather than coherent and predictable temporal dynamics. In…

Machine Learning · Computer Science 2026-02-17 Xinxing Zhou , Qingren Yao , Yiji Zhao , Chenghao Liu , Flora Salim , Xiaojie Yuan , Yanlong Wen , Ming Jin

Optimization based tracking methods have been widely successful by integrating a target model prediction module, providing effective global reasoning by minimizing an objective function. While this inductive bias integrates valuable domain…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Christoph Mayer , Martin Danelljan , Goutam Bhat , Matthieu Paul , Danda Pani Paudel , Fisher Yu , Luc Van Gool

Time series forecasting is a subject of significant scientific and industrial importance. Despite the widespread utilization of forecasting methods, there is a dearth of research aimed at comprehending the conditions under which these…

Machine Learning · Computer Science 2024-10-23 Moisés Santos , André de Carvalho , Carlos Soares

Time Series Foundation Models (TSFMs) are a powerful paradigm for time series analysis and are often enhanced by synthetic data augmentation to improve the training data quality. Existing augmentation methods, however, typically rely on…

Machine Learning · Computer Science 2026-01-28 Junwei Deng , Chang Xu , Jiaqi W. Ma , Ming Jin , Chenghao Liu , Jiang Bian

Although pre-trained transformers and reprogrammed text-based LLMs have shown strong performance on time series tasks, the best-performing architectures vary widely across tasks, with most models narrowly focused on specific areas, such as…

Machine Learning · Computer Science 2024-11-27 Shanghua Gao , Teddy Koker , Owen Queen , Thomas Hartvigsen , Theodoros Tsiligkaridis , Marinka Zitnik

In this paper, we propose PATO-a producibility-aware topology optimization (TO) framework to help efficiently explore the design space of components fabricated using metal additive manufacturing (AM), while ensuring manufacturability with…

Computational Engineering, Finance, and Science · Computer Science 2021-12-10 Naresh S. Iyer , Amir M. Mirzendehdel , Sathyanarayanan Raghavan , Yang Jiao , Erva Ulu , Morad Behandish , Saigopal Nelaturi , Dean M. Robinson

Many important problems require modelling large-scale spatio-temporal datasets, with one prevalent example being weather forecasting. Recently, transformer-based approaches have shown great promise in a range of weather forecasting…

Machine Learning · Statistics 2024-10-11 Matthew Ashman , Cristiana Diaconu , Eric Langezaal , Adrian Weller , Richard E. Turner