English
Related papers

Related papers: TEMPO: Prompt-based Generative Pre-trained Transfo…

200 papers

Accurate prediction of the need for invasive mechanical ventilation (IMV) in intensive care units (ICUs) patients is crucial for timely interventions and resource allocation. However, variability in patient populations, clinical practices,…

Machine Learning · Computer Science 2026-01-28 Xiaolei Lu , Shamim Nemati

Graph generation is a critical task in numerous domains, including molecular design and social network analysis, due to its ability to model complex relationships and structured data. While most modern graph generative models utilize…

Machine Learning · Computer Science 2025-06-04 Xiaohui Chen , Yinkai Wang , Jiaxing He , Yuanqi Du , Soha Hassoun , Xiaolin Xu , Li-Ping Liu

Deep learning methods are powerful tools in classifying multivariate time series data. Despite their high performance, these methods are hard to interpret, which diminishes their applications in high-risk domains such as healthcare. In this…

Machine Learning · Computer Science 2026-05-11 Bhavesh Kalisetti , Vincent Wang , Gaurav R. Ghosal , Maryam Bijanzadeh , Reza Abbasi-Asl

Dynamic graphs have attracted increasing attention due to their ability to model complex and evolving relationships in real-world scenarios. Traditional approaches typically pre-train models using dynamic link prediction and directly apply…

Machine Learning · Computer Science 2026-01-21 Yufei Peng , Cheng Yang , Zhengjie Fan , Chuan Shi

A thorough regulation of building energy systems translates in relevant energy savings and in a better comfort for the occupants. Algorithms to predict the thermal state of a building on a certain time horizon with a good confidence are…

Machine Learning · Computer Science 2023-11-01 Alfredo V Clemente , Alessandro Nocente , Massimiliano Ruocco

Recent works have demonstrated the effectiveness of adapting pre-trained language models (LMs) for forecasting time series in the low-data regime. We build upon these findings by analyzing the effective transfer from language models to time…

Computation and Language · Computer Science 2025-06-30 Roland Riachi , Kashif Rasul , Arjun Ashok , Prateek Humane , Alexis Roger , Andrew R. Williams , Yuriy Nevmyvaka , Irina Rish

In this paper, we propose ShapTST, a framework that enables time-series transformers to efficiently generate Shapley-value-based explanations alongside predictions in a single forward pass. Shapley values are widely used to evaluate the…

Machine Learning · Computer Science 2025-01-28 Qisen Cheng , Jinming Xing , Chang Xue , Xiaoran Yang

The recent surge in Time Series Foundation Models has rapidly advanced the field, yet the heterogeneous training setups across studies make it difficult to attribute improvements to architectural innovations versus data engineering. In this…

Machine Learning · Computer Science 2026-02-09 Yunshi Wen , Wesley M. Gifford , Chandra Reddy , Lam M. Nguyen , Jayant Kalagnanam , Anak Agung Julius

Time-series forecasting is a critical challenge in various domains and has witnessed substantial progress in recent years. Many real-life scenarios, such as public health, economics, and social applications, involve feedback loops where…

Machine Learning · Computer Science 2025-06-04 Zhiyuan Zhao , Haoxin Liu , Alexander Rodriguez , B. Aditya Prakash

The paper develops a Transformer architecture for estimating dynamic factors from multivariate time series data under flexible identification assumptions. Performance on small datasets is improved substantially by using a conventional…

Econometrics · Economics 2026-01-21 Oliver Snellman

The fourth industrial revolution creates ubiquitous sensor data in production plants. To generate maximum value out of these data, reliable and precise time series-based machine learning methods like temporal neural networks are needed.…

Machine Learning · Computer Science 2023-05-22 Stefan Gaugel , Manfred Reichert

Temporal graph learning is pivotal for deciphering dynamic systems, where the core challenge lies in explicitly modeling the underlying evolving patterns that govern network transformation. However, prevailing methods are predominantly…

Machine Learning · Computer Science 2026-02-20 Yijun Ma , Zehong Wang , Weixiang Sun , Yanfang Ye

Spatio-temporal sequence forecasting is one of the fundamental tasks in spatio-temporal data mining. It facilitates many real world applications such as precipitation nowcasting, citywide crowd flow prediction and air pollution forecasting.…

Machine Learning · Computer Science 2020-05-20 Hong-Bin Liu , Ickjai Lee

Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality…

Machine Learning · Computer Science 2020-01-07 Yuya Jeremy Ong , Mu Qiao , Divyesh Jadav

Time series forecasting is a crucial task in machine learning, as it has a wide range of applications including but not limited to forecasting electricity consumption, traffic, and air quality. Traditional forecasting models rely on rolling…

Machine Learning · Computer Science 2021-10-22 Shereen Elsayed , Daniela Thyssens , Ahmed Rashed , Hadi Samer Jomaa , Lars Schmidt-Thieme

Many real-world time series exhibit strong periodic structures arising from physical laws, human routines, or seasonal cycles. However, modern deep forecasting models often fail to capture these recurring patterns due to spectral bias and a…

Machine Learning · Computer Science 2025-08-05 Menglin Kong , Vincent Zhihao Zheng , Lijun Sun

Deep learning model (primarily convolutional networks and LSTM) for time series classification has been studied broadly by the community with the wide applications in different domains like healthcare, finance, industrial engineering and…

Machine Learning · Computer Science 2021-03-29 Minghao Liu , Shengqi Ren , Siyuan Ma , Jiahui Jiao , Yizhou Chen , Zhiguang Wang , Wei Song

Our understanding of the temporal dynamics of the Earth's surface has been advanced by deep vision models, which often require lots of labeled multi-temporal images for training. However, collecting, preprocessing, and annotating…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Zhuo Zheng , Stefano Ermon , Dongjun Kim , Liangpei Zhang , Yanfei Zhong

The recent boom of large pre-trained models witnesses remarkable success in developing foundation models (FMs) for time series forecasting. Despite impressive performance across diverse downstream forecasting tasks, existing time series FMs…

Machine Learning · Computer Science 2025-10-23 Hui He , Kun Yi , Yuanchi Ma , Qi Zhang , Zhendong Niu , Guansong Pang

The task of accurate and efficient language translation is an extremely important information processing task. Machine learning enabled and automated translation that is accurate and fast is often a large topic of interest in the machine…

Computation and Language · Computer Science 2024-04-24 Elijah Pelofske , Vincent Urias , Lorie M. Liebrock