English
Related papers

Related papers: Timer-S1: A Billion-Scale Time Series Foundation M…

200 papers

Deep learning for time series forecasting has seen significant advancements over the past decades. However, despite the success of large-scale pre-training in language and vision domains, pre-trained time series models remain limited in…

Machine Learning · Computer Science 2025-02-28 Xiaoming Shi , Shiyu Wang , Yuqi Nie , Dianqi Li , Zhou Ye , Qingsong Wen , Ming Jin

We present Tiny-TSM, a time series foundation model characterized by small scale, economical training, and state-of-the-art performance. It comprises 23M total parameters, trained on a single A100 GPU in less than a week using a new…

Machine Learning · Computer Science 2025-11-25 Felix Birkel

Deep learning has contributed remarkably to the advancement of time series analysis. Still, deep models can encounter performance bottlenecks in real-world data-scarce scenarios, which can be concealed due to the performance saturation with…

Machine Learning · Computer Science 2024-10-21 Yong Liu , Haoran Zhang , Chenyu Li , Xiangdong Huang , Jianmin Wang , Mingsheng Long

Test-time scaling is a promising new approach to language modeling that uses extra test-time compute to improve performance. Recently, OpenAI's o1 model showed this capability but did not publicly share its methodology, leading to many…

Spatio-temporal forecasting is crucial in transportation, logistics, and supply chain management. However, current methods struggle with large, complex datasets. We propose a dynamic, multi-modal approach that integrates the strengths of…

Machine Learning · Computer Science 2024-08-27 Sagar Srinivas Sakhinana , Geethan Sannidhi , Chidaksh Ravuru , Venkataramana Runkana

To advance time series forecasting (TSF), various methods have been proposed to improve prediction accuracy, evolving from statistical techniques to data-driven deep learning architectures. Despite their effectiveness, most existing methods…

Machine Learning · Computer Science 2026-04-21 Yitong Zhou , Yucong Luo , Mingyue Cheng , Qi Liu , Jiahao Wang , Daoyu Wang , Enhong Chen

As a prominent data modality task, time series forecasting plays a pivotal role in diverse applications. With the remarkable advancements in Large Language Models (LLMs), the adoption of LLMs as the foundational architecture for time series…

Machine Learning · Computer Science 2025-07-10 Yiwen Liu , Chenyu Zhang , Junjie Song , Siqi Chen , Sun Yin , Zihan Wang , Lingming Zeng , Yuji Cao , Junming Jiao

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

Machine Learning · Computer Science 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li

Time series modeling is a well-established problem, which often requires that methods (1) expressively represent complicated dependencies, (2) forecast long horizons, and (3) efficiently train over long sequences. State-space models (SSMs)…

Machine Learning · Computer Science 2023-03-17 Michael Zhang , Khaled K. Saab , Michael Poli , Tri Dao , Karan Goel , Christopher Ré

Recent advances in multimodal time series learning underscore a paradigm shift from analytics centered on basic patterns toward advanced time series understanding and reasoning. However, existing multimodal time series datasets mostly…

Time series foundation models excel at diverse time series forecasting tasks, but their capacity for continuous improvement through incremental learning remains unexplored. We present the first comprehensive study investigating these…

Machine Learning · Computer Science 2025-04-22 Jia Liu , Cheng Jinguo , Xia Fang , Zhenyuan Ma , Yuankai Wu

We present Ring-1T, the first open-source, state-of-the-art thinking model with a trillion-scale parameter. It features 1 trillion total parameters and activates approximately 50 billion per token. Training such models at a…

The proliferation of time series foundation models has created a landscape where no single method achieves consistent superiority, framing the central challenge not as finding the best model, but as orchestrating an optimal ensemble with…

Artificial Intelligence · Computer Science 2025-12-19 Defu Cao , Michael Gee , Jinbo Liu , Hengxuan Wang , Wei Yang , Rui Wang , Yan Liu

Time series modeling and forecasting has fundamental importance to various practical domains. Thus a lot of active research works is going on in this subject during several years. Many important models have been proposed in literature for…

Machine Learning · Computer Science 2013-02-28 Ratnadip Adhikari , R. K. Agrawal

While LLMs have demonstrated remarkable potential in time series forecasting, their practical deployment remains constrained by excessive computational demands and memory footprints. Existing LLM-based approaches typically suffer from three…

Computation and Language · Computer Science 2025-03-11 Haoran Fan , Bin Li , Yixuan Weng , Shoujun Zhou

The availability of large amounts of time series data, paired with the performance of deep-learning algorithms on a broad class of problems, has recently led to significant interest in the use of sequence-to-sequence models for time series…

Machine Learning · Computer Science 2019-02-27 Vitaly Kuznetsov , Zelda Mariet

We introduce Intern-S1-Pro, the first one-trillion-parameter scientific multimodal foundation model. Scaling to this unprecedented size, the model delivers a comprehensive enhancement across both general and scientific domains. Beyond…

Machine Learning · Computer Science 2026-04-03 Yicheng Zou , Dongsheng Zhu , Lin Zhu , Tong Zhu , Yunhua Zhou , Peiheng Zhou , Xinyu Zhou , Dongzhan Zhou , Zhiwang Zhou , Yuhao Zhou , Bowen Zhou , Zhanping Zhong , Zhijie Zhong , Haiteng Zhao , Penghao Zhao , Xiaomeng Zhao , Zhiyuan Zhao , Yechen Zhang , Jin Zhang , Wenwei Zhang , Hongjie Zhang , Zhuo Zhang , Wenlong Zhang , Bo Zhang , Chao Zhang , Chen Zhang , Yuhang Zang , Fei Yuan , Jiakang Yuan , Jiashuo Yu , Jinhui Yin , Haochen Ye , Qian Yao , Bowen Yang , Danni Yang , Kaichen Yang , Ziang Yan , Jun Xu , Yicheng Xu , Wanghan Xu , Xuenan Xu , Chao Xu , Ruiliang Xu , Shuhao Xing , Long Xing , Xinchen Xie , Ling-I Wu , Zijian Wu , Zhenyu Wu , Lijun Wu , Yue Wu , Jianyu Wu , Wen Wu , Fan Wu , Xilin Wei , Qi Wei , Bingli Wang , Rui Wang , Ziyi Wang , Zun Wang , Yi Wang , Haomin Wang , Yizhou Wang , Lintao Wang , Yiheng Wang , Longjiang Wang , Bin Wang , Jian Tong , Zhongbo Tian , Huanze Tang , Chen Tang , Shixiang Tang , Yu Sun , Qiushi Sun , Xuerui Su , Qisheng Su , Chenlin Su , Demin Song , Jin Shi , Fukai Shang , Yuchen Ren , Pengli Ren , Xiaoye Qu , Yuan Qu , Jiantao Qiu , Yu Qiao , Biqing Qi , Runyu Peng , Tianshuo Peng , Jiahui Peng , Qizhi Pei , Zhuoshi Pan , Linke Ouyang , Wenchang Ning , Yichuan Ma , Zerun Ma , Ningsheng Ma , Runyuan Ma , Chengqi Lyu , Haijun Lv , Han Lv , Lindong Lu , Kuikun Liu , Jiangning Liu , Yuhong Liu , Kai Liu , Hongwei Liu , Zhoumianze Liu , Mengjie Liu , Ziyu Liu , Wenran Liu , Yang Liu , Liwei Liu , Kaiwen Liu , Junyao Lin , Junming Lin , Tianyang Lin , Dahua Lin , Jianze Liang , Linyang Li , Peiji Li , Zonglin Li , Zehao Li , Pengze Li , Guoyan Li , Lingkai Kong , Linglin Jing , Zhenjiang Jin , Feifei Jiang , Qian Jiang , Junhao Huang , Zixian Huang , Haian Huang , Zhouqi Hua , Ermo Hua , Han Hu , Linfeng Hou , Yinan He , Conghui He , Tianyao He , Xu Guo , Qipeng Guo , Aijia Guo , Yuzhe Gu , Lixin Gu , Jingyang Gong , Qiming Ge , Jiaye Ge , Songyang Gao , Jianfei Gao , Xinyu Fang , Caihua fan , Yue Fan , Yanhui Duan , Zichen Ding , Shengyuan Ding , Ning Ding , Xuanlang Dai , Erfei Cui , Ganqu Cui , Pei Chu , Tao Chu , Guangran Cheng , Yu Cheng , Kai Chen , Yongkang Chen , Chiyu Chen , Guanzhou Chen , Qiaosheng Chen , Sitao Chen , Xin Chen , Haojiong Chen , Yicheng Chen , Weihan Cao , Yuhang Cao , Qinglong Cao , Lei Bai

We present Timer-XL, a causal Transformer for unified time series forecasting. To uniformly predict multidimensional time series, we generalize next token prediction, predominantly adopted for 1D token sequences, to multivariate next token…

Machine Learning · Computer Science 2025-03-04 Yong Liu , Guo Qin , Xiangdong Huang , Jianmin Wang , Mingsheng Long

We introduce MiniMax-01 series, including MiniMax-Text-01 and MiniMax-VL-01, which are comparable to top-tier models while offering superior capabilities in processing longer contexts. The core lies in lightning attention and its efficient…

Time series foundation models (TSFMs) have recently gained significant attention due to their strong zero-shot capabilities and widespread real-world applications. Such models typically require a computationally costly pre-training on…

‹ Prev 1 2 3 10 Next ›