中文
相关论文

相关论文: Rethinking Post-Training Recipes for Multimodal Ti…

200 篇论文

With the success of pre-trained language models (PLMs) in various application fields beyond natural language processing, language models have raised emerging attention in the field of time series forecasting (TSF) and have shown great…

机器学习 · 计算机科学 2025-09-30 Peng Chen , Yihang Wang , Yang Shu , Yunyao Cheng , Kai Zhao , Zhongwen Rao , Lujia Pan , Bin Yang , Chenjuan Guo

Recently, large language models (LLMs) have demonstrated powerful capabilities in performing various tasks and thus are applied by recent studies to time series forecasting (TSF) tasks, which predict future values with the given historical…

计算与语言 · 计算机科学 2025-07-15 Chen Su , Yuanhe Tian , Qinyu Liu , Jun Zhang , Yan Song

Deep learning (e.g., Transformer) has been widely and successfully used in multivariate time series forecasting (MTSF). Unlike existing methods that focus on training models from a single modal of time series input, large language models…

机器学习 · 计算机科学 2025-04-09 Peiyuan Liu , Hang Guo , Tao Dai , Naiqi Li , Jigang Bao , Xudong Ren , Yong Jiang , Shu-Tao Xia

Large Language Models (LLMs) often produce plausible but poorly-calibrated answers, limiting their reliability on reasoning-intensive tasks. We present Reinforcement Learning from Self-Feedback (RLSF), a post-training stage that uses the…

计算与语言 · 计算机科学 2025-07-30 Carel van Niekerk , Renato Vukovic , Benjamin Matthias Ruppik , Hsien-chin Lin , Milica Gašić

Time series forecasting aims to model temporal dependencies among variables for future state inference, holding significant importance and widespread applications in real-world scenarios. Although deep learning-based methods have achieved…

机器学习 · 计算机科学 2026-05-21 Zesen Wang , Lijuan Lan , Yonggang Li

Time series foundation models (TSFMs) demonstrate impressive zero-shot performance for time series forecasting. However, an important yet underexplored challenge is how to effectively finetune TSFMs on specific downstream tasks. While naive…

Time-series forecasting (TSF) finds broad applications in real-world scenarios. Prompting off-the-shelf Large Language Models (LLMs) demonstrates strong zero-shot TSF capabilities while preserving computational efficiency. However, existing…

计算与语言 · 计算机科学 2024-02-27 Haoxin Liu , Zhiyuan Zhao , Jindong Wang , Harshavardhan Kamarthi , B. Aditya Prakash

Time series forecasting holds significant importance in many real-world dynamic systems and has been extensively studied. Unlike natural language process (NLP) and computer vision (CV), where a single large model can tackle multiple tasks,…

Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer knowledge and…

机器学习 · 计算机科学 2025-01-14 Malcolm L. Wolff , Shenghao Yang , Kari Torkkola , Michael W. Mahoney

Given the significant potential of large language models (LLMs) in sequence modeling, emerging studies have begun applying them to time-series forecasting. Despite notable progress, existing methods still face two critical challenges: 1)…

人工智能 · 计算机科学 2025-01-09 Pengfei Wang , Huanran Zheng , Qi'ao Xu , Silong Dai , Yiqiao Wang , Wenjing Yue , Wei Zhu , Tianwen Qian , Xiaoling Wang

Unlike natural language processing and computer vision, the development of Foundation Models (FMs) for time series forecasting is blocked due to data scarcity. While recent efforts are focused on building such FMs by unlocking the potential…

机器学习 · 计算机科学 2024-10-10 Qingxiang Liu , Xu Liu , Chenghao Liu , Qingsong Wen , Yuxuan Liang

Recent advancements in time series forecasting have explored augmenting models with text or vision modalities to improve accuracy. While text provides contextual understanding, it often lacks fine-grained temporal details. Conversely,…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Siru Zhong , Weilin Ruan , Ming Jin , Huan Li , Qingsong Wen , Yuxuan Liang

Time series forecasting (TSF) is a fundamental and widely studied task, spanning methods from classical statistical approaches to modern deep learning and multimodal language modeling. Despite their effectiveness, these methods often follow…

机器学习 · 计算机科学 2025-12-23 Mingyue Cheng , Jiahao Wang , Daoyu Wang , Xiaoyu Tao , Qi Liu , Enhong Chen

The World Wide Web needs reliable predictive capabilities to respond to changes in user behavior and usage patterns. Time series forecasting (TSF) is a key means to achieve this goal. In recent years, the large language models (LLMs) for…

机器学习 · 计算机科学 2026-01-23 Jianqi Zhang , Jingyao Wang , Wenwen Qiang , Fanjiang Xu , Changwen Zheng

Time series data is fundamental to decision-making across many domains including healthcare, finance, power systems, and logistics. However, analyzing this data correctly often requires incorporating unstructured contextual information,…

机器学习 · 计算机科学 2026-03-17 Felix Parker , Nimeesha Chan , Chi Zhang , Kimia Ghobadi

Time series is a pervasive data type across various application domains, rendering the reasonable solving of diverse time series tasks a long-standing goal. Recent advances in large language models (LLMs), especially their reasoning…

人工智能 · 计算机科学 2026-05-08 Jiahui Zhou , Dan Li , Boxin Li , Xiao Zhang , Erli Meng , Lin Li , Zhuomin Chen , Jian Lou , See-Kiong Ng

Time series forecasting traditionally relies on unimodal numerical inputs, which often struggle to capture high-level semantic patterns due to their dense and unstructured nature. While recent approaches have explored representing time…

机器学习 · 计算机科学 2025-07-02 Sixun Dong , Wei Fan , Teresa Wu , Yanjie Fu

Large language models (LLMs) have demonstrated their effectiveness in multivariate time series classification (MTSC). Effective adaptation of LLMs for MTSC necessitates informative data representations. Existing LLM-based methods directly…

人工智能 · 计算机科学 2025-10-29 Jiahao Wang , Mingyue Cheng , Qingyang Mao , Yitong Zhou , Daoyu Wang , Qi Liu , Feiyang Xu , Xin Li

Time Series Foundation Models (TSFMs) excel at numerical forecasting but operate as black boxes lacking qualitative reasoning. Conversely, applying LLMs directly to temporal data introduces a modality gap: text tokenizers fragment…

机器学习 · 计算机科学 2026-05-12 Md Atik Ahamed , Mihir Parmar , Palash Goyal , Chun-Liang Li , Qiang Cheng , Tomas Pfister , Jinsung Yoon

AI systems are notorious for their fragility; minor input changes can potentially cause major output swings. When such systems are deployed in critical areas like finance, the consequences of their uncertain behavior could be severe. In…