English
Related papers

Related papers: Rethinking Post-Training Recipes for Multimodal Ti…

200 papers

Model selection is a critical step in time series forecasting, traditionally requiring extensive performance evaluations across various datasets. Meta-learning approaches aim to automate this process, but they typically depend on…

Machine Learning · Computer Science 2025-04-04 Wang Wei , Tiankai Yang , Hongjie Chen , Ryan A. Rossi , Yue Zhao , Franck Dernoncourt , Hoda Eldardiry

Recent studies in time series forecasting (TSF) use multimodal inputs, such as text and historical time series data, to predict future values. These studies mainly focus on developing advanced techniques to integrate textual information…

Computation and Language · Computer Science 2025-09-03 Chen Su , Yuanhe Tian , Yan Song , Yongdong Zhang

Time Series Forecasting (TSF) is critical in many real-world domains like financial planning and health monitoring. Recent studies have revealed that Large Language Models (LLMs), with their powerful in-contextual modeling capabilities,…

Machine Learning · Computer Science 2025-03-14 Jialiang Tang , Shuo Chen , Chen Gong , Jing Zhang , Dacheng Tao

In post-training for reasoning Large Language Models (LLMs), the current state of practice trains LLMs in two independent stages: Supervised Fine-Tuning (SFT) and Reinforcement Learning with Verifiable Rewards (RLVR, shortened as ``RL''…

Machine Learning · Computer Science 2025-10-03 Feiyang Kang , Michael Kuchnik , Karthik Padthe , Marin Vlastelica , Ruoxi Jia , Carole-Jean Wu , Newsha Ardalani

Foundation models have achieved remarkable success in natural language processing and computer vision, demonstrating strong capabilities in modeling complex patterns. While recent efforts have explored adapting large language models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Changlu Chen , Yanbin Liu , Chaoxi Niu , Ling Chen , Tianqing Zhu

Large language models (LLMs) trained via pretraining and supervised fine-tuning (SFT) can still produce harmful and misaligned outputs, or struggle in domains like math and coding. Reinforcement learning (RL)-based post-training methods,…

Computation and Language · Computer Science 2026-05-19 Zhichao Wang , Kiran Ramnath , Bin Bi , Shiva Kumar Pentyala , Sougata Chaudhuri , Shubham Mehrotra , Zixu , Zhu , Xiang-Bo Mao , Sitaram Asur , Na , Cheng

To advance time series forecasting (TSF), various methods have been proposed to improve prediction accuracy, evolving from statistical techniques to data-driven deep learning architectures. Despite their effectiveness, most existing methods…

Machine Learning · Computer Science 2026-04-21 Yitong Zhou , Yucong Luo , Mingyue Cheng , Qi Liu , Jiahao Wang , Daoyu Wang , Enhong Chen

Time series forecasting is important for applications spanning energy markets, climate analysis, and traffic management. However, existing methods struggle to effectively integrate exogenous texts and align them with the probabilistic…

Machine Learning · Computer Science 2025-07-30 Yueyang Yao , Jiajun Li , Xingyuan Dai , MengMeng Zhang , Xiaoyan Gong , Fei-Yue Wang , Yisheng Lv

Time series forecasting is critical to real-world decision making, yet most existing approaches remain unimodal and rely on extrapolating historical patterns. While recent progress in large language models (LLMs) highlights the potential…

Artificial Intelligence · Computer Science 2026-01-14 Jinkwan Jang , Hyunbin Jin , Hyungjin Park , Kyubyung Chae , Taesup Kim

Time Series Forecasting (TSF) has long been a challenge in time series analysis. Inspired by the success of Large Language Models (LLMs), researchers are now developing Large Time Series Models (LTSMs)-universal transformer-based models…

Large Language Models (LLMs) show potential as sequential decision-making agents, but their application is often limited due to a reliance on large, computationally expensive models. This creates a need to improve smaller models, yet…

Computation and Language · Computer Science 2025-08-15 Jim Dilkes , Vahid Yazdanpanah , Sebastian Stein

Recent research has shown an increasing interest in utilizing pre-trained large language models (LLMs) for a variety of time series applications. However, there are three main challenges when using LLMs as foundational models for time…

Machine Learning · Computer Science 2025-07-02 Wenzhe Niu , Zongxia Xie , Yanru Sun , Wei He , Man Xu , Chao Hao

Recent studies have indicated that vision models pre-trained on images can serve as time series foundation models (TSFMs) by reformulating time series forecasting (TSF) as image reconstruction. However, effective cross-modal transfer from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Lefei Shen , Mouxiang Chen , Xu Liu , Han Fu , Xiaoxue Ren , Jianling Sun , Zhuo Li , Chenghao Liu

Traditional time series analysis has long relied on pattern recognition, trained on static and well-established benchmarks. However, in real-world settings -- where policies shift, human behavior adapts, and unexpected events unfold --…

Artificial Intelligence · Computer Science 2025-10-16 Xinlei Wang , Mingtian Tan , Jing Qiu , Junhua Zhao , Jinjin Gu

Improving Multi-modal Large Language Models (MLLMs) in the post-training stage typically relies on supervised fine-tuning (SFT) or reinforcement learning (RL), which require expensive and manually annotated multi-modal data--an ultimately…

Computation and Language · Computer Science 2025-10-28 Lai Wei , Yuting Li , Chen Wang , Yue Wang , Linghe Kong , Weiran Huang , Lichao Sun

Video understanding represents the most challenging frontier in computer vision, requiring models to reason about complex spatiotemporal relationships, long-term dependencies, and multimodal evidence. The recent emergence of Video-Large…

Time series analysis provides essential insights for real-world system dynamics and informs downstream decision-making, yet most existing methods often overlook the rich contextual signals present in auxiliary modalities. To bridge this…

Machine Learning · Computer Science 2026-03-24 Yushan Jiang , Wenchao Yu , Geon Lee , Dongjin Song , Kijung Shin , Wei Cheng , Yanchi Liu , Haifeng Chen

To acquire instruction-following capabilities, large language models (LLMs) undergo instruction tuning, where they are trained on instruction-response pairs using next-token prediction (NTP). Efforts to improve instruction tuning often…

Computation and Language · Computer Science 2026-04-21 Yuxin Xiao , Shujian Zhang , Wenxuan Zhou , Marzyeh Ghassemi , Sanqiang Zhao

Time series forecasting (TSF) plays a critical role in decision-making for many real-world applications. Recently, LLM-based forecasters have made promising advancements. Despite their effectiveness, existing methods often lack explicit…

Machine Learning · Computer Science 2026-02-04 Xiaoyu Tao , Mingyue Cheng , Ze Guo , Shuo Yu , Yaguo Liu , Qi Liu , Shijin Wang

Directly training Large Language Models (LLMs) for Multi-Agent Systems (MAS) remains challenging due to intricate reward modeling, dynamic agent interactions, and demanding generalization requirements. This paper explores whether…

Artificial Intelligence · Computer Science 2025-06-03 Yufa Zhou , Shaobo Wang , Xingyu Dong , Xiangqi Jin , Yifang Chen , Yue Min , Kexin Yang , Xingzhang Ren , Dayiheng Liu , Linfeng Zhang