中文
相关论文

相关论文: LLM-Mixer: Multiscale Mixing in LLMs for Time Seri…

200 篇论文

Transformer-based models have gained increasing attention in time series research, driving interest in Large Language Models (LLMs) and foundation models for time series analysis. As the field moves toward multi-modality, Large Vision…

机器学习 · 计算机科学 2025-07-11 Ziming Zhao , ChengAo Shen , Hanghang Tong , Dongjin Song , Zhigang Deng , Qingsong Wen , Jingchao Ni

We present LLM-Blender, an ensembling framework designed to attain consistently superior performance by leveraging the diverse strengths of multiple open-source large language models (LLMs). Our framework consists of two modules: PairRanker…

计算与语言 · 计算机科学 2023-07-04 Dongfu Jiang , Xiang Ren , Bill Yuchen Lin

Given the significant potential of large language models (LLMs) in sequence modeling, emerging studies have begun applying them to time-series forecasting. Despite notable progress, existing methods still face two critical challenges: 1)…

人工智能 · 计算机科学 2025-01-09 Pengfei Wang , Huanran Zheng , Qi'ao Xu , Silong Dai , Yiqiao Wang , Wenjing Yue , Wei Zhu , Tianwen Qian , Xiaoling Wang

Diffusion models have recently emerged as powerful frameworks for generating high-quality images. While recent studies have explored their application to time series forecasting, these approaches face significant challenges in cross-modal…

计算机视觉与模式识别 · 计算机科学 2025-02-24 Weilin Ruan , Siru Zhong , Haomin Wen , Yuxuan Liang

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

人机交互 · 计算机科学 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

Multivariate time series forecasting remains a challenge due to the complexity of local temporal dynamics and global dependencies across multiple variables. In this paper, we propose \textbf{N}eighboring \textbf{P}atching \textbf{Mixer}…

机器学习 · 计算机科学 2026-05-11 Jung Min Choi , Vijaya Krishna Yalavarthi , Lars Schmidt-Thieme

This paper explores how large language models can leverage multi-level contextual information to predict group coordination patterns in collaborative mixed reality environments. We demonstrate that encoding individual behavioral profiles,…

人机交互 · 计算机科学 2025-11-19 Diana Romero , Xin Gao , Daniel Khalkhali , Salma Elmalaki

Machine learning practitioners often face significant challenges in formally integrating their prior knowledge and beliefs into predictive models, limiting the potential for nuanced and context-aware analyses. Moreover, the expertise needed…

机器学习 · 统计学 2024-12-23 James Requeima , John Bronskill , Dami Choi , Richard E. Turner , David Duvenaud

Time series forecasting plays an increasingly important role in modern business decisions. In today's data-rich environment, people often aim to choose the optimal forecasting model for their data. However, identifying the optimal model…

应用统计 · 统计学 2021-12-17 Xixi Li , Fotios Petropoulos , Yanfei Kang

Introduction: Long-term time series forecasting (LTSF) has gained significant attention in recent years. While various specialized designs exist for capturing temporal dependency, recent studies have shown that even a single linear layer…

机器学习 · 计算机科学 2026-05-19 Zhe Li , Shiyi Qi , Yiduo Li , Zenglin Xu

Recent advancements in Large Language Models (LLMs) have transformed many fields including scientific discovery, content generation, biomedical text mining, and educational technology. However, the substantial requirements for training…

机器学习 · 计算机科学 2025-08-05 Yigit Turkmen , Baturalp Buyukates , Melih Bastopcu

Multivariate Time Series Forecasting plays a key role in many applications. Recent works have explored using Large Language Models for MTSF to take advantage of their reasoning abilities. However, many methods treat LLMs as end-to-end…

人工智能 · 计算机科学 2025-09-19 Kuiye Ding , Fanda Fan , Yao Wang , Ruijie jian , Xiaorui Wang , Luqi Gong , Yishan Jiang , Chunjie Luo , Jianfeng Zhan

Time series forecasting traditionally relies on unimodal numerical inputs, which often struggle to capture high-level semantic patterns due to their dense and unstructured nature. While recent approaches have explored representing time…

机器学习 · 计算机科学 2025-07-02 Sixun Dong , Wei Fan , Teresa Wu , Yanjie Fu

Optimization algorithms and large language models (LLMs) enhance decision-making in dynamic environments by integrating artificial intelligence with traditional techniques. LLMs, with extensive domain knowledge, facilitate intelligent…

神经与进化计算 · 计算机科学 2024-05-17 Sen Huang , Kaixiang Yang , Sheng Qi , Rui Wang

Scaling laws for large language models (LLMs) have provided useful guidance in training ever larger models for predictable performance gains. Time series forecasting shares a similar sequential structure to language, and is amenable to…

机器学习 · 计算机科学 2025-01-09 Thomas D. P. Edwards , James Alvey , Justin Alsing , Nam H. Nguyen , Benjamin D. Wandelt

Large language models (LLMs) rely on pretraining on massive and heterogeneous corpora, where training data composition has a decisive impact on training efficiency and downstream generalization under realistic compute and data budget…

计算与语言 · 计算机科学 2026-04-21 Zhuo Chen , Yuxuan Miao , Supryadi , Deyi Xiong

Time series forecasting is a crucial task in various domains. Caused by factors such as trends, seasonality, or irregular fluctuations, time series often exhibits non-stationary. It obstructs stable feature propagation through deep layers,…

机器学习 · 计算机科学 2024-01-05 Xiang Ma , Xuemei Li , Lexin Fang , Tianlong Zhao , Caiming Zhang

Traditional time series analysis has long relied on pattern recognition, trained on static and well-established benchmarks. However, in real-world settings -- where policies shift, human behavior adapts, and unexpected events unfold --…

人工智能 · 计算机科学 2025-10-16 Xinlei Wang , Mingtian Tan , Jing Qiu , Junhua Zhao , Jinjin Gu

Time series forecasting presents significant challenges in real-world applications across various domains. Building upon the decomposition of the time series, we enhance the architecture of machine learning models for better multivariate…

机器学习 · 计算机科学 2026-02-24 Sanjeev Panta , Xu Yuan , Li Chen , Nian-Feng Tzeng

Irregularly sampled time series (ISTS) are widespread in real-world scenarios, exhibiting asynchronous observations on uneven time intervals across variables. Existing ISTS forecasting methods often solely utilize historical observations to…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Zhi Lei , Chenxi Liu , Hao Miao , Wanghui Qiu , Bin Yang , Chenjuan Guo