English
Related papers

Related papers: Enhancing few-shot time series forecasting with LL…

200 papers

Latent diffusion models offer an attractive alternative to discrete diffusion for non-autoregressive text generation by operating on continuous text representations and denoising entire sequences in parallel. The major challenge in latent…

Computation and Language · Computer Science 2026-05-11 Viacheslav Meshchaninov , Alexander Shabalin , Egor Chimbulatov , Nikita Gushchin , Ilya Koziev , Alexander Korotin , Dmitry Vetrov

Spatio-temporal video prediction plays a pivotal role in critical domains, ranging from weather forecasting to industrial automation. However, in high-precision industrial scenarios such as semiconductor manufacturing, the absence of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Xinyu Xie , Weifeng Cao , Jun Shi , Yangyang Hu , Hui Liang , Wanyong Liang , Xiaoliang Qian

Denoising diffusion probabilistic models (DDPMs) are becoming the leading paradigm for generative models. It has recently shown breakthroughs in audio synthesis, time series imputation and forecasting. In this paper, we propose…

Machine Learning · Computer Science 2024-10-22 Xinyu Yuan , Yan Qiao

Domain Generalized Semantic Segmentation (DGSS) is a critical yet challenging task, as domain shifts in unseen environments can severely compromise model performance. While recent studies enhance feature alignment by projecting features…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 I-Hsiang Chen , Hua-En Chang , Wei-Ting Chen , Jenq-Neng Hwang , Sy-Yen Kuo

Multivariate Time Series Forecasting plays a key role in many applications. Recent works have explored using Large Language Models for MTSF to take advantage of their reasoning abilities. However, many methods treat LLMs as end-to-end…

Artificial Intelligence · Computer Science 2025-09-19 Kuiye Ding , Fanda Fan , Yao Wang , Ruijie jian , Xiaorui Wang , Luqi Gong , Yishan Jiang , Chunjie Luo , Jianfeng Zhan

Diffusion models, a family of generative models based on deep learning, have become increasingly prominent in cutting-edge machine learning research. With a distinguished performance in generating samples that resemble the observed data,…

Machine Learning · Computer Science 2023-05-02 Lequan Lin , Zhengkun Li , Ruikun Li , Xuliang Li , Junbin Gao

Forecasting Multivariate Time Series (MTS) involves significant challenges in various application domains. One immediate challenge is modeling temporal patterns with the finite length of the input. These temporal patterns usually involve…

Machine Learning · Computer Science 2024-09-30 Muyao Wang , Wenchao Chen , Zhibin Duan , Bo Chen

While LLMs have demonstrated remarkable potential in time series forecasting, their practical deployment remains constrained by excessive computational demands and memory footprints. Existing LLM-based approaches typically suffer from three…

Computation and Language · Computer Science 2025-03-11 Haoran Fan , Bin Li , Yixuan Weng , Shoujun Zhou

Generating high-quality synthetic time series is a fundamental yet challenging task across domains such as forecasting and anomaly detection, where real data can be scarce, noisy, or costly to collect. Unlike static data generation,…

Machine Learning · Computer Science 2025-09-25 MohammadReza EskandariNasab , Shah Muhammad Hamdi , Soukaina Filali Boubrahimi

Precipitation nowcasting is a critical spatio-temporal prediction task for society to prevent severe damage owing to extreme weather events. Despite the advances in this field, the complex and stochastic nature of this task still poses…

Machine Learning · Computer Science 2025-12-25 Shi Quan Foo , Chi-Ho Wong , Zhihan Gao , Dit-Yan Yeung , Ka-Hing Wong , Wai-Kin Wong

Generative models have made significant impacts across various domains, largely due to their ability to scale during training by increasing data, computational resources, and model size, a phenomenon characterized by the scaling laws.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Nanye Ma , Shangyuan Tong , Haolin Jia , Hexiang Hu , Yu-Chuan Su , Mingda Zhang , Xuan Yang , Yandong Li , Tommi Jaakkola , Xuhui Jia , Saining Xie

Equipping a deep model the abaility of few-shot learning, i.e., learning quickly from only few examples, is a core challenge for artificial intelligence. Gradient-based meta-learning approaches effectively address the challenge by learning…

Machine Learning · Computer Science 2024-01-09 Baoquan Zhang , Chuyao Luo , Demin Yu , Huiwei Lin , Xutao Li , Yunming Ye , Bowen Zhang

Advances in endoscopy use in surgeries face challenges like inadequate lighting. Deep learning, notably the Denoising Diffusion Probabilistic Model (DDPM), holds promise for low-light image enhancement in the medical field. However, DDPMs…

Image and Video Processing · Electrical Eng. & Systems 2024-05-20 Tong Chen , Qingcheng Lyu , Long Bai , Erjian Guo , Huxin Gao , Xiaoxiao Yang , Hongliang Ren , Luping Zhou

Leveraging Large Language Models (LLMs) as federated learning (FL)-based time series foundation models offers a promising way to transfer the generalization capabilities of LLMs to time series data while preserving access to private data.…

Machine Learning · Computer Science 2026-04-07 Liwei Deng , Qingxiang Liu , Xinhe Niu , Shengchao Chen , Sheng Sun , Yuankai Wu , Guodong Long , Yuxuan Liang

This paper proposes LLaFS, the first attempt to leverage large language models (LLMs) in few-shot segmentation. In contrast to the conventional few-shot segmentation methods that only rely on the limited and biased information from the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Lanyun Zhu , Tianrun Chen , Deyi Ji , Jieping Ye , Jun Liu

Time series data is fundamental to decision-making across many domains including healthcare, finance, power systems, and logistics. However, analyzing this data correctly often requires incorporating unstructured contextual information,…

Machine Learning · Computer Science 2026-03-17 Felix Parker , Nimeesha Chan , Chi Zhang , Kimia Ghobadi

Recent advancements in deep learning have led to the development of various models for long-term multivariate time-series forecasting (LMTF), many of which have shown promising results. Generally, the focus has been on…

Machine Learning · Computer Science 2024-02-28 Shiyi Qi , Zenglin Xu , Yiduo Li , Liangjian Wen , Qingsong Wen , Qifan Wang , Yuan Qi

Time Series foundation models (TSFMs) deliver strong forecasting performance through large-scale pretraining, but their large parameter sizes make deployment costly. While knowledge distillation offers a natural and effective approach for…

Machine Learning · Computer Science 2026-01-21 Yuqi Li , Kuiye Ding , Chuanguang Yang , Szu-Yu Chen , Yingli Tian

Time series forecasting holds significant importance in many real-world dynamic systems and has been extensively studied. Unlike natural language process (NLP) and computer vision (CV), where a single large model can tackle multiple tasks,…

In recent years, generative pre-trained paradigms such as Large Language Models (LLMs) and Large Vision Models (LVMs) have achieved revolutionary advancements and widespread real-world applications. Particularly, the emergence of…

Computational Engineering, Finance, and Science · Computer Science 2024-06-05 Jiarui Yang , Tao Dai , Naiqi Li , Junxi Wu , Peiyuan Liu , Jinmin Li , Jigang Bao , Haigang Zhang , Shutao Xia