English
Related papers

Related papers: Enhancing Large Language Models for Time-Series Fo…

200 papers

Large Language Models (LLMs) have recently demonstrated significant potential in time series forecasting, offering impressive capabilities in handling complex temporal data. However, their robustness and reliability in real-world…

Machine Learning · Computer Science 2025-03-14 Fuqiang Liu , Sicong Jiang , Luis Miranda-Moreno , Seongjin Choi , Lijun Sun

Large language models (LLM) have emerged as a powerful tool for AI, with the key ability of in-context learning (ICL), where they can perform well on unseen tasks based on a brief series of task examples without necessitating any…

Machine Learning · Computer Science 2024-05-31 Zhenmei Shi , Junyi Wei , Zhuoyan Xu , Yingyu Liang

Multimodal in-context learning (ICL) has emerged as a key capability of Large Vision-Language Models (LVLMs), driven by their increasing scale and applicability. Despite its promise, effective ICL in the multimodal setting remains…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yanshu Li

Large language models (LLMs) have been widely explored for embedding generation. While recent studies show that in-context learning (ICL) effectively enhances the representational capability of LLMs by prepending a few task-related…

Computation and Language · Computer Science 2026-05-05 Ailiang Lin , Zhuoyun Li , Keyu Mao , Kotaro Funakoshi , Manabu Okumura

In-context learning (ICL), a predominant trend in instruction learning, aims at enhancing the performance of large language models by providing clear task guidance and examples, improving their capability in task understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Cheng Chen , Yunpeng Zhai , Yifan Zhao , Jinyang Gao , Bolin Ding , Jia Li

Large Language Models (LLMs) have recently gained the In-Context Learning (ICL) ability with the models scaling up, allowing them to quickly adapt to downstream tasks with only a few demonstration examples prepended in the input sequence.…

Computation and Language · Computer Science 2024-03-19 Zhe Yang , Damai Dai , Peiyi Wang , Zhifang Sui

Large language models (LLM) in natural language processing (NLP) have demonstrated great potential for in-context learning (ICL) -- the ability to leverage a few sets of example prompts to adapt to various tasks without having to explicitly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Trevine Oorloff , Vishwanath Sindagi , Wele Gedara Chaminda Bandara , Ali Shafahi , Amin Ghiasi , Charan Prakash , Reza Ardekani

Large Language Models (LLMs) have demonstrated remarkable proficiency across diverse tasks, exhibiting emergent properties such as semantic prompt comprehension, In-Context Learning (ICL), and Chain-of-Thought (CoT) reasoning. Despite their…

Computation and Language · Computer Science 2026-03-13 Yuling Jiao , Yanming Lai , Huazhen Lin , Wensen Ma , Houduo Qi , Defeng Sun

The rapid growth of Large Language Models (LLMs) usage has highlighted the importance of gradient-free in-context learning (ICL). However, interpreting their inner workings remains challenging. This paper introduces a novel multimodal…

Computation and Language · Computer Science 2024-08-26 Yosuke Miyanishi , Minh Le Nguyen

Large vision language models (LVLMs) achieve remarkable performance through Vision In-context Learning (VICL), a process that depends significantly on demonstrations retrieved from an extensive collection of annotated examples (retrieval…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Wenqiang Wang , Yangshijie Zhang

In-context learning (ICL) has garnered significant attention for its ability to grasp functions/tasks from demonstrations. Recent studies suggest the presence of a latent task/function vector in LLMs during ICL. Merullo et al. (2024) showed…

Machine Learning · Computer Science 2025-08-14 Dake Bu , Wei Huang , Andi Han , Atsushi Nitanda , Qingfu Zhang , Hau-San Wong , Taiji Suzuki

Time series analysis is crucial in fields like finance, transportation, and industry. However, traditional models often focus solely on temporal features, limiting their ability to capture underlying information. This paper proposes a novel…

Machine Learning · Computer Science 2025-03-12 Shule Hao , Junpeng Bao , Chuncheng Lu

Model selection is a critical step in time series forecasting, traditionally requiring extensive performance evaluations across various datasets. Meta-learning approaches aim to automate this process, but they typically depend on…

Machine Learning · Computer Science 2025-04-04 Wang Wei , Tiankai Yang , Hongjie Chen , Ryan A. Rossi , Yue Zhao , Franck Dernoncourt , Hoda Eldardiry

The emerging in-context learning (ICL) ability of large language models (LLMs) has prompted their use for predictive tasks in various domains with different data types, including tabular data, facilitated by serialization methods. However,…

Machine Learning · Computer Science 2025-11-18 Karuna Bhaila , Minh-Hao Van , Kennedy Edemacu , Chen Zhao , Feng Chen , Xintao Wu

Large Language Models (LLMs) have become an integral part of many real-world workflows. However, LLMs consume a lot of energy, which becomes a large concern in the scale of the demand for these tools. As LLMs become integrated into…

Software Engineering · Computer Science 2026-05-01 Katelyn Crumpacker , Dimitrios Nikolopoulos

A public safety Uncrewed Aerial Vehicle (UAV) enhances situational awareness during emergency response. Its agility, mobility optimization, and ability to establish Line-of-Sight (LoS) communication make it increasingly important for…

Artificial Intelligence · Computer Science 2026-02-18 Yousef Emami , Hao Zhou , Miguel Gutierrez Gaitan , Kai Li , Luis Almeida , Zhu Han

Large Language Models (LLMs) have the impressive ability to perform in-context learning (ICL) from only a few examples, but the success of ICL varies widely from task to task. Thus, it is important to quickly determine whether ICL is…

Computation and Language · Computer Science 2023-10-27 Harvey Yiyun Fu , Qinyuan Ye , Albert Xu , Xiang Ren , Robin Jia

Recent research has shown that large language models (LLMs) can be effectively used for real-world time series forecasting due to their strong natural language understanding capabilities. However, aligning time series into semantic spaces…

Machine Learning · Computer Science 2024-12-03 Lingzheng Zhang , Lifeng Shen , Yimin Zheng , Shiyuan Piao , Ziyue Li , Fugee Tsung

Fine-tuning Large Language Models (LLMs) typically involves updating at least a few billions of parameters. A more parameter-efficient approach is Prompt Tuning (PT), which updates only a few learnable tokens, and differently, In-Context…

Computation and Language · Computer Science 2024-10-23 Tsachi Blau , Moshe Kimhi , Yonatan Belinkov , Alexander Bronstein , Chaim Baskin

With the widespread adoption of Large Language Models (LLMs), there is a growing need to establish best practices for leveraging their capabilities beyond traditional natural language tasks. In this paper, a novel cross-domain knowledge…

Machine Learning · Computer Science 2025-09-29 Mohammadmahdi Ghasemloo , Alireza Moradi