English
Related papers

Related papers: Why Larger Language Models Do In-context Learning …

200 papers

In-context learning (ICL) is a cornerstone of large language model (LLM) functionality, yet its theoretical foundations remain elusive due to the complexity of transformer architectures. In particular, most existing work only theoretically…

Machine Learning · Computer Science 2024-09-18 Siyu Chen , Heejune Sheen , Tianhao Wang , Zhuoran Yang

Although large language models (LLMs) have demonstrated remarkable performance, the lack of transparency in their inference logic raises concerns about their trustworthiness. To gain a better understanding of LLMs, we conduct a detailed…

Computation and Language · Computer Science 2024-07-26 Jie Ren , Qipeng Guo , Hang Yan , Dongrui Liu , Quanshi Zhang , Xipeng Qiu , Dahua Lin

In-Context Learning (ICL) has emerged as a pivotal capability of auto-regressive large language models, yet it is hindered by a notable sensitivity to the ordering of context examples regardless of their mutual independence. To address this…

Computation and Language · Computer Science 2025-05-09 Lizhe Fang , Yifei Wang , Khashayar Gatmiry , Lei Fang , Yisen Wang

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

Computation and Language · Computer Science 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

We study the phenomenon of \textit{in-context learning} (ICL) exhibited by large language models, where they can adapt to a new learning task, given a handful of labeled examples, without any explicit parameter optimization. Our goal is to…

Machine Learning · Computer Science 2023-05-29 Jacob Abernethy , Alekh Agarwal , Teodor V. Marinov , Manfred K. Warmuth

Large Language Models (LLMs), originally developed for natural language processing (NLP), have demonstrated the potential to generalize across modalities and domains. With their in-context learning (ICL) capabilities, LLMs can perform…

Artificial Intelligence · Computer Science 2025-08-26 Nikolaos Pavlidis , Vasilis Perifanis , Symeon Symeonidis , Pavlos S. Efraimidis

In-context learning is a key paradigm in large language models (LLMs) that enables them to generalize to new tasks and domains by simply prompting these models with a few exemplars without explicit parameter updates. Many attempts have been…

Machine Learning · Computer Science 2024-12-11 Siyan Zhao , Tung Nguyen , Aditya Grover

Large language models (LLMs) have shown an impressive ability to perform a wide range of tasks using in-context learning (ICL), where a few examples are used to describe a task to the model. However, the performance of ICL varies…

Computation and Language · Computer Science 2024-06-25 Keqin Peng , Liang Ding , Yancheng Yuan , Xuebo Liu , Min Zhang , Yuanxin Ouyang , Dacheng Tao

In-context Learning (ICL) empowers large language models (LLMs) to swiftly adapt to unseen tasks at inference-time by prefixing a few demonstration examples before queries. Despite its versatility, ICL incurs substantial computational and…

Machine Learning · Computer Science 2025-02-26 Zhuowei Li , Zihao Xu , Ligong Han , Yunhe Gao , Song Wen , Di Liu , Hao Wang , Dimitris N. Metaxas

The emergent ability of Large Language Models to use a small number of examples to learn to perform in novel domains and tasks, also called in-context learning (ICL). In this work, we show that a much smaller model can be trained to perform…

Computation and Language · Computer Science 2023-09-18 Raphael Reinauer , Patrick Simianer , Kaden Uhlig , Johannes E. M. Mosig , Joern Wuebker

Generating rational and generally accurate responses to tasks, often accompanied by example demonstrations, highlights Large Language Model's (LLM's) remarkable In-Context Learning (ICL) capabilities without requiring updates to the model's…

Machine Learning · Computer Science 2025-06-17 Debanjan Dutta , Faizanuddin Ansari , Swagatam Das

Large Language Models (LLMs) have demonstrated remarkable in-context learning (ICL) capabilities. In this study, we explore a surprising phenomenon related to ICL: LLMs can perform multiple, computationally distinct ICL tasks…

Large Language Models (LLMs) exhibit positional bias, struggling to utilize information from the middle or end of long contexts. Our study explores LLMs' long-context reasoning by probing their hidden representations. We find that while…

Computation and Language · Computer Science 2024-10-08 Taiming Lu , Muhan Gao , Kuai Yu , Adam Byerly , Daniel Khashabi

Large language models (LLMs) are increasingly deployed on complex reasoning tasks, yet little is known about their ability to internally evaluate problem difficulty, which is an essential capability for adaptive reasoning and efficient…

Computation and Language · Computer Science 2025-10-14 Sunbowen Lee , Qingyu Yin , Chak Tou Leong , Jialiang Zhang , Yicheng Gong , Shiwen Ni , Min Yang , Xiaoyu Shen

Large language models (LLMs) have led to a series of breakthroughs in natural language processing (NLP), owing to their excellent understanding and generation abilities. Remarkably, what further sets these models apart is the massive…

Computation and Language · Computer Science 2022-11-10 Daliang Li , Ankit Singh Rawat , Manzil Zaheer , Xin Wang , Michal Lukasik , Andreas Veit , Felix Yu , Sanjiv Kumar

In-context learning (ICL) using large language models for tasks with many labels is challenging due to the limited context window, which makes it difficult to fit a sufficient number of examples in the prompt. In this paper, we use a…

Computation and Language · Computer Science 2023-12-07 Aristides Milios , Siva Reddy , Dzmitry Bahdanau

In-context learning, a capability that enables a model to learn from input examples on the fly without necessitating weight updates, is a defining characteristic of large language models. In this work, we follow the setting proposed in…

Machine Learning · Computer Science 2023-05-29 Kartik Ahuja , David Lopez-Paz

Going beyond mimicking limited human experiences, recent studies show initial evidence that, like humans, large language models (LLMs) are capable of improving their abilities purely by self-correction, i.e., correcting previous responses…

Machine Learning · Computer Science 2024-11-19 Yifei Wang , Yuyang Wu , Zeming Wei , Stefanie Jegelka , Yisen Wang

The capability of predicting environmental dynamics underpins both biological neural systems and general embodied AI in adapting to their surroundings. Yet prevailing approaches rest on static world models that falter when confronted with…

Machine Learning · Computer Science 2026-03-02 Fan Wang , Zhiyuan Chen , Yuxuan Zhong , Sunjian Zheng , Pengtao Shao , Bo Yu , Shaoshan Liu , Jianan Wang , Ning Ding , Yang Cao , Yu Kang

In-context learning (ICL) enables large language models (LLMs) to perform new tasks using only a few demonstrations. However, in Named Entity Recognition (NER), existing ICL methods typically rely on task-agnostic semantic similarity for…

Computation and Language · Computer Science 2025-10-30 Fan Bai , Hamid Hassanzadeh , Ardavan Saeedi , Mark Dredze