English
Related papers

Related papers: Benchmarking General-Purpose In-Context Learning

200 papers

In-context learning (ICL) of large language models has proven to be a surprisingly effective method of learning a new task from only a few demonstrative examples. In this paper, we study the efficacy of ICL from the viewpoint of statistical…

Machine Learning · Statistics 2024-10-03 Juno Kim , Tai Nakamaki , Taiji Suzuki

The capability of predicting environmental dynamics underpins both biological neural systems and general embodied AI in adapting to their surroundings. Yet prevailing approaches rest on static world models that falter when confronted with…

Machine Learning · Computer Science 2026-03-02 Fan Wang , Zhiyuan Chen , Yuxuan Zhong , Sunjian Zheng , Pengtao Shao , Bo Yu , Shaoshan Liu , Jianan Wang , Ning Ding , Yang Cao , Yu Kang

In-context learning (ICL) adapts LLMs by providing demonstrations without fine-tuning the model parameters; however, it does not differentiate between demonstrations and quadratically increases the complexity of Transformer LLMs, exhausting…

Computation and Language · Computer Science 2024-11-06 Giwon Hong , Emile van Krieken , Edoardo Ponti , Nikolay Malkin , Pasquale Minervini

Language models that can learn a task at inference time, called in-context learning (ICL), show increasing promise in natural language inference tasks. In ICL, a model user constructs a prompt to describe a task with a natural language…

Software Engineering · Computer Science 2024-04-22 Sarah Santos , Travis Breaux , Thomas Norton , Sara Haghighi , Sepideh Ghanavati

In-context learning (ICL) is the ability of a large language model (LLM) to learn a new task from a few demonstrations presented as part of the context. Past studies have attributed a large portion of the success of ICL to the way these…

Computation and Language · Computer Science 2025-10-10 Ioana Marinescu , Kyunghyun Cho , Eric Karl Oermann

In-context learning (ICL) has emerged as a powerful capability for large language models (LLMs) to adapt to downstream tasks by leveraging a few (demonstration) examples. Despite its effectiveness, the mechanism behind ICL remains…

Machine Learning · Computer Science 2025-06-03 Pengfei He , Yingqian Cui , Han Xu , Hui Liu , Makoto Yamada , Jiliang Tang , Yue Xing

Fine-tuning and in-context learning (ICL) are two prevalent methods in imbuing large language models with task-specific knowledge. It is commonly believed that fine-tuning can surpass ICL given sufficient training samples as it allows the…

Machine Learning · Computer Science 2024-10-08 Qingyu Yin , Xuzheng He , Luoao Deng , Chak Tou Leong , Fan Wang , Yanzhao Yan , Xiaoyu Shen , Qiang Zhang

Large Language Models (LLMs) have proven effective at In-Context Learning (ICL), an ability that allows them to create predictors from labeled examples. Few studies have explored the interplay between ICL and specific properties of…

Machine Learning · Computer Science 2023-11-23 David Oniani , Yanshan Wang

Large Language Models have demonstrated remarkable performance across various tasks, exhibiting the capacity to swiftly acquire new skills, such as through In-Context Learning (ICL) with minimal demonstration examples. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Folco Bertini Baldassini , Mustafa Shukor , Matthieu Cord , Laure Soulier , Benjamin Piwowarski

In-Context Learning (ICL) is a phenomenon where task learning occurs through a prompt sequence without the necessity of parameter updates. ICL in Multi-Headed Attention (MHA) with absolute positional embedding has been the focus of more…

In-context learning (ICL) empowers large language models (LLMs) to perform diverse tasks in underrepresented languages using only short in-context information, offering a crucial avenue for narrowing the gap between high-resource and…

Computation and Language · Computer Science 2024-06-26 Samuel Cahyawijaya , Holy Lovenia , Pascale Fung

Recent point cloud understanding research suffers from performance drops on unseen data, due to the distribution shifts across different domains. While recent studies use Domain Generalization (DG) techniques to mitigate this by learning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Jincen Jiang , Qianyu Zhou , Yuhang Li , Xuequan Lu , Meili Wang , Lizhuang Ma , Jian Chang , Jian Jun Zhang

The emergence of in-context learning (ICL) enables large pre-trained language models (PLMs) to make predictions for unseen inputs without updating parameters. Despite its potential, ICL's effectiveness heavily relies on the quality,…

Machine Learning · Computer Science 2024-07-02 Xiaoling Zhou , Wei Ye , Yidong Wang , Chaoya Jiang , Zhemg Lee , Rui Xie , Shikun Zhang

In-Context Learning (ICL) enables Large Language Models (LLMs) to perform new tasks by conditioning on prompts with relevant information. Retrieval-Augmented Generation (RAG) enhances ICL by incorporating retrieved documents into the LLM's…

Machine Learning · Computer Science 2024-12-02 Marie Al Ghossein , Emile Contal , Alexandre Robicquet

We formalize a new concept for LLMs, context-enhanced learning. It involves standard gradient-based learning on text except that the context is enhanced with additional data on which no auto-regressive gradients are computed. This setting…

Machine Learning · Computer Science 2025-06-06 Xingyu Zhu , Abhishek Panigrahi , Sanjeev Arora

While multilingual large language models generally perform adequately, and sometimes even rival English performance on high-resource languages (HRLs), they often significantly underperform on low-resource languages (LRLs). Among several…

Computation and Language · Computer Science 2025-10-09 Yilei Tu , Andrew Xue , Freda Shi

In-context learning (ICL) unfolds as large language models become capable of inferring test labels conditioned on a few labeled samples without any gradient update. ICL-enabled large language models provide a promising step forward toward…

Computation and Language · Computer Science 2023-06-27 Eshaan Tanwar , Subhabrata Dutta , Manish Borthakur , Tanmoy Chakraborty

Large language models (LLMs) have become the norm in natural language processing (NLP), excelling in few-shot in-context learning (ICL) with their remarkable abilities. Nonetheless, the success of ICL largely hinges on the choice of…

Computation and Language · Computer Science 2025-05-06 Xingxuan Li , Xuan-Phi Nguyen , Shafiq Joty , Lidong Bing

Recent studies have demonstrated that In-Context Learning (ICL), through the use of specific demonstrations, can align Large Language Models (LLMs) with human preferences known as In-Context Alignment (ICA), indicating that models can…

Computation and Language · Computer Science 2024-06-18 Heyan Huang , Yinghao Li , Huashan Sun , Yu Bai , Yang Gao

Large language models can solve new tasks without task-specific fine-tuning. This ability, also known as in-context learning (ICL), is considered an emergent ability and is primarily seen in large language models with billions of…

Computation and Language · Computer Science 2024-04-04 Sherin Muckatira , Vijeta Deshpande , Vladislav Lialin , Anna Rumshisky
‹ Prev 1 3 4 5 6 7 10 Next ›