English
Related papers

Related papers: StaICC: Standardized Evaluation for Classification…

200 papers

Large language models (LLMs) are able to solve various tasks with only a few demonstrations utilizing their in-context learning (ICL) abilities. However, LLMs often rely on their pre-trained semantic priors of demonstrations rather than on…

Computation and Language · Computer Science 2024-04-16 Joonwon Jang , Sanghwan Jang , Wonbin Kweon , Minjin Jeon , Hwanjo Yu

In-context learning (ICL) allows Transformers to adapt to novel tasks without weight updates, yet the underlying algorithms remain poorly understood. We adopt a statistical decision-theoretic perspective by investigating simple binary…

Machine Learning · Computer Science 2026-03-13 Faris Chaudhry , Siddhant Gadkari

Recent advancements in video large multimodal models (LMMs) have significantly improved their video understanding and reasoning capabilities. However, their performance drops on out-of-distribution (OOD) tasks that are underrepresented in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Kangsan Kim , Geon Park , Youngwan Lee , Woongyeong Yeo , Sung Ju Hwang

In-context learning (ICL) leverages in-context examples as prompts for the predictions of Large Language Models (LLMs). These prompts play a crucial role in achieving strong performance. However, the selection of suitable prompts from a…

Machine Learning · Computer Science 2024-09-16 Jian Qian , Miao Sun , Sifan Zhou , Ziyu Zhao , Ruizhi Hun , Patrick Chiang

Cross-lingual in-context learning (XICL) has emerged as a transformative paradigm for leveraging large language models (LLMs) to tackle multilingual tasks, especially for low-resource languages. However, existing approaches often rely on…

Computation and Language · Computer Science 2024-12-13 Mateo Alejandro Rojas , Rafael Carranza

In-context learning (ICL) effectively conditions large language models (LLMs) for molecular tasks, such as property prediction and molecule captioning, by embedding carefully selected demonstration examples into the input prompt. This…

Machine Learning · Computer Science 2025-02-11 Ali Al-Lawati , Jason Lucas , Zhiwei Zhang , Prasenjit Mitra , Suhang Wang

Clinical decision support systems require models that are not only highly accurate but also equitable and sensitive to the implications of missed diagnoses. In this study, we introduce a knowledge-guided in-context learning (ICL) framework…

Machine Learning · Computer Science 2025-07-28 Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia , Eugenio di Sciascio

This paper introduces a novel in-context learning (ICL) framework, inspired by large language models (LLMs), for soft-input soft-output channel equalization in coded multiple-input multiple-output (MIMO) systems. The proposed approach…

Signal Processing · Electrical Eng. & Systems 2025-05-12 Zihang Song , Matteo Zecchin , Bipin Rajendran , Osvaldo Simeone

In-context learning with large language models (LLMs) excels at adapting to various tasks rapidly. However, its success hinges on carefully selecting demonstrations, which remains an obstacle in practice. Current approaches to this problem…

Computation and Language · Computer Science 2024-01-15 Shangqing Xu , Chao Zhang

Text-to-image diffusion models have recently become highly capable, yet their behavior in multi-object scenes remains unreliable: models often produce an incorrect number of instances and exhibit semantics leaking across objects. We trace…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Sanghyun Jo , Wooyeol Lee , Ziseok Lee , Kyungsu Kim

The rapid advancement of large language models (LLMs) has accelerated the emergence of in-context learning (ICL) as a cutting-edge approach in the natural language processing domain. Recently, ICL has been employed in visual understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Dianmo Sheng , Dongdong Chen , Zhentao Tan , Qiankun Liu , Qi Chu , Jianmin Bao , Tao Gong , Bin Liu , Shengwei Xu , Nenghai Yu

The ubiquity of time series data creates a strong demand for general-purpose foundation models, yet developing them for classification remains a significant challenge, largely due to the high cost of labeled data. Foundation models capable…

Machine Learning · Computer Science 2025-11-27 Chin-Chia Michael Yeh , Uday Singh Saini , Junpeng Wang , Xin Dai , Xiran Fan , Jiarui Sun , Yujie Fan , Yan Zheng

In-context learning is a surprising and important phenomenon that emerged when modern language models were scaled to billions of learned parameters. Without modifying a large language model's weights, it can be tuned to perform various…

Computation and Language · Computer Science 2023-03-15 Noam Wies , Yoav Levine , Amnon Shashua

In-Context Learning (ICL) is a significant paradigm for Large Multimodal Models (LMMs), using a few in-context demonstrations (ICDs) for new task adaptation. However, its performance is sensitive to demonstration configurations and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Xiaoyu Li , Yuhang Liu , Xuanshuo Kang , Zheng Luo , Fangqi Lou , Xiaohua Wu , Zihan Xiong

In-context learning (ICL) enables task adaptation at inference time by conditioning on demonstrations rather than updating model parameters. Although recent time-series foundation models incorporate contextual conditioning, retrieval, or…

Machine Learning · Computer Science 2026-05-15 Anish Saha , Konstantin Shmakov

Large language models (LLMs) are increasingly applied to sequential decision-making through in-context learning (ICL), yet their effectiveness is highly sensitive to prompt quality. Effective prompts should meet three principles: focus on…

Artificial Intelligence · Computer Science 2025-11-19 Ruomeng Ding , Wei Cheng , Minglai Shao , Chen Zhao

In-context learning (ICL) is an important yet not fully understood ability of pre-trained large language models (LLMs). It can greatly enhance task performance using a few examples, termed demonstrations, without fine-tuning. Although…

Computation and Language · Computer Science 2025-06-03 Do Xuan Long , Duong Ngoc Yen , Do Xuan Trong , Luu Anh Tuan , Kenji Kawaguchi , Shafiq Joty , Min-Yen Kan , Nancy F. Chen

Point cloud processing (PCP) encompasses tasks like reconstruction, denoising, registration, and segmentation, each often requiring specialized models to address unique task characteristics. While in-context learning (ICL) has shown promise…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Feifei Shao , Ping Liu , Zhao Wang , Yawei Luo , Hongwei Wang , Jun Xiao

In-context learning (ICL) suffers from oversensitivity to the prompt, making it unreliable in real-world scenarios. We study the sensitivity of ICL with respect to multiple perturbation types. First, we find that label bias obscures the…

Computation and Language · Computer Science 2024-01-30 Yanda Chen , Chen Zhao , Zhou Yu , Kathleen McKeown , He He

The rise of large-scale models has catalyzed in-context learning as a powerful approach for multitasking, particularly in natural language and image processing. However, its application to 3D point cloud tasks has been largely unexplored.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Mengyuan Liu , Zhongbin Fang , Xia Li , Joachim M. Buhmann , Deheng Ye , Xiangtai Li , Chen Change Loy