English
Related papers

Related papers: Enhancing Multimodal In-Context Learning for Image…

200 papers

Multimodal in-context learning (ICL) is becoming a key capability that allows large vision-language models (LVLMs) to adapt to novel tasks without parameter updates, which expands their usefulness in many real-world applications. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yanshu Li , Jianjiang Yang , Ziteng Yang , Bozheng Li , Ligong Han , Hongyang He , Zhengtao Yao , Yingjie Victor Chen , Songlin Fei , Dongfang Liu , Ruixiang Tang

Despite their impressive realism, modern text-to-image models still struggle with compositionality, often failing to render accurate object counts, attributes, and spatial relations. To address this challenge, we present a training-free…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Minsuk Ji , Sanghyeok Lee , Namhyuk Ahn

In-context learning (ICL), teaching a large language model (LLM) to perform a task with few-shot demonstrations rather than adjusting the model parameters, has emerged as a strong paradigm for using LLMs. While early studies primarily used…

Computation and Language · Computer Science 2023-05-24 Man Luo , Xin Xu , Zhuyun Dai , Panupong Pasupat , Mehran Kazemi , Chitta Baral , Vaiva Imbrasaite , Vincent Y Zhao

In-Context Learning (ICL) is a significant paradigm for Large Multimodal Models (LMMs), using a few in-context demonstrations (ICDs) for new task adaptation. However, its performance is sensitive to demonstration configurations and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Xiaoyu Li , Yuhang Liu , Xuanshuo Kang , Zheng Luo , Fangqi Lou , Xiaohua Wu , Zihan Xiong

Clinical decision support systems require models that are not only highly accurate but also equitable and sensitive to the implications of missed diagnoses. In this study, we introduce a knowledge-guided in-context learning (ICL) framework…

Machine Learning · Computer Science 2025-07-28 Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia , Eugenio di Sciascio

In-context learning (ICL) improves language models' performance on a variety of NLP tasks by simply demonstrating a handful of examples at inference time. It is not well understood why ICL ability emerges, as the model has never been…

Computation and Language · Computer Science 2023-06-28 Xiaochuang Han , Daniel Simig , Todor Mihaylov , Yulia Tsvetkov , Asli Celikyilmaz , Tianlu Wang

In-context learning (ICL) has emerged as an effective solution for few-shot learning with large language models (LLMs). However, how LLMs leverage demonstrations to specify a task and learn a corresponding computational function through ICL…

Computation and Language · Computer Science 2025-11-17 Yu Bai , Heyan Huang , Cesare Spinoso-Di Piano , Marc-Antoine Rondeau , Sanxing Chen , Yang Gao , Jackie Chi Kit Cheung

Large language models (LLMs) have demonstrated impressive capabilities across a wide range of coding tasks, including summarization, translation, completion, and code generation. Despite these advances, detecting code vulnerabilities…

Software Engineering · Computer Science 2026-02-05 Md Abdul Hannan , Ronghao Ni , Chi Zhang , Limin Jia , Ravi Mangal , Corina S. Pasareanu

The rapid success of Vision Large Language Models (VLLMs) often depends on the high-resolution images with abundant visual tokens, which hinders training and deployment efficiency. Current training-free visual token compression methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Jianjian Li , Junquan Fan , Feng Tang , Gang Huang , Shitao Zhu , Songlin Liu , Nian Xie , Wulong Liu , Yong Liao

In-Context Learning (ICL) has emerged as a promising solution to enhance the code generation capabilities of Large Language Models (LLMs), which incorporates code examples inside the prompt to let LLMs learn from demonstrations. However,…

Software Engineering · Computer Science 2025-08-11 Dongze Li , Songqiang Chen , Jialun Cao , Shing-Chi Cheung

In-context learning (ICL) greatly improves the performance of large language models (LLMs) on various down-stream tasks, where the improvement highly depends on the quality of demonstrations. In this work, we introduce syntactic knowledge…

Computation and Language · Computer Science 2024-09-26 Chenming Tang , Zhixiang Wang , Yunfang Wu

Large vision language models (LVLMs) achieve remarkable performance through Vision In-context Learning (VICL), a process that depends significantly on demonstrations retrieved from an extensive collection of annotated examples (retrieval…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Wenqiang Wang , Yangshijie Zhang

Many-shot in-context learning (ICL) has emerged as a unique setup to both utilize and test the ability of large language models to handle long context. This paper delves into long-context language model (LCLM) evaluation through many-shot…

Computation and Language · Computer Science 2025-06-13 Kaijian Zou , Muhammad Khalifa , Lu Wang

Fine-grained skill representations, commonly referred to as knowledge components (KCs), are fundamental to many approaches in student modeling and learning analytics. However, KC-level correctness labels are rarely available in real-world…

Computation and Language · Computer Science 2026-03-31 Zhangqi Duan , Arnav Kankaria , Dhruv Kartik , Andrew Lan

Contrastive Language-Image Pre-training (CLIP) has shown powerful zero-shot learning performance. Few-shot learning aims to further enhance the transfer capability of CLIP by giving few images in each class, aka 'few shots'. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yaohui Li , Qifeng Zhou , Haoxing Chen , Jianbing Zhang , Xinyu Dai , Hao Zhou

In-Context Learning (ICL) enables Large Language Models (LLMs) to perform new tasks by conditioning on prompts with relevant information. Retrieval-Augmented Generation (RAG) enhances ICL by incorporating retrieved documents into the LLM's…

Machine Learning · Computer Science 2024-12-02 Marie Al Ghossein , Emile Contal , Alexandre Robicquet

Multimodal in-context learning (ICL) has emerged as a key capability of Large Vision-Language Models (LVLMs), driven by their increasing scale and applicability. Despite its promise, effective ICL in the multimodal setting remains…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yanshu Li

Multimodal large language models (MLLMs) rely heavily on instruction tuning to align vision and language capabilities, yet the computational cost of training on large-scale datasets remains a major bottleneck. Existing data selection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yichen Yan , Ming Zhong , Qi Zhu , Xiaoling Gu , Jinpeng Chen , Huan Li

Multimodal in-context learning (ICL) equips Large Vision-language Models (LVLMs) with the ability to adapt to new tasks via multiple user-provided demonstrations, without requiring any model parameter updates. However, its effectiveness is…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Yanshu Li , Yi Cao , Hongyang He , Qisen Cheng , Xiang Fu , Xi Xiao , Tianyang Wang , Ruixiang Tang

Image clustering is one of the crucial techniques in multimedia analytics and knowledge discovery. Recently, the Deep clustering method (DC), characterized by its ability to perform feature learning and cluster assignment jointly, surpasses…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haiyang Zheng , Ruilin Zhang , Hongpeng Wang