English
Related papers

Related papers: Multi-modal In-Context Learning Makes an Ego-evolv…

200 papers

Multi-modal models have shown appealing performance in visual recognition tasks, as free-form text-guided training evokes the ability to understand fine-grained visual content. However, current models cannot be trivially applied to scene…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yongkun Du , Zhineng Chen , Yuchen Su , Caiyan Jia , Yu-Gang Jiang

In-context Learning (ICL) has emerged as a powerful capability alongside the development of scaled-up large language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks…

Computation and Language · Computer Science 2024-07-24 Quanyu Long , Yin Wu , Wenya Wang , Sinno Jialin Pan

Scene Text Recognition (STR) is difficult because of the variations in text styles, shapes, and backgrounds. Though the integration of linguistic information enhances models' performance, existing methods based on either permuted language…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Xiaomeng Yang , Zhi Qiao , Jin Wei , Dongbao Yang , Yu Zhou

The remarkable performance of Large Language Models (LLMs) can be enhanced with test-time computation, which relies on external tools and even other deep learning models. However, existing approaches for integrating non-text modality…

Computation and Language · Computer Science 2025-12-12 Tianle Zhang , Wanlong Fang , Jonathan Woo , Paridhi Latawa , Deepak A. Subramanian , Alvin Chan

In-Context Learning (ICL) empowers Large Language Models (LLMs) with the ability to learn from a few examples provided in the prompt, enabling downstream generalization without the requirement for gradient updates. Despite encouragingly…

Computation and Language · Computer Science 2025-01-28 Haitao Mao , Guangliang Liu , Yao Ma , Rongrong Wang , Kristen Johnson , Jiliang Tang

Large language models (LLMs) exploit in-context learning (ICL) to solve tasks with only a few demonstrations, but its mechanisms are not yet well-understood. Some works suggest that LLMs only recall already learned concepts from…

Computation and Language · Computer Science 2023-05-18 Jane Pan , Tianyu Gao , Howard Chen , Danqi Chen

In this paper, we investigate cross-lingual learning (CLL) for multilingual scene text recognition (STR). CLL transfers knowledge from one language to another. We aim to find the condition that exploits knowledge from high-resource…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Jeonghun Baek , Yusuke Matsui , Kiyoharu Aizawa

In-context Learning (ICL) empowers large language models (LLMs) to swiftly adapt to unseen tasks at inference-time by prefixing a few demonstration examples before queries. Despite its versatility, ICL incurs substantial computational and…

Machine Learning · Computer Science 2025-02-26 Zhuowei Li , Zihao Xu , Ligong Han , Yunhe Gao , Song Wen , Di Liu , Hao Wang , Dimitris N. Metaxas

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

Computation and Language · Computer Science 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

Large Language Models (LLMs) exhibit In-Context Learning (ICL), which enables the model to perform new tasks conditioning only on the examples provided in the context without updating the model's weights. While ICL offers fast adaptation…

In-context learning (ICL) using large language models for tasks with many labels is challenging due to the limited context window, which makes it difficult to fit a sufficient number of examples in the prompt. In this paper, we use a…

Computation and Language · Computer Science 2023-12-07 Aristides Milios , Siva Reddy , Dzmitry Bahdanau

Pre-trained vision-language models~(VLMs) are the de-facto foundation models for various downstream tasks. However, scene text recognition methods still prefer backbones pre-trained on a single modality, namely, the visual modality, despite…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Shuai Zhao , Ruijie Quan , Linchao Zhu , Yi Yang

Scene text recognition (STR) enables computers to recognize and read the text in various real-world scenes. Recent STR models benefit from taking linguistic information in addition to visual cues into consideration. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Jie Wu , Ying Peng , Shengming Zhang , Weigang Qi , Jian Zhang

In-context learning (ICL) enables Large Language Models (LLMs) to learn tasks from demonstration examples without parameter updates. Although it has been extensively studied in LLMs, its effectiveness in Vision-Language Models (VLMs)…

Machine Learning · Computer Science 2025-10-29 Gabriel O. dos Santos , Esther Colombini , Sandra Avila

As model context lengths continue to increase, the number of demonstrations that can be provided in-context approaches the size of entire training datasets. We study the behavior of in-context learning (ICL) at this extreme scale on…

Computation and Language · Computer Science 2025-03-05 Amanda Bertsch , Maor Ivgi , Emily Xiao , Uri Alon , Jonathan Berant , Matthew R. Gormley , Graham Neubig

Deep learning based methods have achieved surprising progress in Scene Text Recognition (STR), one of classic problems in computer vision. In this paper, we propose a feasible framework for multi-lingual arbitrary-shaped STR, including…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Jinjin Zhang , Wei Wang , Di Huang , Qingjie Liu , Yunhong Wang

The remarkable capability of large language models (LLMs) for in-context learning (ICL) needs to be activated by demonstration examples. Prior work has extensively explored the selection of examples for ICL, predominantly following the…

Computation and Language · Computer Science 2024-06-07 Haoyu Liu , Jianfeng Liu , Shaohan Huang , Yuefeng Zhan , Hao Sun , Weiwei Deng , Furu Wei , Qi Zhang

Large Language Models (LLMs) excel at in-context learning (ICL), a supervised learning technique that relies on adding annotated examples to the model context. We investigate a contextual bandit version of in-context reinforcement learning…

Computation and Language · Computer Science 2025-09-30 Giovanni Monea , Antoine Bosselut , Kianté Brantley , Yoav Artzi

In-context learning (ICL), teaching a large language model (LLM) to perform a task with few-shot demonstrations rather than adjusting the model parameters, has emerged as a strong paradigm for using LLMs. While early studies primarily used…

Computation and Language · Computer Science 2023-05-24 Man Luo , Xin Xu , Zhuyun Dai , Panupong Pasupat , Mehran Kazemi , Chitta Baral , Vaiva Imbrasaite , Vincent Y Zhao

In-Context Learning (ICL) empowers Large Language Models (LLMs) for rapid task adaptation without Fine-Tuning (FT), but its reliance on demonstration selection remains a critical challenge. While many-shot ICL shows promising performance…

Computation and Language · Computer Science 2025-06-06 Jianfei Zhang , Bei Li , Jun Bai , Rumei Li , Yanmeng Wang , Chenghua Lin , Wenge Rong
‹ Prev 1 2 3 10 Next ›