English
Related papers

Related papers: VIOLA: Towards Video In-Context Learning with Mini…

200 papers

Few shot in-context learning (ICL) typically assumes access to large annotated training sets. However, in many real world scenarios, such as domain adaptation, there is only a limited budget to annotate a small number of samples, with the…

Computation and Language · Computer Science 2025-01-29 Uri Berger , Tal Baumel , Gabriel Stanovsky

The growing demand for AI training data has transformed data annotation into a global industry, but traditional approaches relying on human annotators are often time-consuming, labor-intensive, and prone to inconsistent quality. We propose…

Human-Computer Interaction · Computer Science 2024-09-25 Yifan Wang , David Stevens , Pranay Shah , Wenwen Jiang , Miao Liu , Xu Chen , Robert Kuo , Na Li , Boying Gong , Daniel Lee , Jiabo Hu , Ning Zhang , Bob Kamma

While Large Language Models (LLMs) have exhibited remarkable emergent capabilities through extensive pre-training, they still face critical limitations in generalizing to specialized domains and handling diverse linguistic variations, known…

Computation and Language · Computer Science 2025-05-28 Jinwu Hu , Zhitian Zhang , Guohao Chen , Xutao Wen , Chao Shuai , Wei Luo , Bin Xiao , Yuanqing Li , Mingkui Tan

Large Language Models (LLMs) have showcased their In-Context Learning (ICL) capabilities, enabling few-shot learning without the need for gradient updates. Despite its advantages, the effectiveness of ICL heavily depends on the choice of…

Computation and Language · Computer Science 2024-06-19 Vinay M. S. , Minh-Hao Van , Xintao Wu

Document images often have intricate layout structures, with numerous content regions (e.g. texts, figures, tables) densely arranged on each page. This makes the manual annotation of layout datasets expensive and inefficient. These…

Machine Learning · Computer Science 2021-03-31 Zejiang Shen , Jian Zhao , Melissa Dell , Yaoliang Yu , Weining Li

Audio-visual learning has been a major pillar of multi-modal machine learning, where the community mostly focused on its modality-aligned setting, i.e., the audio and visual modality are both assumed to signal the prediction target. With…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Yung-Hsuan Lai , Yen-Chun Chen , Yu-Chiang Frank Wang

In-context Learning (ICL) has emerged as a powerful capability alongside the development of scaled-up large language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks…

Computation and Language · Computer Science 2024-07-24 Quanyu Long , Yin Wu , Wenya Wang , Sinno Jialin Pan

Multimodal in-context learning (ICL) is becoming a key capability that allows large vision-language models (LVLMs) to adapt to novel tasks without parameter updates, which expands their usefulness in many real-world applications. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yanshu Li , Jianjiang Yang , Ziteng Yang , Bozheng Li , Ligong Han , Hongyang He , Zhengtao Yao , Yingjie Victor Chen , Songlin Fei , Dongfang Liu , Ruixiang Tang

The rapid advancement of large language models (LLMs) has accelerated the emergence of in-context learning (ICL) as a cutting-edge approach in the natural language processing domain. Recently, ICL has been employed in visual understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Dianmo Sheng , Dongdong Chen , Zhentao Tan , Qiankun Liu , Qi Chu , Jianmin Bao , Tao Gong , Bin Liu , Shengwei Xu , Nenghai Yu

Large language models (LLMs) have proven their remarkable versatility in handling a comprehensive range of language-centric applications. To expand LLMs' capabilities to a broader spectrum of modal inputs, multimodal large language models…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Qiang Zhou , Zhibin Wang , Wei Chu , Yinghui Xu , Hao Li , Yuan Qi

Source-Free Domain Adaptation (SFDA) seeks to adapt a source model, which is pre-trained on a supervised source domain, for a target domain, with only access to unlabeled target training data. Relying on pseudo labeling and/or auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Song Tang , Yunxiang Bai , Wenxin Su , Mao Ye , Jianwei Zhang , Xiatian Zhu

Working with annotated data is the cornerstone of supervised learning. Nevertheless, providing labels to instances is a task that requires significant human effort. Several critical real-world applications make things more complicated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Erencem Ozbey , Dimitrios I. Diochnos

With recent progress in joint modeling of visual and textual representations, Vision-Language Pretraining (VLP) has achieved impressive performance on many multimodal downstream tasks. However, the requirement for expensive annotations…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Zirui Wang , Jiahui Yu , Adams Wei Yu , Zihang Dai , Yulia Tsvetkov , Yuan Cao

High-quality relevance judgements over large query sets are essential for evaluating Information Retrieval (IR) systems, yet manual annotation remains costly and time-consuming. Large Language Models (LLMs) have recently shown promise as…

Information Retrieval · Computer Science 2026-05-07 David Otero , Javier Parapar

Various design settings for in-context learning (ICL), such as the choice and order of the in-context examples, can bias a model toward a particular prediction without being reflective of an understanding of the task. While many studies…

Computation and Language · Computer Science 2023-08-07 Yu Fei , Yifan Hou , Zeming Chen , Antoine Bosselut

While significant advancements have been made in compressed representations for text embeddings in large language models (LLMs), the compression of visual tokens in multi-modal LLMs (MLLMs) has remained a largely overlooked area. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Jieneng Chen , Luoxin Ye , Ju He , Zhao-Yang Wang , Daniel Khashabi , Alan Yuille

Large vision language models (LVLMs) achieve remarkable performance through Vision In-context Learning (VICL), a process that depends significantly on demonstrations retrieved from an extensive collection of annotated examples (retrieval…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Wenqiang Wang , Yangshijie Zhang

This system paper presents the DeMeVa team's approaches to the third edition of the Learning with Disagreements shared task (LeWiDi 2025; Leonardelli et al., 2025). We explore two directions: in-context learning (ICL) with large language…

Computation and Language · Computer Science 2025-09-12 Daniil Ignatev , Nan Li , Hugh Mee Wong , Anh Dang , Shane Kaszefski Yaschuk

Vision-Language-Action (VLA) models integrate visual perception, language understanding, and action decision-making for cross-modal semantic alignment, exhibiting broad application potential. However, the joint processing of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Chuhang Liu , Yayun He , Zuheng Kang , Xiaoyang Qu , Jianzong Wang

Foundational Vision-Language Models (VLMs) excel across diverse tasks, but adapting them to new domains without forgetting prior knowledge remains a critical challenge. Continual Learning (CL) addresses this challenge by enabling models to…

Machine Learning · Computer Science 2026-02-03 Vaibhav Singh , Rahaf Aljundi , Eugene Belilovsky