English
Related papers

Related papers: ConText: Driving In-context Learning for Text Remo…

200 papers

The open-set text recognition task is an emerging challenge that requires an extra capability to cognize novel characters during evaluation. We argue that a major cause of the limited performance for current methods is the confounding…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Chang Liu , Chun Yang , Xu-Cheng Yin

Vision In-Context Learning (VICL) enables inpainting models to quickly adapt to new visual tasks from only a few prompts. However, existing methods suffer from two key issues: (1) selecting only the most similar prompt discards…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Wenwen Liao , Jianbo Yu , Yuansong Wang , Shifu Yan , Xiaofeng Yang

Vision-language models are pre-trained by aligning image-text pairs in a common space to deal with open-set visual concepts. To boost the transferability of the pre-trained models, recent works adopt fixed or learnable prompts, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Jiangmeng Li , Wenyi Mo , Wenwen Qiang , Bing Su , Changwen Zheng , Hui Xiong , Ji-Rong Wen

Continual semantic segmentation (CSS) based on incremental learning (IL) is a great endeavour in developing human-like segmentation models. However, current CSS approaches encounter challenges in the trade-off between preserving old…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Bo Yuan , Danpei Zhao , Zhenwei Shi

The ability to learn from context with novel concepts, and deliver appropriate responses are essential in human conversations. Despite current Multimodal Large Language Models (MLLMs) and Large Language Models (LLMs) being trained on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yan Tai , Weichen Fan , Zhao Zhang , Feng Zhu , Rui Zhao , Ziwei Liu

Recent advances in image understanding have enabled methods that leverage large language models for multimodal reasoning in remote sensing. However, existing approaches still struggle to steer models to the user-relevant regions when only…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Xu Zhang , Jiabin Fang , Zhuoming Ding , Jin Yuan , Xuan Liu , Qianjun Zhang , Zhiyong Li

Current pre-trained vision-language models, such as CLIP, have demonstrated remarkable zero-shot generalization capabilities across various downstream tasks. However, their performance significantly degrades when test inputs exhibit…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Junhui Yin , Xinyu Zhang , Lin Wu , Xiaojie Wang

Image-text matching has been a hot research topic bridging the vision and language areas. It remains challenging because the current representation of image usually lacks global semantic concepts as in its corresponding text caption. To…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Kunpeng Li , Yulun Zhang , Kai Li , Yuanyuan Li , Yun Fu

Segmentation localizes objects in an image on a fine-grained per-pixel scale. Segmentation benefits by humans-in-the-loop to provide additional input of objects to segment using a combination of foreground or background clicks. Tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Nikolai Warner , Meera Hahn , Jonathan Huang , Irfan Essa , Vighnesh Birodkar

To bridge the gap between supervised semantic segmentation and real-world applications that acquires one model to recognize arbitrary new concepts, recent zero-shot segmentation attracts a lot of attention by exploring the relationships…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Quande Liu , Youpeng Wen , Jianhua Han , Chunjing Xu , Hang Xu , Xiaodan Liang

Can in-context learning (ICL) override pre-trained label semantics, or does it merely refine an existing semantic backbone? We address this question by treating LLMs as prompt-induced classifiers and contrasting their behavior under…

Computation and Language · Computer Science 2025-11-27 Anantha Padmanaban Krishna Kumar

Language models have the ability to perform in-context learning (ICL), allowing them to flexibly adapt their behavior based on context. This contrasts with in-weights learning (IWL), where memorized information is encoded in model…

Computation and Language · Computer Science 2025-03-04 Suraj Anand , Michael A. Lepori , Jack Merullo , Ellie Pavlick

Understanding in-context learning (ICL) capability that enables large language models (LLMs) to excel in proficiency through demonstration examples is of utmost importance. This importance stems not only from the better utilization of this…

Computation and Language · Computer Science 2024-10-04 Yuxiang Zhou , Jiazheng Li , Yanzheng Xiang , Hanqi Yan , Lin Gui , Yulan He

Large Language Models (LLMs) exhibit In-Context Learning (ICL), which enables the model to perform new tasks conditioning only on the examples provided in the context without updating the model's weights. While ICL offers fast adaptation…

Existing methods for arbitrary-shaped text detection in natural scenes face two critical issues, i.e., 1) fracture detections at the gaps in a text instance; and 2) inaccurate detections of arbitrary-shaped text instances with diverse…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Bo Du , Jian Ye , Jing Zhang , Juhua Liu , Dacheng Tao

Interpreting the internal process of neural models has long been a challenge. This challenge remains relevant in the era of large language models (LLMs) and in-context learning (ICL); for example, ICL poses a new issue of interpreting which…

Computation and Language · Computer Science 2025-07-10 Mengyu Ye , Tatsuki Kuribayashi , Goro Kobayashi , Jun Suzuki

Transformer-based language models excel at in-context learning (ICL), where they can adapt to new tasks based on contextual examples, without parameter updates. In a specific form of ICL, which we refer to as \textit{contextual recall},…

Machine Learning · Computer Science 2026-03-24 Bhavya Vasudeva , Puneesh Deora , Alberto Bietti , Vatsal Sharan , Christos Thrampoulidis

With in-context learning ability, the performance of large language models can be significantly boosted when provided with appropriate context. However, existing in-context learning methods mainly rely on human-provided contexts, such as…

Machine Learning · Computer Science 2024-08-21 Jinghan Yang , Shuming Ma , Furu Wei

In-context learning (ICL) has emerged as a new approach to various natural language processing tasks, utilizing large language models (LLMs) to make predictions based on context that has been supplemented with a few examples or…

Computation and Language · Computer Science 2023-05-23 Linyong Nan , Yilun Zhao , Weijin Zou , Narutatsu Ri , Jaesung Tae , Ellen Zhang , Arman Cohan , Dragomir Radev

Image recognition has recently witnessed a paradigm shift, where vision-language models are now used to perform few-shot classification based on textual prompts. Among these, the CLIP model has shown remarkable capabilities for zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Lorenzo Agnolucci , Alberto Baldrati , Francesco Todino , Federico Becattini , Marco Bertini , Alberto Del Bimbo