中文
相关论文

相关论文: How to Configure Good In-Context Sequence for Visu…

200 篇论文

Visual Question Answering (VQA) requires reasoning across visual and textual modalities, yet Large Vision-Language Models (LVLMs) often lack integrated commonsense knowledge, limiting their robustness in real-world scenarios. To address…

计算与语言 · 计算机科学 2025-06-12 Shuo Yang , Siwen Luo , Soyeon Caren Han , Eduard Hovy

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional capabilities in complex tasks like machine translation, commonsense reasoning, and language understanding. One of the primary reasons for the adaptability of…

计算与语言 · 计算机科学 2024-07-12 Nicholas Kroeger , Dan Ley , Satyapriya Krishna , Chirag Agarwal , Himabindu Lakkaraju

In-context learning (ICL) derives its power from enabling Large Language Models to adapt to new tasks via prompt-based reasoning alone, entirely bypassing the need for parameter updates. Existing theories primarily study ICL in single-task…

机器学习 · 计算机科学 2026-05-28 Guangyu Li , Meng Ding , Lijie Hu

Multimodal Large Language Models (MLLMs), built on powerful language backbones, have enabled Multimodal In-Context Learning (MICL)-adapting to new tasks from a few multimodal demonstrations consisting of images, questions, and answers.…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Shuo Chen , Jianzhe Liu , Zhen Han , Yan Xia , Daniel Cremers , Philip Torr , Volker Tresp , Jindong Gu

In recent years, In-context Learning (ICL) has gained increasing attention and emerged as the new paradigm for large language model (LLM) evaluation. Unlike traditional fine-tuning methods, ICL instead adapts the pre-trained models to…

计算与语言 · 计算机科学 2023-03-07 Zhenyu Wu , YaoXiang Wang , Jiacheng Ye , Jiangtao Feng , Jingjing Xu , Yu Qiao , Zhiyong Wu

In question-answering scenarios, humans can assess whether the available information is sufficient and seek additional information if necessary, rather than providing a forced answer. In contrast, Vision Language Models (VLMs) typically…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Li Liu , Diji Yang , Sijia Zhong , Kalyana Suma Sree Tholeti , Lei Ding , Yi Zhang , Leilani H. Gilpin

Large Language Models (LLMs) have demonstrated the ability to solve complex tasks through In-Context Learning (ICL), where models learn from a few input-output pairs without explicit fine-tuning. In this paper, we explore the capacity of…

机器学习 · 计算机科学 2024-11-26 Paimon Goulart , Evangelos E. Papalexakis

For question-answering (QA) tasks, in-context learning (ICL) enables language models to generate responses without modifying their parameters by leveraging examples provided in the input. However, the effectiveness of ICL heavily depends on…

机器学习 · 计算机科学 2025-06-10 Ruhan Wang , Zhiyong Wang , Chengkai Huang , Rui Wang , Tong Yu , Lina Yao , John C. S. Lui , Dongruo Zhou

Large Language models (LLMs) have achieved encouraging results in tabular data generation. However, existing approaches require fine-tuning, which is computationally expensive. This paper explores an alternative: prompting a fixed LLM with…

机器学习 · 计算机科学 2025-02-25 Liancheng Fang , Aiwei Liu , Hengrui Zhang , Henry Peng Zou , Weizhi Zhang , Philip S. Yu

Recent advancements in video large multimodal models (LMMs) have significantly improved their video understanding and reasoning capabilities. However, their performance drops on out-of-distribution (OOD) tasks that are underrepresented in…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Kangsan Kim , Geon Park , Youngwan Lee , Woongyeong Yeo , Sung Ju Hwang

Large language models (LLMs) have achieved promising results in sentiment analysis through the in-context learning (ICL) paradigm. However, their ability to distinguish subtle sentiments still remains a challenge. Inspired by the human…

计算与语言 · 计算机科学 2024-06-06 Hongling Xu , Qianlong Wang , Yice Zhang , Min Yang , Xi Zeng , Bing Qin , Ruifeng Xu

In-context learning (ICL) is a crucial capability of current large language models (LLMs), where the selection of examples plays a key role in performance. While most existing approaches focus on selecting the most similar examples to the…

计算与语言 · 计算机科学 2025-06-06 Wenyang Xiao , Haoyu Zhao , Lingxiao Huang

Visual Question Answering (VQA) is an evolving research field aimed at enabling machines to answer questions about visual content by integrating image and language processing techniques such as feature extraction, object detection, text…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Ngoc Dung Huynh , Mohamed Reda Bouadjenek , Sunil Aryal , Imran Razzak , Hakim Hacid

Real-world applications of large language models (LLMs) in computational social science (CSS) tasks primarily depend on the effectiveness of instruction tuning (IT) or in-context learning (ICL). While IT has shown highly effective at…

计算与语言 · 计算机科学 2024-09-24 Taihang Wang , Xiaoman Xu , Yimin Wang , Ye Jiang

In-context learning (ICL) ability has emerged with the increasing scale of large language models (LLMs), enabling them to learn input-label mappings from demonstrations and perform well on downstream tasks. However, under the standard ICL…

计算与语言 · 计算机科学 2024-04-19 Yifan Wang , Qingyan Guo , Xinzhe Ni , Chufan Shi , Lemao Liu , Haiyun Jiang , Yujiu Yang

Multimodal large language models (MLLMs) have demonstrated great performance on visual question answering (VQA). When it comes to knowledge-based Visual Question Answering (KB-VQA), MLLMs may lack the specialized domain knowledge needed to…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Weixi Weng , Jieming Zhu , Xiaojun Meng , Hao Zhang , Rui Zhang , Chun Yuan

By simply incorporating demonstrations into the context, in-context learning (ICL) enables large language models (LLMs) to yield awesome performance on many tasks. In this study, we focus on passage-level long-context ICL for generation…

计算与语言 · 计算机科学 2025-06-09 Hao Sun , Chenming Tang , Gengyang Li , Yunfang Wu

In-context learning (ICL) approaches typically leverage prompting to condition decoder-only language model generation on reference information. Just-in-time processing of a context is inefficient due to the quadratic cost of self-attention…

Emerging multimodal large language models (MLLMs) exhibit great potential for chart question answering (CQA). Recent efforts primarily focus on scaling up training datasets (i.e., charts, data tables, and question-answer (QA) pairs) through…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Xingchen Zeng , Haichuan Lin , Yilin Ye , Wei Zeng

In-context learning (ICL) is a recent advancement in the capabilities of large language models (LLMs). This feature allows users to perform a new task without updating the model. Concretely, users can address tasks during the inference time…

密码学与安全 · 计算机科学 2024-07-10 Wai Man Si , Michael Backes , Yang Zhang