中文
相关论文

相关论文: Guiding In-Context Learning of LLMs through Qualit…

200 篇论文

Large Language Models (LLMs) with in-context learning (ICL) ability can quickly adapt to a specific context given a few demonstrations (demos). Recently, Multimodal Large Language Models (MLLMs) built upon LLMs have also shown multimodal…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Shuo Chen , Zhen Han , Bailan He , Jianzhe Liu , Mark Buckley , Yao Qin , Philip Torr , Volker Tresp , Jindong Gu

Large language models (LLMs) have shown impressive in-context learning (ICL) ability in code generation. LLMs take a prompt consisting of requirement-code examples and a new requirement as input, and output new programs. Existing studies…

软件工程 · 计算机科学 2023-10-17 Jia Li , Ge Li , Chongyang Tao , Jia Li , Huangzhao Zhang , Fang Liu , Zhi Jin

In-context learning (ICL) enables Large Language Models (LLMs) to learn tasks from demonstration examples without parameter updates. Although it has been extensively studied in LLMs, its effectiveness in Vision-Language Models (VLMs)…

机器学习 · 计算机科学 2025-10-29 Gabriel O. dos Santos , Esther Colombini , Sandra Avila

The remarkable ability of Large Language Models (LLMs) to understand and follow instructions has sometimes been limited by their in-context learning (ICL) performance in low-resource languages. To address this, we introduce a novel approach…

计算与语言 · 计算机科学 2023-12-06 Xiaoqian Li , Ercong Nie , Sheng Liang

Generative Large Language Models (LLMs) are capable of being in-context learners. However, the underlying mechanism of in-context learning (ICL) is still a major research question, and experimental research results about how models exploit…

计算与语言 · 计算机科学 2025-02-11 Aliakbar Nafar , Kristen Brent Venable , Parisa Kordjamshidi

In-context learning (ICL) is the ability of a large language model (LLM) to learn a new task from a few demonstrations presented as part of the context. Past studies have attributed a large portion of the success of ICL to the way these…

计算与语言 · 计算机科学 2025-10-10 Ioana Marinescu , Kyunghyun Cho , Eric Karl Oermann

Large Language Models (LLMs) excel at in-context learning (ICL), a supervised learning technique that relies on adding annotated examples to the model context. We investigate a contextual bandit version of in-context reinforcement learning…

计算与语言 · 计算机科学 2025-09-30 Giovanni Monea , Antoine Bosselut , Kianté Brantley , Yoav Artzi

Recently, large language models (LLMs) have made remarkable progress in natural language processing. The most representative ability of LLMs is in-context learning (ICL), which enables LLMs to learn patterns from in-context exemplars…

计算与语言 · 计算机科学 2023-12-20 Jiachen Zhao

Vision-based quality assessment in additive manufacturing often requires dedicated machine learning models and application-specific datasets. However, data collection and model training can be expensive and time-consuming. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Qiaojie Zheng , Jiucai Zhang , Xiaoli Zhang

Multilingual large language models (MLLMs) are able to leverage in-context learning (ICL) to achieve high performance by leveraging cross-lingual knowledge transfer without parameter updates. However, their effectiveness is highly sensitive…

计算与语言 · 计算机科学 2025-02-18 Masahiro Kaneko , Alham Fikri Aji , Timothy Baldwin

In-context learning (ICL) enables large language models (LLMs) to adapt to new tasks during inference using only a few demonstrations. However, ICL performance is highly dependent on the selection of these demonstrations. Recent work…

机器学习 · 计算机科学 2025-05-27 Zheng Zhang , Shaocheng Lan , Lei Song , Jiang Bian , Yexin Li , Kan Ren

Many-shot in-context learning (ICL) has emerged as a unique setup to both utilize and test the ability of large language models to handle long context. This paper delves into long-context language model (LCLM) evaluation through many-shot…

计算与语言 · 计算机科学 2025-06-13 Kaijian Zou , Muhammad Khalifa , Lu Wang

Large language models (LLMs) have shown an impressive ability to perform a wide range of tasks using in-context learning (ICL), where a few examples are used to describe a task to the model. However, the performance of ICL varies…

计算与语言 · 计算机科学 2024-06-25 Keqin Peng , Liang Ding , Yancheng Yuan , Xuebo Liu , Min Zhang , Yuanxin Ouyang , Dacheng Tao

In-context machine translation (MT) with large language models (LLMs) is a promising approach for low-resource MT, as it can readily take advantage of linguistic resources such as grammar books and dictionaries. Such resources are usually…

计算与语言 · 计算机科学 2025-05-30 Renhao Pei , Yihong Liu , Peiqin Lin , François Yvon , Hinrich Schütze

Large Language Models (LLMs) exhibit In-Context Learning (ICL), which enables the model to perform new tasks conditioning only on the examples provided in the context without updating the model's weights. While ICL offers fast adaptation…

In-context learning (ICL), teaching a large language model (LLM) to perform a task with few-shot demonstrations rather than adjusting the model parameters, has emerged as a strong paradigm for using LLMs. While early studies primarily used…

计算与语言 · 计算机科学 2023-05-24 Man Luo , Xin Xu , Zhuyun Dai , Panupong Pasupat , Mehran Kazemi , Chitta Baral , Vaiva Imbrasaite , Vincent Y Zhao

The emergent ability of Large Language Models to use a small number of examples to learn to perform in novel domains and tasks, also called in-context learning (ICL). In this work, we show that a much smaller model can be trained to perform…

计算与语言 · 计算机科学 2023-09-18 Raphael Reinauer , Patrick Simianer , Kaden Uhlig , Johannes E. M. Mosig , Joern Wuebker

Relation extraction (RE) is an important task that aims to identify the relationships between entities in texts. While large language models (LLMs) have revealed remarkable in-context learning (ICL) capability for general zero and few-shot…

计算与语言 · 计算机科学 2024-04-30 Guozheng Li , Peng Wang , Jiajun Liu , Yikai Guo , Ke Ji , Ziyu Shang , Zijie Xu

This paper investigates the reference-less evaluation of machine translation for low-resource language pairs, known as quality estimation (QE). Segment-level QE is a challenging cross-lingual language understanding task that provides a…

计算与语言 · 计算机科学 2025-01-09 Archchana Sindhujan , Diptesh Kanojia , Constantin Orasan , Shenbin Qian

In-context learning (ICL) in Large Language Models (LLMs) has emerged as a powerful new learning paradigm. However, its underlying mechanism is still not well understood. In particular, it is challenging to map it to the "standard" machine…

计算与语言 · 计算机科学 2023-10-25 Roee Hendel , Mor Geva , Amir Globerson