English
Related papers

Related papers: Enhancing Low-Resource LLMs Classification with PE…

200 papers

Large language models (LLMs) with decoder-only architectures demonstrate remarkable in-context learning (ICL) capabilities. This feature enables them to effectively handle both familiar and novel tasks by utilizing examples provided within…

Information Retrieval · Computer Science 2024-09-25 Chaofan Li , MingHao Qin , Shitao Xiao , Jianlyu Chen , Kun Luo , Yingxia Shao , Defu Lian , Zheng Liu

In-context machine translation (MT) with large language models (LLMs) is a promising approach for low-resource MT, as it can readily take advantage of linguistic resources such as grammar books and dictionaries. Such resources are usually…

Computation and Language · Computer Science 2025-05-30 Renhao Pei , Yihong Liu , Peiqin Lin , François Yvon , Hinrich Schütze

Large Language Models (LLMs) have recently demonstrated impressive few-shot learning capabilities through in-context learning (ICL). However, ICL performance is highly dependent on the choice of few-shot demonstrations, making the selection…

Computation and Language · Computer Science 2025-06-03 Soumya Suvra Ghosal , Soumyabrata Pal , Koyel Mukherjee , Dinesh Manocha

Large language models (LLMs) have shown impressive in-context learning (ICL) ability in code generation. LLMs take a prompt consisting of requirement-code examples and a new requirement as input, and output new programs. Existing studies…

Software Engineering · Computer Science 2023-10-17 Jia Li , Ge Li , Chongyang Tao , Jia Li , Huangzhao Zhang , Fang Liu , Zhi Jin

As large language models (LLMs) are widely adopted, new safety issues and policies emerge, to which existing safety classifiers do not generalize well. If we have only observed a few examples of violations of a new safety rule, how can we…

Machine Learning · Computer Science 2023-10-27 Ananth Balashankar , Xiao Ma , Aradhana Sinha , Ahmad Beirami , Yao Qin , Jilin Chen , Alex Beutel

Financial sentiment analysis plays a crucial role in uncovering latent patterns and detecting emerging trends, enabling individuals to make well-informed decisions that may yield substantial advantages within the constantly changing realm…

Machine Learning · Computer Science 2023-12-15 Sorouralsadat Fatemi , Yuheng Hu

The strong few-shot in-context learning capability of large pre-trained language models (PLMs) such as GPT-3 is highly appealing for application domains such as biomedicine, which feature high and diverse demands of language technologies…

Computation and Language · Computer Science 2022-11-08 Bernal Jiménez Gutiérrez , Nikolas McNeal , Clay Washington , You Chen , Lang Li , Huan Sun , Yu Su

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman

Until recently, fine-tuned BERT-like models provided state-of-the-art performance on text classification tasks. With the rise of instruction-tuned decoder-only models, commonly known as large language models (LLMs), the field has…

Computation and Language · Computer Science 2026-02-20 Taja Kuzman Pungeršek , Peter Rupnik , Ivan Porupski , Vuk Dinić , Nikola Ljubešić

We propose a novel zero-shot document ranking approach based on Large Language Models (LLMs): the Setwise prompting approach. Our approach complements existing prompting approaches for LLM-based zero-shot ranking: Pointwise, Pairwise, and…

Information Retrieval · Computer Science 2024-05-31 Shengyao Zhuang , Honglei Zhuang , Bevan Koopman , Guido Zuccon

LLMs are typically trained in high-resource languages, and tasks in lower-resourced languages tend to underperform the higher-resource language counterparts for in-context learning. Despite the large body of work on prompting settings, it…

Computation and Language · Computer Science 2025-06-25 Christopher Toukmaji , Jeffrey Flanigan

Collecting and annotating task-oriented dialogues is time-consuming and costly; thus, zero and few shot learning could greatly benefit dialogue state tracking (DST). In this work, we propose an in-context learning (ICL) framework for…

Computation and Language · Computer Science 2022-10-27 Yushi Hu , Chia-Hsuan Lee , Tianbao Xie , Tao Yu , Noah A. Smith , Mari Ostendorf

State-of-the-art Vision-Language Models (VLMs) ground the vision and the language modality primarily via projecting the vision tokens from the encoder to language-like tokens, which are directly fed to the Large Language Model (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Sivan Doveh , Shaked Perek , M. Jehanzeb Mirza , Wei Lin , Amit Alfassy , Assaf Arbelle , Shimon Ullman , Leonid Karlinsky

The recent GPT-3 model (Brown et al., 2020) achieves remarkable few-shot performance solely by leveraging a natural-language prompt and a few task demonstrations as input context. Inspired by their findings, we study few-shot learning in a…

Computation and Language · Computer Science 2021-06-03 Tianyu Gao , Adam Fisch , Danqi Chen

Large language models (LLMs) demonstrate impressive capabilities to generate accurate code snippets given natural language intents in a zero-shot manner, i.e., without the need for specific fine-tuning. While prior studies have highlighted…

Software Engineering · Computer Science 2024-12-30 Martin Weyssow , Xin Zhou , Kisub Kim , David Lo , Houari Sahraoui

Although large language models can be prompted for both zero- and few-shot learning, performance drops significantly when no demonstrations are available. In this paper, we introduce Z-ICL, a new zero-shot method that closes the gap by…

Computation and Language · Computer Science 2023-06-06 Xinxi Lyu , Sewon Min , Iz Beltagy , Luke Zettlemoyer , Hannaneh Hajishirzi

In-context learning can help Large Language Models (LLMs) to adapt new tasks without additional training. However, this performance heavily depends on the quality of the demonstrations, driving research into effective demonstration…

Computation and Language · Computer Science 2024-10-31 Dong Shu , Mengnan Du

The advent of transformers has fueled progress in machine translation. More recently large language models (LLMs) have come to the spotlight thanks to their generality and strong performance in a wide range of language tasks, including…

Computation and Language · Computer Science 2024-06-26 Roman Koshkin , Katsuhito Sudoh , Satoshi Nakamura

In-context learning (ICL) has transformed the use of large language models (LLMs) for NLP tasks, enabling few-shot learning by conditioning on labeled examples without finetuning. Despite its effectiveness, ICL is prone to errors,…

Computation and Language · Computer Science 2025-03-21 Mario Sanz-Guerrero , Katharina von der Wense

Image recognition has recently witnessed a paradigm shift, where vision-language models are now used to perform few-shot classification based on textual prompts. Among these, the CLIP model has shown remarkable capabilities for zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Lorenzo Agnolucci , Alberto Baldrati , Francesco Todino , Federico Becattini , Marco Bertini , Alberto Del Bimbo