English
Related papers

Related papers: Prompt-Induced Score Variance in Zero-Shot Binary …

200 papers

Single-positive multi-label learning (SPMLL) is a typical weakly supervised multi-label learning problem, where each training example is annotated with only one positive label. Existing SPMLL methods typically assign pseudo-labels to…

Machine Learning · Computer Science 2024-05-28 Biao Liu , Ning Xu , Jie Wang , Xin Geng

Large Language Models (LLMs) can reason over natural-language inputs, but their role in intrusion detection without fine-tuning remains uncertain. This study evaluates a prompt-only approach on UNSW-NB15 by converting each network flow to a…

Cryptography and Security · Computer Science 2025-10-28 Mohammad Abdul Rehman , Syed Imad Ali Shah , Abbas Anwar , Noor Islam

Traditional benchmarks for large language models (LLMs), such as HELM and AIR-BENCH, primarily assess safety through breadth-oriented evaluation across diverse tasks and risk categories. However, real-world deployment often exposes a…

Machine Learning · Computer Science 2026-04-29 Keita Broadwater

Consistently scaling pre-trained language models (PLMs) imposes substantial burdens on model adaptation, necessitating more efficient alternatives to conventional fine-tuning. Given the advantage of prompting in the zero-shot setting and…

Computation and Language · Computer Science 2023-06-01 Yulin Chen , Ning Ding , Xiaobin Wang , Shengding Hu , Hai-Tao Zheng , Zhiyuan Liu , Pengjun Xie

Prompting pre-trained language models has achieved impressive performance on various NLP tasks, especially in low data regimes. Despite the success of prompting in monolingual settings, applying prompt-based methods in multilingual…

Computation and Language · Computer Science 2022-10-27 Yuxuan Chen , David Harbecke , Leonhard Hennig

Safety benchmarks are routinely treated as evidence about how a language model will behave once deployed, but this inference is fragile if behavior depends on whether a prompt looks like an evaluation. We define evaluation-context…

Computation and Language · Computer Science 2026-05-08 Florian A. D. Burnat , Brittany I. Davidson

Prompt-based verification is widely used to mitigate hallucinations in large vision-language models (LVLMs), yet when it helps remains poorly understood. We systematically study verification prompting across two representative LVLM…

Computation and Language · Computer Science 2026-05-28 Yuang Huang , Yafeng Zhang , Yu Zilan

Active learning (AL) aims to optimize model training and reduce annotation costs by selecting the most informative samples for labeling. Typically, AL methods rely on the empirical distribution of labeled data to define the decision…

Computation and Language · Computer Science 2025-07-23 Hui Xiang , Jinqiao Shi , Ting Zhang , Xiaojie Zhao , Yong Liu , Yong Ma

Prompt-based probing has been widely used in evaluating the abilities of pretrained language models (PLMs). Unfortunately, recent studies have discovered such an evaluation may be inaccurate, inconsistent and unreliable. Furthermore, the…

Computation and Language · Computer Science 2022-03-24 Boxi Cao , Hongyu Lin , Xianpei Han , Fangchao Liu , Le Sun

Prompt design significantly impacts the moral competence and safety alignment of large language models (LLMs), yet empirical comparisons remain fragmented across datasets and models.We introduce ProMoral-Bench, a unified benchmark…

Artificial Intelligence · Computer Science 2026-02-17 Rohan Subramanian Thomas , Shikhar Shiromani , Abdullah Chaudhry , Ruizhe Li , Vasu Sharma , Kevin Zhu , Sunishchal Dev

This paper proposes a novel framework for multi-label image recognition without any training data, called data-free framework, which uses knowledge of pre-trained Large Language Model (LLM) to learn prompts to adapt pretrained…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shuo Yang , Zirui Shang , Yongqi Wang , Derong Deng , Hongwei Chen , Qiyuan Cheng , Xinxiao Wu

Typographic prompt injection exploits vision language models' (VLMs) ability to read text rendered in images, posing a growing threat as VLMs power autonomous agents. Prior work typically focus on maximizing attack success rate (ASR) but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ravikumar Balakrishnan , Sanket Mendapara

Consistency under paraphrase, the property that semantically equivalent prompts yield identical predictions, is increasingly used as a proxy for reliability when deploying medical vision-language models (VLMs). We show this proxy is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Binesh Sadanandan , Vahid Behzadan

As powerful pre-trained vision-language models (VLMs) like CLIP gain prominence, numerous studies have attempted to combine VLMs for downstream tasks. Among these, prompt learning has been validated as an effective method for adapting to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yu Du , Tong Niu , Rong Zhao

The promising zero-shot generalization of vision-language models such as CLIP has led to their adoption using prompt learning for numerous downstream tasks. Previous works have shown test-time prompt tuning using entropy minimization to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Jameel Hassan , Hanan Gani , Noor Hussein , Muhammad Uzair Khattak , Muzammal Naseer , Fahad Shahbaz Khan , Salman Khan

Audio-language models have recently demonstrated strong zero-shot capabilities by leveraging natural-language supervision to classify audio events without labeled training data. Yet, their performance is highly sensitive to the wording of…

Prompt ensembling of Large Language Model (LLM) generated category-specific prompts has emerged as an effective method to enhance zero-shot recognition ability of Vision-Language Models (VLMs). To obtain these category-specific prompts, the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Sivan Doveh , Jakub Micorek , Mateusz Kozinski , Hilde Kuehne , Horst Possegger

Prompt tuning of Vision-Language Models (VLMs) such as CLIP, has demonstrated the ability to rapidly adapt to various downstream tasks. However, recent studies indicate that tuned VLMs may suffer from the problem of spurious correlations,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Chaoquan Jiang , Yunfan Yang , Rui Hu , Jitao Sang

Zero-shot text classification typically relies on prompt engineering, but the inherent prompt brittleness of large language models undermines its reliability. Minor changes in prompt can cause significant discrepancies in model performance.…

Computation and Language · Computer Science 2025-04-07 Junlang Qian , Zixiao Zhu , Hanzhang Zhou , Zijian Feng , Zepeng Zhai , Kezhi Mao

Pre-trained vision-language models (VLMs) have shown remarkable generalization capabilities via prompting, which leverages VLMs as knowledge bases to extract information beneficial for downstream tasks. However, existing methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xiaoyu Qiu , Hao Feng , Yuechen Wang , Wengang Zhou , Houqiang Li