English
Related papers

Related papers: Generating customized prompts for Zero-Shot Rare E…

200 papers

In recent years, pre-trained large language models (LLMs) have demonstrated remarkable efficiency in achieving an inference-time few-shot learning capability known as in-context learning. However, existing literature has highlighted the…

Computation and Language · Computer Science 2024-02-14 Xinyi Wang , Wanrong Zhu , Michael Saxon , Mark Steyvers , William Yang Wang

Zero-shot Visual Question Answering (VQA) is a prominent vision-language task that examines both the visual and textual understanding capability of systems in the absence of training data. Recently, by converting the images into captions,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yunshi Lan , Xiang Li , Xin Liu , Yang Li , Wei Qin , Weining Qian

Prompt-based methods leverage the knowledge of pre-trained language models (PLMs) trained with a masked language modeling (MLM) objective; however, these methods are sensitive to template, verbalizer, and few-shot instance selection,…

Computation and Language · Computer Science 2025-07-02 Mohna Chakraborty , Adithya Kulkarni , Qi Li

Prompt engineering is an essential technique for enhancing the abilities of large language models (LLMs) by providing explicit and specific instructions. It enables LLMs to excel in various tasks, such as arithmetic reasoning, question…

Computation and Language · Computer Science 2024-03-29 Fobo Shi , Peijun Qing , Dong Yang , Nan Wang , Youbo Lei , Haonan Lu , Xiaodong Lin , Duantengchuan Li

Probing Pre-trained Language Models (PLMs) using prompts has indirectly implied that language models (LMs) can be treated as knowledge bases. To this end, this phenomena has been effective especially when these LMs are fine-tuned towards…

Computation and Language · Computer Science 2022-04-08 M. Abaho , D. Bollegala , P. Williamson , S. Dodd

Inspired by the outstanding zero-shot capability of vision language models (VLMs) in image classification tasks, open-vocabulary object detection has attracted increasing interest by distilling the broad VLM knowledge into detector…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Sheng Jin , Xueying Jiang , Jiaxing Huang , Lewei Lu , Shijian Lu

Prompt learning is an effective way to exploit the potential of large-scale pre-trained foundational models. Continuous prompts parameterize context tokens in prompts by turning them into differentiable vectors. Deep continuous prompts…

Machine Learning · Computer Science 2025-01-03 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Jianxi Gao

One of the most challenging problems in the field of intrusion detection is anomaly detection for discrete event logs. While most earlier work focused on applying unsupervised learning upon engineered features, most recent work has started…

Machine Learning · Computer Science 2021-06-04 Lun-Pin Yuan , Peng Liu , Sencun Zhu

Large language models (LLMs) have displayed an impressive ability to harness natural language to perform complex tasks. In this work, we explore whether we can leverage this learned ability to find and explain patterns in data.…

Machine Learning · Computer Science 2023-01-30 Chandan Singh , John X. Morris , Jyoti Aneja , Alexander M. Rush , Jianfeng Gao

Few-shot classification aims to adapt to new tasks with limited labeled examples. To fully use the accessible data, recent methods explore suitable measures for the similarity between the query and support images and better high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Kaihui Cheng , Chule Yang , Xiao Liu , Naiyang Guan , Zhiyuan Wang

Zero-shot domain-specific image classification is challenging in classifying real images without ground-truth in-domain training examples. Recent research involved knowledge from texts with a text-to-image model to generate in-domain…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Shijian Wang , Linxin Song , Ryotaro Shimizu , Masayuki Goto , Hanqian Wu

Recent advances in zero-shot and few-shot classification heavily rely on the success of pre-trained vision-language models (VLMs) such as CLIP. Due to a shortage of large-scale datasets, training such models for event camera data remains…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ziyi Wu , Xudong Liu , Igor Gilitschenski

Medical vision-language models (Med-VLMs) trained on large datasets of medical image-text pairs and later fine-tuned for specific tasks have emerged as a mainstream paradigm in medical image analysis. However, recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Noor Hussein , Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar

Adapting pre-trained models to open classes is a challenging problem in machine learning. Vision-language models fully explore the knowledge of text modality, demonstrating strong zero-shot recognition performance, which is naturally suited…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Zhengqing Gao , Xiang Ao , Xu-Yao Zhang , Cheng-Lin Liu

Visual Emotion Recognition (VER) is an important research topic due to its wide range of applications, including opinion mining and advertisement design. Extending this capability to recognize emotions at the individual level further…

Computation and Language · Computer Science 2025-09-08 Ryo Takahashi , Naoki Saito , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Prompt optimization is essential for enhancing the performance of Large Language Models (LLMs) in a range of Natural Language Processing (NLP) tasks, particularly in scenarios of few-shot learning where training examples are incorporated…

Computation and Language · Computer Science 2024-08-15 Dai Do , Quan Tran , Svetha Venkatesh , Hung Le

This paper presents a framework for predicting rare, high-impact outcomes by integrating large language models (LLMs) with a multi-model machine learning (ML) architecture. The approach combines the predictive strength of black-box models…

Machine Learning · Computer Science 2025-09-11 Mihir Kumar , Aaron Ontoyin Yin , Zakari Salifu , Kelvin Amoaba , Afriyie Kwesi Samuel , Fuat Alican , Yigit Ihlamur

Vision-Language Models for remote sensing have shown promising uses thanks to their extensive pretraining. However, their conventional usage in zero-shot scene classification methods still involves dividing large images into patches and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Karim El Khoury , Maxime Zanella , Benoît Gérin , Tiffanie Godelaine , Benoît Macq , Saïd Mahmoudi , Christophe De Vleeschouwer , Ismail Ben Ayed

Prompt-learning has become a new paradigm in modern natural language processing, which directly adapts pre-trained language models (PLMs) to $cloze$-style prediction, autoregressive modeling, or sequence to sequence generation, resulting in…

Computation and Language · Computer Science 2021-11-04 Ning Ding , Shengding Hu , Weilin Zhao , Yulin Chen , Zhiyuan Liu , Hai-Tao Zheng , Maosong Sun

As a fundamental and extensively studied task in computer vision, image segmentation aims to locate and identify different semantic concepts at the pixel level. Recently, inspired by In-Context Learning (ICL), several generalist…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Wei Suo , Lanqing Lai , Mengyang Sun , Hanwang Zhang , Peng Wang , Yanning Zhang