English
Related papers

Related papers: Z-BERT-A: a zero-shot Pipeline for Unknown Intent …

200 papers

Few-shot learning-the ability to train models with access to limited data-has become increasingly popular in the natural language processing (NLP) domain, as large language models such as GPT and T0 have been empirically shown to achieve…

Software Engineering · Computer Science 2023-06-16 Robert Kraig Helmeczi , Mucahit Cevik , Savas Yıldırım

Zero-shot point cloud segmentation aims to make deep models capable of recognizing novel objects in point cloud that are unseen in the training phase. Recent trends favor the pipeline which transfers knowledge from seen classes with labels…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yuhang Lu , Qi Jiang , Runnan Chen , Yuenan Hou , Xinge Zhu , Yuexin Ma

We present the zero-shot entity linking task, where mentions must be linked to unseen entities without in-domain labeled data. The goal is to enable robust transfer to highly specialized domains, and so no metadata or alias tables are…

Computation and Language · Computer Science 2019-06-19 Lajanugen Logeswaran , Ming-Wei Chang , Kenton Lee , Kristina Toutanova , Jacob Devlin , Honglak Lee

Pretrained contextual representation models (Peters et al., 2018; Devlin et al., 2018) have pushed forward the state-of-the-art on many NLP tasks. A new release of BERT (Devlin, 2018) includes a model simultaneously pretrained on 104…

Computation and Language · Computer Science 2019-10-04 Shijie Wu , Mark Dredze

Learning what to share between tasks has been a topic of great importance recently, as strategic sharing of knowledge has been shown to improve downstream task performance. This is particularly important for multilingual applications, as…

Computation and Language · Computer Science 2020-10-06 Farhad Nooralahzadeh , Giannis Bekoulis , Johannes Bjerva , Isabelle Augenstein

Benefiting from generalizability of vision-language models (VLMs) such as CLIP, many zero-/few-shot anomaly detection (AD) approaches have achieved impressive detection performance across various datasets. Nevertheless, they require…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yi Zhang , Jiawen Zhu , Lele Fu , Guansong Pang

Pretrained language models (PLMs) have demonstrated remarkable performance in various natural language processing tasks: Unidirectional PLMs (e.g., GPT) are well known for their superior text generation capabilities; bidirectional PLMs…

Computation and Language · Computer Science 2022-10-13 Yu Meng , Jiaxin Huang , Yu Zhang , Jiawei Han

In this study, a modular, data-free pipeline for multi-label intention recognition is proposed for agentic AI applications in transportation. Unlike traditional intent recognition systems that depend on large, annotated corpora and often…

Machine Learning · Computer Science 2025-11-06 Xiaocai Zhang , Hur Lim , Ke Wang , Zhe Xiao , Jing Wang , Kelvin Lee , Xiuju Fu , Zheng Qin

Vision-language models have showcased impressive zero-shot classification capabilities when equipped with suitable text prompts. Previous studies have shown the effectiveness of test-time prompt tuning; however, these methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yuhan Zhu , Guozhen Zhang , Chen Xu , Haocheng Shen , Xiaoxin Chen , Gangshan Wu , Limin Wang

Pre-trained vision-language models (VLMs) are highly adaptable to various downstream tasks through few-shot learning, making prompt-based anomaly detection a promising approach. Traditional methods depend on human-crafted prompts that…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Pi-Wei Chen , Jerry Chun-Wei Lin , Jia Ji , Feng-Hao Yeh , Zih-Ching Chen , Chao-Chun Chen

An important concern in training multilingual neural machine translation (NMT) is to translate between language pairs unseen during training, i.e zero-shot translation. Improving this ability kills two birds with one stone by providing an…

Computation and Language · Computer Science 2019-06-21 Ngoc-Quan Pham , Jan Niehues , Thanh-Le Ha , Alex Waibel

The remarkable advancements in large language models (LLMs) have brought about significant improvements in Natural Language Processing(NLP) tasks. This paper presents a comprehensive review of in-context learning techniques, focusing on…

Computation and Language · Computer Science 2023-09-26 Yinheng Li

Large-scale pre-trained language models have shown remarkable results in diverse NLP applications. Unfortunately, these performance gains have been accompanied by a significant increase in computation time and model size, stressing the need…

Computation and Language · Computer Science 2021-09-27 Cristóbal Eyzaguirre , Felipe del Río , Vladimir Araujo , Álvaro Soto

The Zero-Shot Learning (ZSL) task pertains to the identification of entities or relations in texts that were not seen during training. ZSL has emerged as a critical research area due to the scarcity of labeled data in specific domains, and…

Computation and Language · Computer Science 2023-07-26 Gabriele Picco , Marcos Martínez Galindo , Alberto Purpura , Leopold Fuchs , Vanessa López , Hoang Thanh Lam

Existing AI-generated text detection methods heavily depend on large annotated datasets and external threshold tuning, restricting interpretability, adaptability, and zero-shot effectiveness. To address these limitations, we propose…

Computation and Language · Computer Science 2025-05-22 Jiatao Li , Mao Ye , Cheng Peng , Xunjian Yin , Xiaojun Wan

Intent detection is a text classification task whose aim is to recognize and label the semantics behind a users query. It plays a critical role in various business applications. The output of the intent detection module strongly conditions…

Machine Learning · Computer Science 2024-08-07 Eduardo Sanchez-Karhunen , Jose F. Quesada-Moreno , Miguel A. Gutiérrez-Naranjo

State-of-the-art neural language models can now be used to solve ad-hoc language tasks through zero-shot prompting without the need for supervised training. This approach has gained popularity in recent years, and researchers have…

Computation and Language · Computer Science 2022-08-17 Hendrik Strobelt , Albert Webson , Victor Sanh , Benjamin Hoover , Johanna Beyer , Hanspeter Pfister , Alexander M. Rush

A hallmark of modern large language models (LLMs) is their impressive general zero-shot and few-shot abilities, often elicited through in-context learning (ICL) via prompting. However, while highly coveted and being the most general,…

Computation and Language · Computer Science 2023-10-24 Xingchen Wan , Ruoxi Sun , Hootan Nakhost , Hanjun Dai , Julian Martin Eisenschlos , Sercan O. Arik , Tomas Pfister

Pre-trained vision-language models, e.g., CLIP, working with manually designed prompts have demonstrated great capacity of transfer learning. Recently, learnable prompts achieve state-of-the-art performance, which however are prone to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Baoshuo Kan , Teng Wang , Wenpeng Lu , Xiantong Zhen , Weili Guan , Feng Zheng

Today, the detection of AI-generated content is receiving more and more attention. Our idea is to go beyond detection and try to recover the prompt used to generate a text. This paper, to the best of our knowledge, introduces the first…

Computation and Language · Computer Science 2024-06-25 Louis Give , Timo Zaoral , Maria Antonietta Bruno