English
Related papers

Related papers: PromptNCE: Pointwise Mutual Information Prediction…

200 papers

Prompting large language models is a training-free method for detecting Alzheimer's disease from speech transcripts. Using the ADReSS dataset, we revisit zero-shot prompting and study few-shot prompting with a class-balanced protocol using…

Machine Learning · Computer Science 2025-09-25 Jana Sweidan , Mounim A. El-Yacoubi , Nasredine Semmar

While most existing works on LLM prompting techniques focus only on how to select a better set of data samples inside one single prompt input (In-Context Learning or ICL), why can not we design and leverage multiple prompts together to…

Computation and Language · Computer Science 2024-04-03 Bingsheng Yao , Guiming Chen , Ruishi Zou , Yuxuan Lu , Jiachen Li , Shao Zhang , Yisi Sang , Sijia Liu , James Hendler , Dakuo Wang

Vision-Language Models (VLMs), such as CLIP, have significantly advanced zero-shot image recognition. However, their performance remains limited by suboptimal prompt engineering and poor adaptability to target classes. While recent methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Hui Liu , Kecheng Chen , Jialiang Wang , Xianming Liu , Wenya Wang , Haoliang Li

Ranking documents using Large Language Models (LLMs) by directly feeding the query and candidate documents into the prompt is an interesting and practical problem. However, researchers have found it difficult to outperform fine-tuned…

Information Retrieval · Computer Science 2024-03-29 Zhen Qin , Rolf Jagerman , Kai Hui , Honglei Zhuang , Junru Wu , Le Yan , Jiaming Shen , Tianqi Liu , Jialu Liu , Donald Metzler , Xuanhui Wang , Michael Bendersky

Large language models (LLMs) encode parametric knowledge about world facts and have shown remarkable performance in knowledge-driven NLP tasks. However, their reliance on parametric knowledge may cause them to overlook contextual cues,…

Computation and Language · Computer Science 2023-10-24 Wenxuan Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

Large Language Models are expressive tools that enable complex tasks of text understanding within Computational Social Science. Their versatility, while beneficial, poses a barrier for establishing standardized best practices within the…

Computers and Society · Computer Science 2024-08-05 Anders Giovanni Møller , Luca Maria Aiello

Although pretrained language models (PLMs) can be prompted to perform a wide range of language tasks, it remains an open question how much this ability comes from generalizable linguistic understanding versus surface-level lexical patterns.…

Computation and Language · Computer Science 2023-05-23 Terra Blevins , Hila Gonen , Luke Zettlemoyer

Research on prompting has shown excellent performance with little or even no supervised training across many tasks. However, prompting for machine translation is still under-explored in the literature. We fill this gap by offering a…

Computation and Language · Computer Science 2023-01-19 Biao Zhang , Barry Haddow , Alexandra Birch

Prompt engineering is an essential technique for enhancing the abilities of large language models (LLMs) by providing explicit and specific instructions. It enables LLMs to excel in various tasks, such as arithmetic reasoning, question…

Computation and Language · Computer Science 2024-03-29 Fobo Shi , Peijun Qing , Dong Yang , Nan Wang , Youbo Lei , Haonan Lu , Xiaodong Lin , Duantengchuan Li

The latest generation of LLMs can be prompted to achieve impressive zero-shot or few-shot performance in many NLP tasks. However, since performance is highly sensitive to the choice of prompts, considerable effort has been devoted to…

Computation and Language · Computer Science 2023-11-06 Alina Leidinger , Robert van Rooij , Ekaterina Shutova

Pre-trained Language Models (PLMs) are known to contain various kinds of knowledge. One method to infer relational knowledge is through the use of cloze-style prompts, where a model is tasked to predict missing subjects or objects.…

Computation and Language · Computer Science 2024-04-03 Stephan Linzbach , Dimitar Dimitrov , Laura Kallmeyer , Kilian Evang , Hajira Jabeen , Stefan Dietze

Soft prompt tuning achieves superior performances across a wide range of few-shot tasks. However, the performances of prompt tuning can be highly sensitive to the initialization of the prompts. We also empirically observe that conventional…

Computation and Language · Computer Science 2023-06-09 Junda Wu , Tong Yu , Rui Wang , Zhao Song , Ruiyi Zhang , Handong Zhao , Chaochao Lu , Shuai Li , Ricardo Henao

A hallmark of modern large language models (LLMs) is their impressive general zero-shot and few-shot abilities, often elicited through in-context learning (ICL) via prompting. However, while highly coveted and being the most general,…

Computation and Language · Computer Science 2023-10-24 Xingchen Wan , Ruoxi Sun , Hootan Nakhost , Hanjun Dai , Julian Martin Eisenschlos , Sercan O. Arik , Tomas Pfister

Recently introduced language model prompting methods can achieve high accuracy in zero- and few-shot settings while requiring few to no learned task-specific parameters. Nevertheless, these methods still often trail behind full model…

Computation and Language · Computer Science 2022-10-24 Zhaofeng Wu , Robert L. Logan , Pete Walsh , Akshita Bhagia , Dirk Groeneveld , Sameer Singh , Iz Beltagy

The item cold-start problem is crucial for online recommender systems, as the success of the cold-start phase determines whether items can transition into popular ones. Prompt learning, a powerful technique used in natural language…

Information Retrieval · Computer Science 2024-12-25 Yuezihan Jiang , Gaode Chen , Wenhan Zhang , Jingchi Wang , Yinjie Jiang , Qi Zhang , Jingjian Lin , Peng Jiang , Kaigui Bian

The grammatical knowledge of language models (LMs) is often measured using a benchmark of linguistic minimal pairs, where the LMs are presented with a pair of acceptable and unacceptable sentences and required to judge which is more…

Computation and Language · Computer Science 2025-02-10 Yusuke Ide , Yuto Nishida , Justin Vasselli , Miyu Oba , Yusuke Sakai , Hidetaka Kamigaito , Taro Watanabe

This paper studies contextual biasing with Large Language Models (LLMs), where during second-pass rescoring additional contextual information is provided to a LLM to boost Automatic Speech Recognition (ASR) performance. We propose to…

Computation and Language · Computer Science 2023-09-25 Chuanneng Sun , Zeeshan Ahmed , Yingyi Ma , Zhe Liu , Lucas Kabela , Yutong Pang , Ozlem Kalinli

Large Language Models (LLMs) have achieved impressive performance across various reasoning tasks. However, even state-of-the-art LLMs such as ChatGPT are prone to logical errors during their reasoning processes. Existing solutions, such as…

Computation and Language · Computer Science 2024-03-25 Chi Hu , Yuan Ge , Xiangnan Ma , Hang Cao , Qiang Li , Yonghua Yang , Tong Xiao , Jingbo Zhu

Recent advancements in speech synthesis have enabled large language model (LLM)-based systems to perform zero-shot generation with controllable content, timbre, speaker identity, and emotion through input prompts. As a result, these models…

The cold-start user issue further compromises the effectiveness of recommender systems in limiting access to the historical behavioral information. It is an effective pipeline to optimize instructional prompts on a few-shot large language…

Artificial Intelligence · Computer Science 2025-09-12 Haowei Yang , Yushang Zhao , Sitao Min , Bo Su , Chao Yao , Wei Xu