English
Related papers

Related papers: Exploring Lottery Prompts for Pre-trained Language…

200 papers

Prompt-based classifiers are an attractive approach for zero-shot classification. However, the precise choice of the prompt template and label words can largely influence performance, with semantically equivalent settings often showing…

Computation and Language · Computer Science 2023-09-12 Adian Liusie , Potsawee Manakul , Mark J. F. Gales

Large language models (LLMs) showcase increasingly impressive English benchmark scores, however their performance profiles remain inconsistent across multilingual settings. To address this gap, we introduce PolyPrompt, a novel,…

Computation and Language · Computer Science 2025-06-04 Nathan Roll

We observe that pre-trained large language models (LLMs) are capable of autoregressively completing complex token sequences -- from arbitrary ones procedurally generated by probabilistic context-free grammars (PCFG), to more rich spatial…

Artificial Intelligence · Computer Science 2023-10-27 Suvir Mirchandani , Fei Xia , Pete Florence , Brian Ichter , Danny Driess , Montserrat Gonzalez Arenas , Kanishka Rao , Dorsa Sadigh , Andy Zeng

Recently, large language models (LLMs) (e.g., GPT-4) have demonstrated impressive general-purpose task-solving abilities, including the potential to approach recommendation tasks. Along this line of research, this work aims to investigate…

Information Retrieval · Computer Science 2024-01-25 Yupeng Hou , Junjie Zhang , Zihan Lin , Hongyu Lu , Ruobing Xie , Julian McAuley , Wayne Xin Zhao

Time-series forecasting (TSF) finds broad applications in real-world scenarios. Prompting off-the-shelf Large Language Models (LLMs) demonstrates strong zero-shot TSF capabilities while preserving computational efficiency. However, existing…

Computation and Language · Computer Science 2024-02-27 Haoxin Liu , Zhiyuan Zhao , Jindong Wang , Harshavardhan Kamarthi , B. Aditya Prakash

Large language models (LLMs) are becoming a popular tool as they have significantly advanced in their capability to tackle a wide range of language-based tasks. However, LLMs applications are highly vulnerable to prompt injection attacks,…

Computation and Language · Computer Science 2024-11-11 Md Abdur Rahman , Fan Wu , Alfredo Cuzzocrea , Sheikh Iqbal Ahamed

Prompt-based learning has been proved to be an effective way in pre-trained language models (PLMs), especially in low-resource scenarios like few-shot settings. However, the trustworthiness of PLMs is of paramount significance and potential…

Computation and Language · Computer Science 2023-09-15 Zihao Tan , Qingliang Chen , Wenbin Zhu , Yongjian Huang

Going beyond mere fine-tuning of vision-language models (VLMs), learnable prompt tuning has emerged as a promising, resource-efficient alternative. Despite their potential, effectively learning prompts faces the following challenges: (i)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Hari Chandana Kuchibhotla , Sai Srinivas Kancheti , Abbavaram Gowtham Reddy , Vineeth N Balasubramanian

Large language models (LLMs) have the potential to enhance K-12 STEM education by improving both teaching and learning processes. While previous studies have shown promising results, there is still a lack of comprehensive understanding…

Computation and Language · Computer Science 2024-10-16 Eason Chen , Danyang Wang , Luyi Xu , Chen Cao , Xiao Fang , Jionghao Lin

The springing up of Large Language Models (LLMs) has shifted the community from single-task-orientated natural language processing (NLP) research to a holistic end-to-end multi-task learning paradigm. Along this line of research endeavors…

Computation and Language · Computer Science 2023-10-31 Yuanfeng Song , Yuanqin He , Xuefang Zhao , Hanlin Gu , Di Jiang , Haijun Yang , Lixin Fan , Qiang Yang

Large language models (LLMs) excel on new tasks without additional training, simply by providing natural language prompts that demonstrate how the task should be performed. Prompt ensemble methods comprehensively harness the knowledge of…

Computation and Language · Computer Science 2024-12-17 Hanxi Liu , Xiaokai Mao , Haocheng Xia , Jian Lou , Jinfei Liu , Kui Ren

The remarkable performance of pre-trained large language models has revolutionised various natural language processing applications. Due to huge parametersizes and extensive running costs, companies or organisations tend to transfer the…

Computation and Language · Computer Science 2023-12-15 Jiazheng Li , Runcong Zhao , Yongxin Yang , Yulan He , Lin Gui

Large Language Models (LLMs) are increasingly expected to handle complex decision-making tasks, yet their ability to perform structured resource allocation remains underexplored. Evaluating their reasoning is also difficult due to data…

Artificial Intelligence · Computer Science 2025-08-11 Sankarshan Damle , Boi Faltings

Large Language Models (LLMs) exhibit remarkable proficiency in addressing a diverse array of tasks within the Natural Language Processing (NLP) domain, with various prompt design strategies significantly augmenting their capabilities.…

Computation and Language · Computer Science 2024-08-05 Xiangyu Zhao , Chengqian Ma

Current literature demonstrates that Large Language Models (LLMs) are great few-shot learners, and prompting significantly increases their performance on a range of downstream tasks in a few-shot learning setting. An attempt to automate…

Computation and Language · Computer Science 2023-06-26 Yulin Zhou , Yiren Zhao , Ilia Shumailov , Robert Mullins , Yarin Gal

Language modeling studies the probability distributions over strings of texts. It is one of the most fundamental tasks in natural language processing (NLP). It has been widely used in text generation, speech recognition, machine…

Computation and Language · Computer Science 2024-07-18 Chengwei Wei , Yun-Cheng Wang , Bin Wang , C. -C. Jay Kuo

Large Language Models (LLMs) offer promising capabilities for tackling complex reasoning tasks, including optimization problems. However, existing methods either rely on prompt engineering, which leads to poor generalization across problem…

Machine Learning · Computer Science 2025-10-23 Dong Li , Xujiang Zhao , Linlin Yu , Yanchi Liu , Wei Cheng , Zhengzhang Chen , Zhong Chen , Feng Chen , Chen Zhao , Haifeng Chen

We investigate different natural language processing (NLP) approaches based on contextualised word representations for the problem of early prediction of lung cancer using free-text patient medical notes of Dutch primary care physicians.…

Computation and Language · Computer Science 2023-03-29 Auke Elfrink , Iacopo Vagliano , Ameen Abu-Hanna , Iacer Calixto

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks and exhibited impressive reasoning abilities by applying zero-shot Chain-of-Thought (CoT) prompting. However, due to the evolving nature of sentence…

Computation and Language · Computer Science 2024-02-09 Feihu Jin , Yifan Liu , Ying Tan

The emergence of Pre-trained Language Models (PLMs) has achieved tremendous success in the field of Natural Language Processing (NLP) by learning universal representations on large corpora in a self-supervised manner. The pre-trained models…

Information Retrieval · Computer Science 2023-09-14 Peng Liu , Lemei Zhang , Jon Atle Gulla