English
Related papers

Related papers: Large Language Models as Zero-Shot Keyphrase Extra…

200 papers

We introduce ZeroSCROLLS, a zero-shot benchmark for natural language understanding over long texts, which contains only test and small validation sets, without training data. We adapt six tasks from the SCROLLS benchmark, and add four new…

Computation and Language · Computer Science 2023-12-19 Uri Shaham , Maor Ivgi , Avia Efrat , Jonathan Berant , Omer Levy

With the emergence of numerous Large Language Models (LLM), the usage of such models in various Natural Language Processing (NLP) applications is increasing extensively. Counterspeech generation is one such key task where efforts are made…

Computation and Language · Computer Science 2024-03-25 Punyajoy Saha , Aalok Agrawal , Abhik Jana , Chris Biemann , Animesh Mukherjee

POS tagging plays a fundamental role in numerous applications. While POS taggers are highly accurate in well-resourced settings, they lag behind in cases of limited or missing training data. This paper focuses on POS tagging for languages…

Computation and Language · Computer Science 2024-10-15 Zeno Vandenbulcke , Lukas Vermeire , Miryam de Lhoneux

We explore the use of large language models (LLMs) for zero-shot semantic parsing. Semantic parsing involves mapping natural language utterances to task-specific meaning representations. Language models are generally trained on the publicly…

Computation and Language · Computer Science 2022-12-22 Dheeraj Mekala , Jason Wolfe , Subhro Roy

Large Language Models (LLMs) have rapidly transformed software development, especially in code generation. However, their inconsistent performance, prone to hallucinations and quality issues, complicates program comprehension and hinders…

Software Engineering · Computer Science 2025-04-21 Antonio Della Porta , Stefano Lambiase , Fabio Palomba

Large language models (LLMs) can be used as accessible and intelligent chatbots by constructing natural language queries and directly inputting the prompt into the large language model. However, different prompt' constructions often lead to…

Computation and Language · Computer Science 2023-12-14 Jinta Weng , Jiarui Zhang , Yue Hu , Daidong Fa , Xiaofeng Xuand , Heyan Huang

Advances in automated essay scoring (AES) have traditionally relied on labeled essays, requiring tremendous cost and expertise for their acquisition. Recently, large language models (LLMs) have achieved great success in various tasks, but…

Computation and Language · Computer Science 2024-10-07 Sanwoo Lee , Yida Cai , Desong Meng , Ziyang Wang , Yunfang Wu

Over the last few years, large language models (LLMs) have emerged as the most important breakthroughs in natural language processing (NLP) that fundamentally transform research and developments in the field. ChatGPT represents one of the…

Computation and Language · Computer Science 2023-04-13 Viet Dac Lai , Nghia Trung Ngo , Amir Pouran Ben Veyseh , Hieu Man , Franck Dernoncourt , Trung Bui , Thien Huu Nguyen

Time-series forecasting (TSF) finds broad applications in real-world scenarios. Prompting off-the-shelf Large Language Models (LLMs) demonstrates strong zero-shot TSF capabilities while preserving computational efficiency. However, existing…

Computation and Language · Computer Science 2024-02-27 Haoxin Liu , Zhiyuan Zhao , Jindong Wang , Harshavardhan Kamarthi , B. Aditya Prakash

Large Language Models (LLMs) have limited performance when solving arithmetic reasoning tasks and often provide incorrect answers. Unlike natural language understanding, math problems typically have a single correct answer, making the task…

Computation and Language · Computer Science 2023-03-10 Shima Imani , Liang Du , Harsh Shrivastava

In this paper, we demonstrate a surprising capability of large language models (LLMs): given only input feature names and a description of a prediction task, they are capable of selecting the most predictive features, with performance…

Machine Learning · Computer Science 2025-04-21 Daniel P. Jeong , Zachary C. Lipton , Pradeep Ravikumar

Language models built using semi-supervised machine learning on large corpora of natural language have very quickly enveloped the fields of natural language generation and understanding. In this paper we apply a zero-shot approach…

Computation and Language · Computer Science 2022-01-25 Darren Abramson , Ali Emami

Recent work has investigated the capabilities of large language models (LLMs) as zero-shot models for generating individual-level characteristics (e.g., to serve as risk models or augment survey datasets). However, when should a user have…

This article investigates a zero-shot approach to hypernymy prediction using large language models (LLMs). The study employs a method based on text probability calculation, applying it to various generated prompts. The experiments…

Computation and Language · Computer Science 2024-01-10 Mikhail Tikhomirov , Natalia Loukachevitch

Large Language Models (LLMs) have achieved remarkable success recently, displaying exceptional capabilities in creating understandable and organized text. These LLMs have been utilized in diverse fields, such as clinical research, where…

Statistical Finance · Quantitative Finance 2025-01-17 Shuoling Liu , Gaoguo Jia , Yuhang Jiang , Liyuan Chen , Qiang Yang

In this paper, we leverage large language models (LMs) to perform zero-shot text style transfer. We present a prompting method that we call augmented zero-shot learning, which frames style transfer as a sentence rewriting task and requires…

Computation and Language · Computer Science 2022-04-01 Emily Reif , Daphne Ippolito , Ann Yuan , Andy Coenen , Chris Callison-Burch , Jason Wei

In this work, we propose a simple method that applies a large language model (LLM) to large-scale retrieval in zero-shot scenarios. Our method, the Language language model as Retriever (LameR), is built upon no other neural models but an…

Computation and Language · Computer Science 2023-08-03 Tao Shen , Guodong Long , Xiubo Geng , Chongyang Tao , Tianyi Zhou , Daxin Jiang

Despite being introduced only a few years ago, Large Language Models (LLMs) are already widely used by developers for code generation. However, their application in automating other Software Engineering activities remains largely…

Software Engineering · Computer Science 2024-09-27 Aylton Almeida , Laerte Xavier , Marco Tulio Valente

Automated code generation can be a powerful technique for software development, significantly reducing developers' efforts and time required to create new code by generating it automatically based on requirements. Recently, OpenAI's…

Software Engineering · Computer Science 2023-05-16 Chao Liu , Xuanlin Bao , Hongyu Zhang , Neng Zhang , Haibo Hu , Xiaohong Zhang , Meng Yan

There is a growing interest in dataset generation recently due to the superior generative capacity of large pre-trained language models (PLMs). In this paper, we study a flexible and efficient zero-short learning method, \textsc{ZeroGen}.…

Computation and Language · Computer Science 2022-10-25 Jiacheng Ye , Jiahui Gao , Qintong Li , Hang Xu , Jiangtao Feng , Zhiyong Wu , Tao Yu , Lingpeng Kong