English
Related papers

Related papers: Evaluating LLM-Based Goal Extraction in Requiremen…

200 papers

Prompt engineering for large language models (LLMs) is often a manual time-intensive process that involves generating, evaluating, and refining prompts iteratively to ensure high-quality outputs. While there has been work on automating…

Computation and Language · Computer Science 2024-07-19 Derek Austin , Elliott Chartock

Large language models (LLMs) have revolutionized zero-shot task performance, mitigating the need for task-specific annotations while enhancing task generalizability. Despite its advancements, current methods using trigger phrases such as…

Computation and Language · Computer Science 2024-06-13 Saurabh Srivastava , Chengyue Huang , Weiguo Fan , Ziyu Yao

Keyphrases are the essential topical phrases that summarize a document. Keyphrase generation is a long-standing NLP task for automatically generating keyphrases for a given document. While the task has been comprehensively explored in the…

Computation and Language · Computer Science 2025-03-04 Jayanth Mohan , Jishnu Ray Chowdhury , Tomas Malik , Cornelia Caragea

Large Language Models (LLMs) are the cornerstone in automating Requirements Engineering (RE) tasks, underpinning recent advancements in the field. Their pre-trained comprehension of natural language is pivotal for effectively tailoring them…

Software Engineering · Computer Science 2024-05-16 Andreas Vogelsang , Jannik Fischbach

Recently, various illustrative examples have shown the impressive ability of generative large language models (LLMs) to perform NLP related tasks. ChatGPT undoubtedly is the most representative model. We empirically evaluate ChatGPT's…

Software Engineering · Computer Science 2023-07-20 Jianzhang Zhang , Yiyang Chen , Nan Niu , Yinglin Wang , Chuang Liu

Producing large volumes of high-quality, timely feedback poses significant challenges to instructors. To address this issue, automation technologies-particularly Large Language Models (LLMs)-show great potential. However, current LLM-based…

Human-Computer Interaction · Computer Science 2025-05-09 Jie Cao , Chloe Qianhui Zhao , Xian Chen , Shuman Wang , Christian Schunn , Kenneth R. Koedinger , Jionghao Lin

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks and exhibited impressive reasoning abilities by applying zero-shot Chain-of-Thought (CoT) prompting. However, due to the evolving nature of sentence…

Computation and Language · Computer Science 2024-02-09 Feihu Jin , Yifan Liu , Ying Tan

Biomedical named entity recognition (NER) is a high-utility natural language processing (NLP) task, and large language models (LLMs) show promise particularly in few-shot settings (i.e., limited training data). In this article, we address…

Computation and Language · Computer Science 2025-08-12 Yao Ge , Sudeshna Das , Yuting Guo , Abeed Sarker

Recommender systems utilizing explicit feedback have witnessed significant advancements and widespread applications over the past years. However, generating recommendations in few-shot scenarios remains a persistent challenge. Recently,…

Information Retrieval · Computer Science 2023-12-22 Zhoumeng Wang

We address the detection of emission reduction goals in corporate reports, an important task for monitoring companies' progress in addressing climate change. Specifically, we focus on the issue of integrating expert feedback in the form of…

Machine Learning · Computer Science 2025-07-02 Marco Wrzalik , Adrian Ulges , Anne Uersfeld , Florian Faust , Viola Campos

Code generation is to automatically generate source code conforming to a given programming specification, which has received extensive attention especially with the development of large language models (LLMs). Due to the inherent difficulty…

Software Engineering · Computer Science 2024-12-20 Zhao Tian , Junjie Chen , Xiangyu Zhang

Large language models (LLMs) produce context inconsistency hallucinations, which are LLM generated outputs that are misaligned with the user prompt. This research project investigates whether prompt engineering (PE) methods can mitigate…

Computation and Language · Computer Science 2025-12-19 Imane Jaaouine , Ross D. King

The majority of research around Large Language Models (LLM) application to software development has been on the subject of code generation. There is little literature on LLMs' impact on requirements engineering (RE), which deals with the…

Software Engineering · Computer Science 2025-02-05 Cory Hymel , Hiroe Johnson

Recommending suitable jobs to users is a critical task in online recruitment platforms, as it can enhance users' satisfaction and the platforms' profitability. While existing job recommendation methods encounter challenges such as the low…

Information Retrieval · Computer Science 2023-07-21 Yingpeng Du , Di Luo , Rui Yan , Hongzhi Liu , Yang Song , Hengshu Zhu , Jie Zhang

Pretrained large language models (LLMs) are widely used in many sub-fields of natural language processing (NLP) and generally known as excellent few-shot learners with task-specific exemplars. Notably, chain of thought (CoT) prompting, a…

Computation and Language · Computer Science 2023-01-31 Takeshi Kojima , Shixiang Shane Gu , Machel Reid , Yutaka Matsuo , Yusuke Iwasawa

The advent of large language models (LLMs) has significantly advanced the field of code translation, enabling automated translation between programming languages. However, these models often struggle with complex translation tasks due to…

Artificial Intelligence · Computer Science 2024-07-30 Manish Bhattarai , Javier E. Santos , Shawn Jones , Ayan Biswas , Boian Alexandrov , Daniel O'Malley

Large Language Models (LLMs) have shown their ability to improve the performance of speech recognizers by effectively rescoring the n-best hypotheses generated during the beam search process. However, the best way to exploit recent…

Computation and Language · Computer Science 2024-09-10 Ada Defne Tur , Adel Moumen , Mirco Ravanelli

Large Language Models (LLMs) are increasingly used to generate synthetic textual data for training smaller specialized models. However, a comparison of various generation strategies for low-resource language settings is lacking. While…

Computation and Language · Computer Science 2025-09-22 Tatiana Anikina , Jan Cegin , Jakub Simko , Simon Ostermann

Currently, generating high-level test cases described in natural language from requirement documents is performed manually. In the industry, including companies specializing in software testing, there is a significant demand for the…

Software Engineering · Computer Science 2025-10-07 Satoshi Masuda , Satoshi Kouzawa , Kyousuke Sezai , Hidetoshi Suhara , Yasuaki Hiruta , Kunihiro Kudou

Large language models (LLMs) like ChatGPT and GPT-4 have attracted great attention given their surprising performance on a wide range of NLP tasks. Length controlled generation of LLMs emerges as an important topic, which enables users to…

Computation and Language · Computer Science 2023-10-03 Renlong Jie , Xiaojun Meng , Lifeng Shang , Xin Jiang , Qun Liu