English
Related papers

Related papers: Prompt Engineering for Scale Development in Genera…

200 papers

While Large Language Models (LLMs) have emerged as promising tools for evaluating Natural Language Generation (NLG) tasks, their effectiveness is limited by their inability to appropriately weigh the importance of different topics, often…

Computation and Language · Computer Science 2025-02-20 Wenwen Xie , Gray Gwizdz , Dongji Feng

Large Language Models (LLMs) have rapidly transformed software development, especially in code generation. However, their inconsistent performance, prone to hallucinations and quality issues, complicates program comprehension and hinders…

Software Engineering · Computer Science 2025-04-21 Antonio Della Porta , Stefano Lambiase , Fabio Palomba

We evaluate large language models (LLMs) for automatic personality prediction from text under the binary Five Factor Model (BIG5). Five models -- including GPT-4 and lightweight open-source alternatives -- are tested across three…

Computation and Language · Computer Science 2025-12-01 Francesco Di Cursi , Chiara Boldrini , Marco Conti , Andrea Passarella

Large Language Models (LLMs) have become integral to a wide spectrum of applications, ranging from traditional computing tasks to advanced artificial intelligence (AI) applications. This widespread adoption has spurred extensive research…

Computation and Language · Computer Science 2024-05-14 Xu Wang , Cheng Li , Yi Chang , Jindong Wang , Yuan Wu

Large language models (LLMs) have shown remarkable performance on many different Natural Language Processing (NLP) tasks. Prompt engineering plays a key role in adding more to the already existing abilities of LLMs to achieve significant…

Computation and Language · Computer Science 2024-07-25 Shubham Vatsal , Harsh Dubey

This paper investigates how prompt engineering techniques impact both accuracy and confidence elicitation in Large Language Models (LLMs) applied to medical contexts. Using a stratified dataset of Persian board exam questions across…

Computers and Society · Computer Science 2025-06-03 Nariman Naderi , Zahra Atf , Peter R Lewis , Aref Mahjoub far , Seyed Amir Ahmad Safavi-Naini , Ali Soroush

Requirements classification assigns natural language requirements to predefined classes, such as functional and non functional. Accurate classification reduces risk and improves software quality. Most existing models rely on supervised…

Software Engineering · Computer Science 2025-09-18 Manal Binkhonain , Reem Alfayaz

This study critically evaluates the efficacy of prompting methods in enhancing the mathematical reasoning capability of large language models (LLMs). The investigation uses three prescriptive prompting methods - simple, persona, and…

Recent advancements in artificial intelligence (AI) and machine learning have reignited interest in their impact on Computer-based Learning (CBL). AI-driven tools like ChatGPT and Intelligent Tutoring Systems (ITS) have enhanced learning…

Computers and Society · Computer Science 2025-05-07 Mohsen Balavar , Wenli Yang , David Herbert , Soonja Yeom

Large Language Models (LLMs) have significantly enhanced Information Retrieval (IR) across various modules, such as reranking. Despite impressive performance, current zero-shot relevance ranking with LLMs heavily relies on human prompt…

Artificial Intelligence · Computer Science 2025-05-21 Can Jin , Hongwu Peng , Shiyu Zhao , Zhenting Wang , Wujiang Xu , Ligong Han , Jiahui Zhao , Kai Zhong , Sanguthevar Rajasekaran , Dimitris N. Metaxas

Prompt engineering is essential for optimizing large language models (LLMs), yet the link between prompt structures and task performance remains underexplored. This work introduces an evolutionary approach that combines context-free grammar…

Computation and Language · Computer Science 2025-04-22 Gabriel Machado Santos , Rita Maria da Silva Julia , Marcelo Zanchetta do Nascimento

In recent years, Large Language Models (LLMs) have demonstrated remarkable proficiency in comprehending and generating natural language, with a growing prevalence in the domain of recommendation systems. However, LLMs still face a…

Information Retrieval · Computer Science 2024-12-13 Xinyu Li , Chuang Zhao , Hongke Zhao , Likang Wu , Ming HE

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding, reasoning, and problem-solving across various domains. However, their ability to perform complex, multi-step reasoning task-essential…

This case study investigates the task of job classification in a real-world setting, where the goal is to determine whether an English-language job posting is appropriate for a graduate or entry-level position. We explore multiple…

Computation and Language · Computer Science 2023-04-19 Benjamin Clavié , Alexandru Ciceu , Frederick Naylor , Guillaume Soulié , Thomas Brightwell

Prompting techniques have significantly enhanced the capabilities of Large Language Models (LLMs) across various complex tasks, including reasoning, planning, and solving math word problems. However, most research has predominantly focused…

Computation and Language · Computer Science 2024-05-24 Neisarg Dave , Daniel Kifer , C. Lee Giles , Ankur Mali

Large Language Models (LLMs) are demonstrating remarkable human like capabilities across diverse domains, including psychological assessment. This study evaluates whether LLMs, specifically GPT-4o and GPT-4o mini, can infer Big Five…

Computation and Language · Computer Science 2025-01-14 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

Large language models (LLMs) underpin applications in code generation, mathematical reasoning, and agent-based workflows. In practice, systems access LLMs via commercial APIs or open-source deployments, and the model landscape (e.g., GPT,…

Computation and Language · Computer Science 2025-12-02 Yaxuan Wang , Quan Liu , Zhenting Wang , Zichao Li , Wei Wei , Yang Liu , Yujia Bao

In recent years, Large Language Models have garnered significant attention for their strong performance in various natural language tasks, such as machine translation and question answering. These models demonstrate an impressive ability to…

Computation and Language · Computer Science 2025-02-21 Qibang Liu , Wenzhe Wang , Jeffrey Willard

The growing integration of AI tools in software development, particularly Large Language Models (LLMs) such as ChatGPT, has revolutionized how developers approach coding tasks. However, achieving high-quality code often requires iterative…

Software Engineering · Computer Science 2025-06-03 Sophia DiCuffa , Amanda Zambrana , Priyanshi Yadav , Sashidhar Madiraju , Khushi Suman , Eman Abdullah AlOmar

Prompt engineering, particularly Chain-of-Thought (CoT) prompting, significantly enhances LLM reasoning capabilities. We introduce "Sculpting," a constrained, rule-based prompting method designed to improve upon standard CoT by reducing…

Computation and Language · Computer Science 2025-10-28 Imran Khan