English
Related papers

Related papers: PromptPilot: Improving Human-AI Collaboration Thro…

200 papers

The performance of Large Language Models (LLMs) in reasoning tasks depends heavily on prompt design, with Chain-of-Thought (CoT) and self-consistency being critical methods that enhance this ability. However, these methods do not fully…

Computation and Language · Computer Science 2024-10-08 Chuanyang Zheng , Zhengying Liu , Enze Xie , Zhenguo Li , Yu Li

Large language models (LLMs) have demonstrated increasingly sophisticated performance in medical and other fields of knowledge. Traditional methods of creating specialist LLMs require extensive fine-tuning and training of models on large…

Computation and Language · Computer Science 2025-02-25 Sean Wu , Michael Koo , Fabien Scalzo , Ira Kurtz

Recent advances in Large Language Models have led to remarkable achievements across a variety of Natural Language Processing tasks, making prompt engineering increasingly central to guiding model outputs. While manual methods can be…

Computation and Language · Computer Science 2025-07-15 Wendi Cui , Zhuohang Li , Hao Sun , Damien Lopez , Kamalika Das , Bradley A. Malin , Sricharan Kumar , Jiaxin Zhang

Prompt engineering has proven to be a crucial step in leveraging pretrained large language models (LLMs) in solving various real-world tasks. Numerous solutions have been proposed that seek to automate prompt engineering by using the model…

As generative AI systems rapidly improve, a key question emerges: how do users adapt to these changes, and when does such adaptation matter for realizing performance gains? Drawing on theories of dynamic capabilities and IT complements, we…

Human-Computer Interaction · Computer Science 2026-01-08 Eaman Jahani , Benjamin S. Manning , Joe Zhang , Hong-Yi TuYe , Mohammed Alsobay , Christos Nicolaides , Siddharth Suri , David Holtz

Prompt engineering is very important to enhance the performance of large language models (LLMs). When dealing with complex issues, prompt engineers tend to distill multiple patterns from examples and inject relevant solutions to optimize…

Computation and Language · Computer Science 2024-10-14 Sheng Yang , Yurong Wu , Yan Gao , Zineng Zhou , Bin Benjamin Zhu , Xiaodi Sun , Jian-Guang Lou , Zhiming Ding , Anbang Hu , Yuan Fang , Yunsong Li , Junyan Chen , Linjun Yang

The alignment of large language models (LLMs) with human values is critical as these models become increasingly integrated into various societal and decision-making processes. Traditional methods, such as reinforcement learning from human…

Machine Learning · Computer Science 2025-01-08 Prashant Trivedi , Souradip Chakraborty , Avinash Reddy , Vaneet Aggarwal , Amrit Singh Bedi , George K. Atia

Although large language models (LLMs) have demonstrated impressive potential on simple tasks, their breadth of scope, lack of transparency, and insufficient controllability can make them less effective when assisting humans on more complex…

Human-Computer Interaction · Computer Science 2022-03-21 Tongshuang Wu , Michael Terry , Carrie J. Cai

The integration of Large Language Models (LLMs) into Development Environments (IDEs) has become a focal point in modern software development. LLMs such as OpenAI GPT-3.5/4 and Code Llama offer the potential to significantly augment…

This study compares the design practices and performance of ChatGPT 4.0, a large language model (LLM), against graduate engineering students in a 48-hour prototyping hackathon, based on a dataset comprising more than 100 prototypes. The LLM…

Human-Computer Interaction · Computer Science 2025-03-04 Daniel Nygård Ege , Henrik H. Øvrebø , Vegar Stubberud , Martin Francis Berg , Christer Elverum , Martin Steinert , Håvard Vestad

This Monte Carlo simulation examines how prompt engineering strategies shape the quality of large language model (LLM)--generated personality assessment items within the AI-GENIE framework for generative psychometrics. Item pools targeting…

Artificial Intelligence · Computer Science 2026-03-18 Lara Lee Russell-Lasalandra , Hudson Golino

Large Language Models (LLMs) have become an integral part of many real-world workflows. However, LLMs consume a lot of energy, which becomes a large concern in the scale of the demand for these tools. As LLMs become integrated into…

Software Engineering · Computer Science 2026-05-01 Katelyn Crumpacker , Dimitrios Nikolopoulos

Large language models (LLMs) are increasingly capable and prevalent, and can be used to produce creative content. The quality of content is influenced by the prompt used, with more specific prompts that incorporate examples generally…

Computation and Language · Computer Science 2023-08-28 Samuel Rhys Cox , Ashraf Abdul , Wei Tsang Ooi

Large language model performance can be improved in a large number of ways. Many such techniques, like fine-tuning or advanced tool usage, are time-intensive and expensive. Although prompt engineering is significantly cheaper and often…

Computation and Language · Computer Science 2025-06-03 Philipp Schoenegger , Cameron R. Jones , Philip E. Tetlock , Barbara Mellers

As large language models (LLMs) have progressed towards more human-like and human--AI communications have become prevalent, prompting has emerged as a decisive component. However, there is limited conceptual consensus on what exactly…

Computation and Language · Computer Science 2025-06-10 Do Xuan Long , Duy Dinh , Ngoc-Hai Nguyen , Kenji Kawaguchi , Nancy F. Chen , Shafiq Joty , Min-Yen Kan

Difficult decision-making problems abound in various disciplines and domains. The proliferation of generative techniques, especially large language models (LLMs), has excited interest in using them for decision support. However, LLMs cannot…

Artificial Intelligence · Computer Science 2025-09-16 Boris Kovalerchuk , Brent D. Fegley

Large Language Models (LLMs) often generate substantively relevant content but fail to adhere to formal constraints, leading to outputs that are conceptually correct but procedurally flawed. Traditional prompt refinement approaches focus on…

Artificial Intelligence · Computer Science 2026-01-08 Alberto Purpura , Li Wang , Sahil Badyal , Eugenio Beaufrand , Adam Faulkner

Prompting serves as the major way humans interact with Large Language Models (LLM). Commercial AI systems commonly define the role of the LLM in system prompts. For example, ChatGPT uses ``You are a helpful assistant'' as part of its…

Computation and Language · Computer Science 2024-10-10 Mingqian Zheng , Jiaxin Pei , Lajanugen Logeswaran , Moontae Lee , David Jurgens

Background: Large Language Models (LLMs) such as ChatGPT and CoPilot are influencing software engineering practice. Software engineering educators must teach future software engineers how to use such tools well. As of yet, there have been…

Software Engineering · Computer Science 2024-04-18 Ben Arie Tanay , Lexy Arinze , Siddhant S. Joshi , Kirsten A. Davis , James C. Davis

The development of large language models (LLMs) capable of following instructions and engaging in conversational interactions sparked increased interest in their utilization across various support tools. We investigate the utility of modern…

Human-Computer Interaction · Computer Science 2024-01-31 Tuhin Chakrabarty , Vishakh Padmakumar , Faeze Brahman , Smaranda Muresan