English
Related papers

Related papers: Prompt Problems: A New Programming Exercise for th…

200 papers

Large language models (LLMs) achieve promising results in code generation based on a given natural language description. They have been integrated into open-source projects and commercial products to facilitate daily coding activities. The…

Software Engineering · Computer Science 2024-07-01 Junkai Chen , Zhenhao Li , Xing Hu , Xin Xia

Due to rapid advancements in the development of Large Language Models (LLMs), programming these models with prompts has recently gained significant attention. However, the sheer number of available prompt engineering techniques creates an…

Computation and Language · Computer Science 2024-02-26 Oluwole Fagbohun , Rachel M. Harrison , Anton Dereventsov

Large Language Models (LLMs) have significantly advanced software engineering (SE) tasks, with prompt engineering techniques enhancing their performance in code-related areas. However, the rapid development of foundational LLMs such as the…

Software Engineering · Computer Science 2024-11-05 Guoqing Wang , Zeyu Sun , Zhihao Gong , Sixiang Ye , Yizhou Chen , Yifan Zhao , Qingyuan Liang , Dan Hao

Large Language Models (LLMs) have shown great ability in solving traditional natural language tasks and elementary reasoning tasks with appropriate prompting techniques. However, their ability is still limited in solving complicated science…

Computation and Language · Computer Science 2024-04-30 Pei Chen , Boran Han , Shuai Zhang

(Source) code summarization is the task of automatically generating natural language summaries (also called comments) for given code snippets. Recently, with the successful application of large language models (LLMs) in numerous fields,…

Software Engineering · Computer Science 2024-12-10 Tingting Xu , Yun Miao , Chunrong Fang , Hanwei Qian , Xia Feng , Zhenpeng Chen , Chong Wang , Jian Zhang , Weisong Sun , Zhenyu Chen , Yang Liu

Large language models (LLMs) have demonstrated impressive performance across a wide range of Natural Language Processing (NLP) tasks. However, ensuring their effectiveness across multiple languages presents unique challenges. Multilingual…

Computation and Language · Computer Science 2025-05-20 Shubham Vatsal , Harsh Dubey , Aditi Singh

The field of prompt engineering is becoming an essential phenomenon in artificial intelligence. It is altering how data scientists interact with large language models (LLMs) for analytics applications. This research paper shares empirical…

Digital Libraries · Computer Science 2026-02-03 Snehasish Paul , Rohit Kumar , Laxman Das

Recent surge in Large Language Model (LLM) availability has opened exciting avenues for research. However, efficiently interacting with these models presents a significant hurdle since LLMs often reside on proprietary or self-hosted API…

GitHub Copilot is an artificial intelligence model for automatically generating source code from natural language problem descriptions. Since June 2022, Copilot has officially been available for free to all students as a plug-in to…

Human-Computer Interaction · Computer Science 2022-10-28 Paul Denny , Viraj Kumar , Nasser Giacaman

Large language models (LLMs) have demonstrated remarkable potential in natural language understanding and generation, making them valuable tools for enhancing conversational interactions. However, LLMs encounter challenges such as lacking…

Human-Computer Interaction · Computer Science 2023-11-10 Guinan Su , Yanwu Yang , Jie Guo

Computing educators and researchers have used programming process data to understand how programs are constructed and what sorts of problems students struggle with. Although such data shows promise for using it for feedback, fully automated…

Computers and Society · Computer Science 2024-11-04 John Edwards , Arto Hellas , Juho Leinonen

The rapid evolution of artificial intelligence (AI), specifically large language models (LLMs), has opened opportunities for various educational applications. This paper explored the feasibility of utilizing ChatGPT, one of the most popular…

Human-Computer Interaction · Computer Science 2023-12-20 Zhengdong Zhang , Zihan Dong , Yang Shi , Noboru Matsuda , Thomas Price , Dongkuan Xu

Large language models (LLMs) are evolving from conversational systems into strong reasoners for tasks such as Olympiad mathematics and competitive programming. While scaling parameters and test-time computation has driven progress, a key…

Machine Learning · Computer Science 2025-09-25 Xueliang Zhao , Wei Wu , Jian Guan , Zhuocheng Gong , Lingpeng Kong

The use of large language model (LLM)-powered chatbots, such as ChatGPT, has become popular across various domains, supporting a range of tasks and processes. However, due to the intrinsic complexity of LLMs, effective prompting is more…

In robot task planning, large language models (LLMs) have shown significant promise in generating complex and long-horizon action sequences. However, it is observed that LLMs often produce responses that sound plausible but are not…

Robotics · Computer Science 2025-03-11 Jiho Lee , Hayun Lee , Jonghyeon Kim , Kyungjae Lee , Eunwoo Kim

This research investigates prompt designs of evaluating generated texts using large language models (LLMs). While LLMs are increasingly used for scoring various inputs, creating effective prompts for open-ended text evaluation remains…

Computation and Language · Computer Science 2024-06-28 KuanChao Chu , Yi-Pei Chen , Hideki Nakayama

The rapid development of large language models is transforming software development. Beyond serving as code auto-completion tools in integrated development environments, large language models increasingly function as foundation models…

Software Engineering · Computer Science 2026-01-26 Junjie Shi , Weisong Sun , Zhenpeng Chen , Zhujun Wu , Xiaohong Chen , Zhi Jin , Yang Liu

While Chain of Thought (CoT) prompting approaches have significantly consolidated the reasoning capabilities of large language models (LLMs), they still face limitations that require extensive human effort or have performance needs to be…

Computation and Language · Computer Science 2025-06-02 Kangyang Luo , Zichen Ding , Zhenmin Weng , Lingfeng Qiao , Meng Zhao , Xiang Li , Di Yin , Jinlong Shu

Crafting effective prompts for code generation or editing with Large Language Models (LLMs) is not an easy task. Particularly, the absence of immediate, stable feedback during prompt crafting hinders effective interaction, as users are left…

Human-Computer Interaction · Computer Science 2024-05-14 Chen Zhu-Tian , Zeyu Xiong , Xiaoshuo Yao , Elena Glassman

Large Language models (LLMs) have emerged as powerful tools for addressing challenges across diverse domains. Notably, recent studies have demonstrated that large language models significantly enhance the efficiency of biomolecular analysis…

Computation and Language · Computer Science 2025-03-07 Jiyue Jiang , Zikang Wang , Yuheng Shan , Heyan Chai , Jiayi Li , Zixian Ma , Xinrui Zhang , Yu Li