English
Related papers

Related papers: LLMs and Stack Overflow Discussions: Reliability, …

200 papers

Recent research has explored the creation of questions from code submitted by students. These Questions about Learners' Code (QLCs) are created through program analysis, exploring execution paths, and then creating code comprehension…

Computers and Society · Computer Science 2024-04-19 Teemu Lehtinen , Charles Koutcheme , Arto Hellas

The widespread adoption of conversational LLMs for software development has raised new security concerns regarding the safety of LLM-generated content. Our motivational study outlines ChatGPT's potential in volunteering context-specific…

Software Engineering · Computer Science 2025-04-07 Amirali Sajadi , Binh Le , Anh Nguyen , Kostadin Damevski , Preetha Chatterjee

In recent years, large language models (LLMs) have emerged as powerful tools with potential applications in various fields, including software engineering. Within the scope of this research, we evaluate five different state-of-the-art LLMs…

Computation and Language · Computer Science 2024-09-09 Luis Mayer , Christian Heumann , Matthias Aßenmacher

Since the launch of ChatGPT, a powerful AI Chatbot developed by OpenAI, large language models (LLMs) have made significant advancements in both academia and industry, bringing about a fundamental engineering paradigm shift in many areas.…

Software Engineering · Computer Science 2023-11-22 Xiaoxia Liu , Jingyi Wang , Jun Sun , Xiaohan Yuan , Guoliang Dong , Peng Di , Wenhai Wang , Dongxia Wang

Artificial Intelligence (AI) advancements have enabled the development of Large Language Models (LLMs) that can perform a variety of tasks with remarkable semantic understanding and accuracy. ChatGPT is one such LLM that has gained…

Software Engineering · Computer Science 2024-08-02 M. Mehdi Kholoosi , M. Ali Babar , Roland Croft

The universal availability of ChatGPT and other similar tools since late 2022 has prompted tremendous public excitement and experimental effort about the potential of large language models (LLMs) to improve learning experience and outcomes,…

Computers and Society · Computer Science 2024-11-05 Renzhe Yu , Zhen Xu , Sky CH-Wang , Richard Arum

The widespread availability of large language models (LLMs) has changed how students engage with coding and problem-solving. While these tools may increase student productivity, they also make it more difficult for instructors to assess…

Software Engineering · Computer Science 2026-01-23 Yufan Zhang , Jaromir Savelka , Seth Copen Goldstein , Michael Conway

Large Language Models (LLMs) and AI assistants driven by these models are experiencing exponential growth in usage among both expert and amateur users. In this work, we focus on evaluating the reliability of current LLMs as science…

Computation and Language · Computer Science 2024-09-24 Prasoon Bajpai , Niladri Chatterjee , Subhabrata Dutta , Tanmoy Chakraborty

The proliferation of Large Language Models (LLMs), such as ChatGPT, has raised concerns about their potential impact on academic integrity, prompting the need for LLM-resistant exam designs. This article investigates the performance of LLMs…

Computation and Language · Computer Science 2023-04-25 Simon kaare Larsen

Large language model (LLM) applications, such as ChatGPT, are a powerful tool for online information-seeking (IS) and problem-solving tasks. However, users still face challenges initializing and refining prompts, and their cognitive…

Human-Computer Interaction · Computer Science 2024-02-12 Ben Wang , Jiqun Liu , Jamshed Karimnazarov , Nicolas Thompson

With the introduction of ChatGPT, Large Language Models (LLMs) have received enormous attention in healthcare. Despite their potential benefits, researchers have underscored various ethical implications. While individual instances have…

Computers and Society · Computer Science 2024-07-09 Joschka Haltaufderheide , Robert Ranisch

With the advancement of Large Language Models (LLMs), their application in Software Quality Assurance (SQA) has increased. However, the current focus of these applications is predominantly on ChatGPT. There remains a gap in understanding…

Software Engineering · Computer Science 2024-09-04 Ratnadira Widyasari , David Lo , Lizi Liao

The recent success of large language models (LLMs) has shown great potential to develop more powerful conversational recommender systems (CRSs), which rely on natural language conversations to satisfy user needs. In this paper, we embark on…

Computation and Language · Computer Science 2024-06-21 Xiaolei Wang , Xinyu Tang , Wayne Xin Zhao , Jingyuan Wang , Ji-Rong Wen

Large language models LLMs like ChatGPT have reached the 100 Mio user barrier in record time and might increasingly enter all areas of our life leading to a diverse set of interactions between those Artificial Intelligence models and…

Computation and Language · Computer Science 2024-11-25 Johannes Schneider , Steffi Haag , Leona Chandra Kruse

Large Language Models (LLMs) such as ChatGPT and its competitors have caused a revolution in natural language processing, but their capabilities also introduce new security vulnerabilities. This survey provides a comprehensive overview of…

Cryptography and Security · Computer Science 2025-08-26 Miles Q. Li , Benjamin C. M. Fung

The use of large language models (LLMs) in scholarly publications has grown dramatically since the launch of ChatGPT in late 2022. This usage is often undisclosed, and it can be challenging for readers and reviewers to identify human…

Digital Libraries · Computer Science 2025-12-02 Andrew Gray

Recent development of large language models (LLMs), such as ChatGPT has been widely applied to a wide range of software engineering tasks. Many papers have reported their analysis on the potential advantages and limitations of ChatGPT for…

Software Engineering · Computer Science 2023-09-18 Priyanka Mudgal , Rita Wouhaybi

Interest in Large Language Models (LLMs) has increased drastically since the emergence of ChatGPT and the outstanding positive societal response to the ease with which it performs tasks in Natural Language Processing (NLP). The triumph of…

Computation and Language · Computer Science 2023-04-06 Oluwatosin Ogundare , Gustavo Quiros Araya

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

Large language models (LLMs) such as ChatGPT can produce coherent, cohesive, relevant, and fluent answers for various natural language processing (NLP) tasks. Taking document-level machine translation (MT) as a testbed, this paper provides…

Computation and Language · Computer Science 2023-10-25 Longyue Wang , Chenyang Lyu , Tianbo Ji , Zhirui Zhang , Dian Yu , Shuming Shi , Zhaopeng Tu