English
Related papers

Related papers: LLM4DS: Evaluating Large Language Models for Data …

200 papers

Background: Large Language Models (LLMs) such as ChatGPT and CoPilot are influencing software engineering practice. Software engineering educators must teach future software engineers how to use such tools well. As of yet, there have been…

Software Engineering · Computer Science 2024-04-18 Ben Arie Tanay , Lexy Arinze , Siddhant S. Joshi , Kirsten A. Davis , James C. Davis

Large language models (LLMs) have shown remarkable abilities to generate code, however their ability to develop software for embedded systems, which requires cross-domain knowledge of hardware and software has not been studied. In this…

Software Engineering · Computer Science 2023-11-23 Zachary Englhardt , Richard Li , Dilini Nissanka , Zhihan Zhang , Girish Narayanswamy , Joseph Breda , Xin Liu , Shwetak Patel , Vikram Iyer

This paper explores the use of Large Language Models (LLMs) and in particular ChatGPT in programming, source code analysis, and code generation. LLMs and ChatGPT are built using machine learning and artificial intelligence techniques, and…

Software Engineering · Computer Science 2023-06-12 Ahmed R. Sadik , Antonello Ceravola , Frank Joublin , Jibesh Patra

In recent years, generative AI has undergone major advancements, demonstrating significant promise in augmenting human productivity. Notably, large language models (LLM), with ChatGPT-4 as an example, have drawn considerable attention.…

Human-Computer Interaction · Computer Science 2024-01-23 Sida Peng , Wojciech Swiatek , Allen Gao , Paul Cullivan , Haoge Chang

Pretrained Large Language Models (LLMs) have achieved remarkable success across diverse domains, with education and research emerging as particularly impactful areas. Among current state-of-the-art LLMs, ChatGPT and DeepSeek exhibit strong…

Artificial Intelligence · Computer Science 2025-12-10 Md Mostafizer Rahman , Ariful Islam Shiplu , Md Faizul Ibne Amin , Yutaka Watanobe , Lu Peng

Large Language Models (LLMs) are being increasingly employed in data science for tasks like data preprocessing and analytics. However, data scientists encounter substantial obstacles when conversing with LLM-powered chatbots and acting on…

Human-Computer Interaction · Computer Science 2023-10-26 Bhavya Chopra , Ananya Singha , Anna Fariha , Sumit Gulwani , Chris Parnin , Ashish Tiwari , Austin Z. Henley

With the increasing adoption of AI-driven tools in software development, large language models (LLMs) have become essential for tasks like code generation, bug fixing, and optimization. Tools like ChatGPT, GitHub Copilot, and Codeium…

Software Engineering · Computer Science 2024-10-01 Md Sultanul Islam Ovi , Nafisa Anjum , Tasmina Haque Bithe , Md. Mahabubur Rahman , Mst. Shahnaj Akter Smrity

Large Language Models (LLMs) have gained significant attention in the software engineering community. Nowadays developers have the possibility to exploit these models through industrial-grade tools providing a handy interface toward LLMs,…

Software Engineering · Computer Science 2024-02-27 Rosalia Tufano , Antonio Mastropaolo , Federica Pepe , Ozren Dabić , Massimiliano Di Penta , Gabriele Bavota

Generative AI including large language models (LLMs) has recently gained significant interest in the geo-science community through its versatile task-solving capabilities including programming, arithmetic reasoning, generation of sample…

Computers and Society · Computer Science 2024-08-14 Hartwig H. Hochmair , Levente Juhasz , Takoda Kemp

Introduction: Large language models (LLMs) can process requests and generate texts, but their feasibility for assessing complex academic content needs further investigation. To explore LLM's potential in assisting scientific review, this…

Computation and Language · Computer Science 2026-01-29 Yinuo Liu , Emre Sezgin , Eric A. Youngstrom

This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a…

Computation and Language · Computer Science 2024-01-25 Jie Tian , Jixin Hou , Zihao Wu , Peng Shu , Zhengliang Liu , Yujie Xiang , Beikang Gu , Nicholas Filla , Yiwei Li , Ning Liu , Xianyan Chen , Keke Tang , Tianming Liu , Xianqiao Wang

Researchers have made notable progress in applying Large Language Models (LLMs) to solve math problems, as demonstrated through efforts like GSM8k, ProofNet, AlphaGeometry, and MathOdyssey. This progress has sparked interest in their…

Human-Computer Interaction · Computer Science 2025-03-24 Adit Gupta , Jennifer Reddig , Tommaso Calo , Daniel Weitekamp , Christopher J. MacLellan

Large language models (LLMs), such as ChatGPT, have received substantial attention due to their capabilities for understanding and generating human language. While there has been a burgeoning trend in research focusing on the employment of…

Large Language Models (LLMs) have drawn a lot of attention due to their strong performance on a wide range of natural language tasks, since the release of ChatGPT in November 2022. LLMs' ability of general-purpose language understanding and…

Computation and Language · Computer Science 2025-03-25 Shervin Minaee , Tomas Mikolov , Narjes Nikzad , Meysam Chenaghlu , Richard Socher , Xavier Amatriain , Jianfeng Gao

Qualitative analysis of textual contents unpacks rich and valuable information by assigning labels to the data. However, this process is often labor-intensive, particularly when working with large datasets. While recent AI-based tools…

Computation and Language · Computer Science 2023-04-24 Ziang Xiao , Xingdi Yuan , Q. Vera Liao , Rania Abdelghani , Pierre-Yves Oudeyer

Recent research has explored the creation of questions from code submitted by students. These Questions about Learners' Code (QLCs) are created through program analysis, exploring execution paths, and then creating code comprehension…

Computers and Society · Computer Science 2024-04-19 Teemu Lehtinen , Charles Koutcheme , Arto Hellas

This study investigates the efficacy of large language models (LLMs) as tools for grading master-level student essays. Utilizing a sample of 60 essays in political science, the study compares the accuracy of grades suggested by the GPT-4…

General Economics · Economics 2024-06-25 Magnus Lundgren

The dream of achieving a student-teacher ratio of 1:1 is closer than ever thanks to the emergence of large language models (LLMs). One potential application of these models in the educational field would be to provide feedback to students…

Computers and Society · Computer Science 2025-05-06 Marc Ballestero-Ribó , Daniel Ortiz-Martínez

Large Language Models (LLMs), such as GitHub Copilot and ChatGPT have become popular among programming students. Students use LLMs to assist them in programming courses, including generating source code. Previous work has evaluated the…

Artificial Intelligence · Computer Science 2025-04-22 Emir Catir , Robin Claesson , Rodothea Myrsini Tsoupidi

Large Language Models (LLMs) represent a leap in artificial intelligence, excelling in tasks using human language(s). Although the main focus of general-purpose LLMs is not code generation, they have shown promising results in the domain.…

Software Engineering · Computer Science 2024-01-30 Sanka Rasnayaka , Guanlin Wang , Ridwan Shariffdeen , Ganesh Neelakanta Iyer