English
Related papers

Related papers: Large Language Models in Introductory Programming …

200 papers

Recently, large language models (LLM) based generative AI has been gaining momentum for their impressive high-quality performances in multiple domains, particularly after the release of the ChatGPT. Many believe that they have the potential…

Software Engineering · Computer Science 2024-02-22 Wei Wang , Huilong Ning , Gaowei Zhang , Libo Liu , Yi Wang

Large Language Models (LLMs) have demonstrated remarkable performance on a wide range of Natural Language Processing (NLP) tasks, often matching or even beating state-of-the-art task-specific models. This study aims at assessing the…

Computation and Language · Computer Science 2023-10-16 Ethan Callanan , Amarachi Mbakwe , Antony Papadimitriou , Yulong Pei , Mathieu Sibue , Xiaodan Zhu , Zhiqiang Ma , Xiaomo Liu , Sameena Shah

Instruction-tuned Large Language Models (LLMs) have exhibited impressive language understanding and the capacity to generate responses that follow specific prompts. However, due to the computational demands associated with training these…

Computation and Language · Computer Science 2024-03-26 Yida Mu , Ben P. Wu , William Thorne , Ambrose Robinson , Nikolaos Aletras , Carolina Scarton , Kalina Bontcheva , Xingyi Song

Purpose: The performance of three different large language models (LLMS) (GPT-3.5, GPT-4, and PaLM2) in answering ophthalmology professional questions was evaluated and compared with that of three different professional populations (medical…

Computation and Language · Computer Science 2023-11-10 Jason Holmes , Shuyuan Ye , Yiwei Li , Shi-Nan Wu , Zhengliang Liu , Zihao Wu , Jinyu Hu , Huan Zhao , Xi Jiang , Wei Liu , Hong Wei , Jie Zou , Tianming Liu , Yi Shao

Large Language Models (LLMs) offer numerous applications, the full extent of which is not yet understood. This paper investigates if LLMs can be applied for editing structured and semi-structured documents with minimal effort. Using a…

Machine Learning · Computer Science 2024-09-16 Irene Weber

Large language models (LLMs) have demonstrated unparalleled prowess in mimicking human-like text generation and processing. Among the myriad of applications that benefit from LLMs, automated code generation is increasingly promising. The…

Software Engineering · Computer Science 2023-11-15 Lincoln Murr , Morgan Grainger , David Gao

Although several methods were proposed to address the problem of automated essay scoring (AES) in the last 50 years, there is still much to desire in terms of effectiveness. Large Language Models (LLMs) are transformer-based models that…

Computation and Language · Computer Science 2024-04-17 Watheq Mansour , Salam Albatarni , Sohaila Eltanbouly , Tamer Elsayed

With the rapid evolution of Natural Language Processing (NLP), Large Language Models (LLMs) like ChatGPT have emerged as powerful tools capable of transforming various sectors. Their vast knowledge base and dynamic interaction capabilities…

Computers and Society · Computer Science 2024-01-02 Kevin Wang , Jason Ramos , Ramon Lawrence

Large language models (LLMs), such as GPT-3 and GPT-4, have demonstrated exceptional performance in various natural language processing tasks and have shown the ability to solve certain reasoning problems. However, their reasoning…

Artificial Intelligence · Computer Science 2023-07-18 Adam Ishay , Zhun Yang , Joohyung Lee

Large Language Models (LLMs) have advanced rapidly as tools for automating code generation in scientific research, yet their ability to interpret and use unfamiliar Python APIs for complex computational experiments remains poorly…

Software Engineering · Computer Science 2025-09-17 Nuno Fachada , Daniel Fernandes , Carlos M. Fernandes , Bruno D. Ferreira-Saraiva , João P. Matos-Carvalho

The rapid advancement of large language models (LLMs) such as GPT-4 has revolutionized the landscape of software engineering, positioning these models at the core of modern development practices. As we anticipate these models to evolve into…

Software Engineering · Computer Science 2025-06-16 Jianian Gong , Nachuan Duan , Ziheng Tao , Zhaohui Gong , Yuan Yuan , Minlie Huang

The advent of Large Language Models (LLM) has revolutionized the efficiency and speed with which tasks are completed, marking a significant leap in productivity through technological innovation. As these chatbots tackle increasingly complex…

Software Engineering · Computer Science 2024-05-24 Luc Bryan Heitz , Joun Chamas , Christopher Scherb

Large language model (LLM) applications, such as ChatGPT, are a powerful tool for online information-seeking (IS) and problem-solving tasks. However, users still face challenges initializing and refining prompts, and their cognitive…

Human-Computer Interaction · Computer Science 2024-02-12 Ben Wang , Jiqun Liu , Jamshed Karimnazarov , Nicolas Thompson

The programming capabilities of large language models (LLMs) have revolutionized automatic code generation and opened new avenues for automatic statistical analysis. However, the validity and quality of these generated codes need to be…

Over the past decade, predictive language modeling for code has proven to be a valuable tool for enabling new forms of automation for developers. More recently, we have seen the advent of general purpose "large language models", based on…

Software Engineering · Computer Science 2023-06-05 Sajed Jalil , Suzzana Rafi , Thomas D. LaToza , Kevin Moran , Wing Lam

Large Language Models (LLMs) have drawn a lot of attention due to their strong performance on a wide range of natural language tasks, since the release of ChatGPT in November 2022. LLMs' ability of general-purpose language understanding and…

Computation and Language · Computer Science 2025-03-25 Shervin Minaee , Tomas Mikolov , Narjes Nikzad , Meysam Chenaghlu , Richard Socher , Xavier Amatriain , Jianfeng Gao

Using large language models (LLMs) for source code has recently gained attention. LLMs, such as Transformer-based models like Codex and ChatGPT, have been shown to be highly capable of solving a wide range of programming problems. However,…

Computation and Language · Computer Science 2023-06-27 Atsushi Shirafuji , Yutaka Watanobe , Takumi Ito , Makoto Morishita , Yuki Nakamura , Yusuke Oda , Jun Suzuki

Large language models (LLMs) have demonstrated remarkable potential in handling multilingual machine translation (MMT). In this paper, we systematically investigate the advantages and challenges of LLMs for MMT by answering two questions:…

Computation and Language · Computer Science 2024-06-17 Wenhao Zhu , Hongyi Liu , Qingxiu Dong , Jingjing Xu , Shujian Huang , Lingpeng Kong , Jiajun Chen , Lei Li

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

Language models have steadily increased in size over the past few years. They achieve a high level of performance on various natural language processing (NLP) tasks such as question answering and summarization. Large language models (LLMs)…

Computation and Language · Computer Science 2023-01-31 Jessica Huynh , Cathy Jiao , Prakhar Gupta , Shikib Mehri , Payal Bajaj , Vishrav Chaudhary , Maxine Eskenazi