English
Related papers

Related papers: S3LLM: Large-Scale Scientific Software Understandi…

200 papers

Deductive coding is a widely used qualitative research method for determining the prevalence of themes across documents. While useful, deductive coding is often burdensome and time consuming since it requires researchers to read, interpret,…

Computation and Language · Computer Science 2023-06-28 Robert Chew , John Bollenbacher , Michael Wenger , Jessica Speer , Annice Kim

Large Language Models (LLMs) such as GPT-4 and Llama have shown remarkable capabilities in a variety of software engineering tasks. Despite the advancements, their practical deployment faces challenges, including high financial costs, long…

Software Engineering · Computer Science 2025-08-06 Yueyue Liu , Hongyu Zhang , Yuantian Miao

Traditional optimizing compilers have played an important role in adapting to the growing complexity of modern software systems. The need for efficient parallel programming in current architectures requires strong optimization techniques.…

Artificial Intelligence · Computer Science 2025-04-03 Miguel Romero Rosas , Miguel Torres Sanchez , Rudolf Eigenmann

Large Language Models (LLMs) have shown remarkable capabilities in code generation tasks, yet they face significant limitations in handling complex, long-context programming challenges and demonstrating complex compositional reasoning…

Artificial Intelligence · Computer Science 2025-01-14 Amr Almorsi , Mohanned Ahmed , Walid Gomaa

General large language models (LLMs), represented by ChatGPT, have demonstrated significant potential in tasks such as code generation in software engineering. This has led to the development of specialized LLMs for software engineering,…

Software Engineering · Computer Science 2024-01-09 Zibin Zheng , Kaiwen Ning , Yanlin Wang , Jingwen Zhang , Dewu Zheng , Mingxi Ye , Jiachi Chen

The rapid advancement of large language models (LLMs) has revolutionized artificial intelligence, introducing unprecedented capabilities in natural language processing and multimodal content generation. However, the increasing complexity…

Software Engineering · Computer Science 2024-11-27 Shenao Wang , Yanjie Zhao , Xinyi Hou , Haoyu Wang

Large Language Models (LLMs) have demonstrated remarkable capabilities across a variety of software engineering and coding tasks. However, their application in the domain of code and compiler optimization remains underexplored. Training…

Programming Languages · Computer Science 2024-07-04 Chris Cummins , Volker Seeker , Dejan Grubisic , Baptiste Roziere , Jonas Gehring , Gabriel Synnaeve , Hugh Leather

The integration of large language models (LLMs) into automated algorithm design has shown promising potential. A prevalent approach embeds LLMs within search routines to iteratively generate and refine candidate algorithms. However, most…

Machine Learning · Computer Science 2026-05-20 Fei Liu , Rui Zhang , Xi Lin , Zhichao Lu , Qingfu Zhang

Large Language Models (LLMs) like GPT-3 and GPT-4 have emerged as groundbreaking innovations with capabilities that extend far beyond traditional AI applications. These sophisticated models, trained on massive datasets, can generate…

Software Engineering · Computer Science 2025-05-21 Md Asraful Haque

Science and engineering problems fall in the category of complex conceptual problems that require specific conceptual information (CI) like math/logic -related know-how, process information, or engineering guidelines to solve them. Large…

Computation and Language · Computer Science 2024-12-23 Nishtha N. Vaidya , Thomas Runkler , Thomas Hubauer , Veronika Haderlein-Hoegberg , Maja Mlicic Brandt

Context. Nowadays, 83% of software developers use Large Language Models (LLMs) to generate code. LLMs recently became essential to increase the productivity of software developers and decrease the time and cost of software development.…

Software Engineering · Computer Science 2024-05-07 Vlad-Andrei Cursaru , Laura Duits , Joel Milligan , Damla Ural , Berta Rodriguez Sanchez , Vincenzo Stoico , Ivano Malavolta

Recovering the structure of causal graphical models from observational data is an essential yet challenging task for causal discovery in scientific scenarios. Domain-specific causal discovery usually relies on expert validation or prior…

Artificial Intelligence · Computer Science 2025-08-27 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Qinrui Zhu , Qiang Tu , Huanhuan Chen

Large Language Models (LLMs) are starting to be profiled as one of the most significant disruptions in the Software Testing field. Specifically, they have been successfully applied in software testing tasks such as generating test code, or…

Software Engineering · Computer Science 2025-09-30 Cristian Augusto , Antonia Bertolino , Guglielmo De Angelis , Francesca Lonetti , Jesús Morán

The use of large language models (LLMs) for automated code generation has emerged as a significant focus within AI research. As these pretrained models continue to evolve, their ability to understand and generate complex code structures has…

Software Engineering · Computer Science 2025-05-06 Nazmus Ashrafi , Salah Bouktif , Mohammed Mediani

Mathematical equations have been unreasonably effective in describing complex natural phenomena across various scientific disciplines. However, discovering such insightful equations from data presents significant challenges due to the…

Machine Learning · Computer Science 2025-03-21 Parshin Shojaee , Kazem Meidani , Shashank Gupta , Amir Barati Farimani , Chandan K Reddy

Large Language Models (LLMs) are increasingly utilized for large-scale extraction and organization of unstructured data owing to their exceptional Natural Language Processing (NLP) capabilities. Empowering materials design, vast amounts of…

Digital Libraries · Computer Science 2025-12-11 Wenkai Ning , Musen Li , Jeffrey R. Reimers , Rika Kobayashi

AI-assisted code generation tools have revolutionized software development, offering unprecedented efficiency and scalability. However, multiple studies have consistently highlighted challenges such as security vulnerabilities, reliability…

Software Engineering · Computer Science 2025-06-16 Ahilan Ayyachamy Nadar Ponnusamy

Large Language Models (LLMs) show strong capabilities in code generation, motivating their use in automated quantum solver development. However, in quantum computing, successful execution of generated code is not sufficient: correctness…

Software Engineering · Computer Science 2026-05-12 Luciano Baresi , Domenico Bianculli , Maryse Ernzer , Livia Lestingi , Fabrizio Pastore , Seung Yeob Shin

Software vulnerabilities, caused by unintentional flaws in source code, are a primary root cause of cyberattacks. Static analysis of source code has been widely used to detect these unintentional defects introduced by software developers.…

Software Engineering · Computer Science 2024-08-08 Andrew A Mahyari

The increasing volume of scholarly publications requires advanced tools for efficient knowledge discovery and management. This paper introduces ongoing work on a system using Large Language Models (LLMs) for the semantic extraction of key…

Digital Libraries · Computer Science 2025-10-07 Samy Ateia , Udo Kruschwitz , Melanie Scholz , Agnes Koschmider , Moayad Almohaishi