中文
相关论文

相关论文: Evaluating the Use of LLMs for Automated DOM-Level…

200 篇论文

GitHub workflows or GitHub CI is a popular continuous integration platform that enables developers to automate various software engineering tasks by specifying them as workflows, i.e., YAML files with a list of jobs. However, engineering…

软件工程 · 计算机科学 2024-03-20 Xinyu Zhang , Siddharth Muralee , Sourag Cherupattamoolayil , Aravind Machiry

Large Language Models (LLMs) have shown capabilities close to human performance in various analytical tasks, leading researchers to use them for time and labor-intensive analyses. However, their capability to handle highly specialized and…

计算与语言 · 计算机科学 2024-10-08 Alexander S. Choi , Syeda Sabrina Akter , JP Singh , Antonios Anastasopoulos

Large Language Models (LLMs) have the unique capability to understand and generate human-like text from input queries. When fine-tuned, these models show enhanced performance on domain-specific queries. OpenAI highlights the process of…

计算与语言 · 计算机科学 2024-07-02 Scott Barnett , Zac Brannelly , Stefanus Kurniawan , Sheng Wong

The advent of Large Language Models (LLMs) has revolutionized various domains of artificial intelligence, including the realm of software engineering. In this research, we evaluate the efficacy of pre-trained LLMs in replicating the tasks…

软件工程 · 计算机科学 2024-06-10 Tajmilur Rahman , Rahul Singh , Mir Yousuf Sultan

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

人工智能 · 计算机科学 2023-09-12 Chang Liu , Bo Wu

Large language models (LLMs) have attracted considerable attention as they are capable of showcasing impressive capabilities generating comparable high-quality responses to human inputs. LLMs, can not only compose textual scripts such as…

计算工程、金融与科学 · 计算机科学 2024-05-31 Denish Omondi Otieno , Faranak Abri , Sima Siami-Namini , Akbar Siami Namin

Large Language Models (LLMs), particularly Code LLMs, have demonstrated impressive performance in code generation. Current research primarily focuses on the correctness of generated code, while efficiency remains less explored. Recent works…

软件工程 · 计算机科学 2025-02-27 Tong Ye , Weigang Huang , Xuhong Zhang , Tengfei Ma , Peiyu Liu , Jianwei Yin , Wenhai Wang

Despite the growing interest in leveraging Large Language Models (LLMs) for content analysis, current studies have primarily focused on text-based content. In the present work, we explored the potential of LLMs in assisting video content…

人机交互 · 计算机科学 2024-07-31 Jiaying Lizzy Liu , Yunlong Wang , Yao Lyu , Yiheng Su , Shuo Niu , Xuhai Orson Xu , Yan Zhang

The emergence of Large Language Models (LLMs) has opened new opportunities to automate software engineering activities that traditionally require substantial manual effort. Among these, class diagram generation represents a critical yet…

软件工程 · 计算机科学 2026-03-11 Jackson Nguyen , Rui En Koe , Fanyu Wang , Chetan Arora , Alessio Ferrari

Artificial intelligence (AI) is widely deployed to solve problems related to marketing attribution and budget optimization. However, AI models can be quite complex, and it can be difficult to understand model workings and insights without…

计算与语言 · 计算机科学 2024-04-23 Yilin Gao , Sai Kumar Arava , Yancheng Li , James W. Snyder

Large Language Models (LLMs) have demonstrated remarkable capabilities in software engineering, yet comprehensive benchmarks covering diverse SE activities remain limited. We present a multi-task evaluation of 11 state-of-the-art LLMs…

软件工程 · 计算机科学 2026-02-10 Go Frendi Gunawan , Mukhlis Amien

The rapid advancement of Large Language Models (LLMs) in the realm of mathematical reasoning necessitates comprehensive evaluations to gauge progress and inspire future directions. Existing assessments predominantly focus on problem-solving…

计算与语言 · 计算机科学 2024-06-05 Xiaoyuan Li , Wenjie Wang , Moxin Li , Junrong Guo , Yang Zhang , Fuli Feng

Reasoning Large Language Models (LLMs) have shown promising results when tasked with solving complex problems. In this paper, we propose and evaluate a multi-stage workflow that leverages the capabilities of fine-tuned reasoning LLMs to…

计算与语言 · 计算机科学 2026-01-13 Alberto Purpura , Emily Chen , Swapnil Shinde

Language models (LMs) built upon deep neural networks (DNNs) have recently demonstrated breakthrough effectiveness in software engineering tasks such as code generation, completion, and repair. This has paved the way for the emergence of…

As organizations increasingly seek to leverage machine learning (ML) capabilities, the technical complexity of implementing ML solutions creates significant barriers to adoption and impacts operational efficiency. This research examines how…

人机交互 · 计算机科学 2025-07-09 Jiapeng Yao , Lantian Zhang , Jiping Huang

Objective: This study aims to summarize the usage of Large Language Models (LLMs) in the process of creating a scientific review. We look at the range of stages in a review that can be automated and assess the current state-of-the-art…

数字图书馆 · 计算机科学 2025-05-16 Dmitry Scherbakov , Nina Hubig , Vinita Jansari , Alexander Bakumenko , Leslie A. Lenert

Code analysis is fundamental in Software Engineering, supporting debugging, optimization, and security assessment. Human developers approach it through syntax parsing, static semantics inference, and dynamic reasoning. Traditional tools are…

软件工程 · 计算机科学 2026-05-22 Wei Ma , Zhihao Lin , Shangqing Liu , Qiang Hu , Ye Liu , Wenhan Wang , Cen Zhang , Liming Nie , Li Li , Yang Liu , Lingxiao Jiang

Large Language Models (LLMs) have revolutionized the field of Natural Language Processing thanks to their ability to reuse knowledge acquired on massive text corpora on a wide variety of downstream tasks, with minimal (if any) tuning steps.…

计算与语言 · 计算机科学 2024-07-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

In recent years, large language models (LLMs) have achieved remarkable success in natural language processing (NLP). LLMs require an extreme amount of parameters to attain high performance. As models grow into the trillion-parameter range,…

计算与语言 · 计算机科学 2024-09-10 Zhyar Rzgar K Rostam , Sándor Szénási , Gábor Kertész

Visual Language Models (VLMs) are now increasingly being merged with Large Language Models (LLMs) to enable new capabilities, particularly in terms of improved interactivity and open-ended responsiveness. While these are remarkable…