中文
相关论文

相关论文: A Systematic Evaluation of Large Code Models in AP…

200 篇论文

As software systems grow in scale, developers face increasing difficulty in selecting appropriate Application Programming Interfaces (APIs) from numerous options. Efficiently identifying APIs that satisfy functional requirements has become…

软件工程 · 计算机科学 2026-05-04 Shenglong Wu , Xunhui Zhang , Tao Wang

Large language models (LLMs) have limitations in handling tasks that require real-time access to external APIs. While several benchmarks like ToolBench and APIGen have been developed to assess LLMs' API-use capabilities, they often suffer…

人工智能 · 计算机科学 2024-09-25 Woojeong Kim , Ashish Jagmohan , Aditya Vempaty

$ $Large Language Models (LLMs) are being increasingly utilized in various applications, with code generations being a notable example. While previous research has shown that LLMs have the capability to generate both secure and insecure…

Digital tool-based agents, powered by Large Language Models (LLMs), that invoke external Application Programming Interfaces (APIs) often rely on documentation to understand API functionality. However, such documentation is frequently…

人工智能 · 计算机科学 2025-11-13 Bhrij Patel , Ashish Jagmohan , Aditya Vempaty

Despite recent research efforts, the vision of automatic code generation through API recommendation has not been realized. Accuracy and expressiveness challenges of API recommendation needs to be systematically addressed. We present a new…

软件工程 · 计算机科学 2021-03-19 Ya Xiao , Salman Ahmed , Wenjia Song , Xinyang Ge , Bimal Viswanath , Danfeng Yao

Large language models (LLMs) for code are increasingly used in software development, but they remain static after pretraining while APIs and software libraries continue to evolve. Model editing offers a lightweight alternative to retraining…

软件工程 · 计算机科学 2026-05-11 Vinaik Chhetri , Moghis Fereidouni , A. B Siddique , Umar Farooq

Developers prefer to utilize third-party libraries when they implement some functionalities and Application Programming Interfaces (APIs) are frequently used by them. Facing an unfamiliar API, developers tend to consult tutorials as…

软件工程 · 计算机科学 2017-03-07 He Jiang , Jingxuan Zhang , Xiaochen Li , Zhilei Ren , David Lo

Code reasoning tasks are becoming prevalent in large language model (LLM) assessments. Yet, there is a dearth of studies on the impact of real-world complexities on code reasoning, e.g., inter- or intra-procedural dependencies, API calls,…

软件工程 · 计算机科学 2026-04-27 Changshu Liu , Alireza Ghazanfari , Yang Chen , Reyhaneh Jabbarvand

Based on developer needs and usage scenarios, API (Application Programming Interface) recommendation is the process of assisting developers in finding the required API among numerous candidate APIs. Previous studies mainly modeled API…

软件工程 · 计算机科学 2023-09-14 Yafeng Gu , Yiheng Shen , Xiang Chen , Shaoyu Yang , Yiling Huang , Zhixiang Cao

While the automated detection of cryptographic API misuses has progressed significantly, its precision diminishes for intricate targets due to the reliance on manually defined patterns. Large Language Models (LLMs) offer a promising…

密码学与安全 · 计算机科学 2026-03-19 Yifan Xia , Zichen Xie , Peiyu Liu , Kangjie Lu , Yan Liu , Wenhai Wang , Shouling Ji

Large language models (LLMs) are now an integral part of software development workflows and are reshaping the whole process. Traditional technology stack selection has not caught up. Most of the existing selection methods focus solely on…

软件工程 · 计算机科学 2025-09-16 Xiaoyu Zhang , Weipeng Jiang , Juan Zhai , Shiqing Ma , Qingshuang Bao , Chenhao Lin , Chao Shen , Tianlin Li , Yang Liu

Large Language Models (LLMs) can interact with the real world by connecting with versatile external APIs, resulting in better problem-solving and task automation capabilities. Previous research primarily focuses on APIs with limited…

软件工程 · 计算机科学 2024-10-29 Hongru Wang , Rui Wang , Boyang Xue , Heming Xia , Jingtao Cao , Zeming Liu , Jeff Z. Pan , Kam-Fai Wong

Open Source Software projects add labels to open issues to help contributors choose tasks. However, manually labeling issues is time-consuming and error-prone. Current automatic approaches for creating labels are mostly limited to…

软件工程 · 计算机科学 2024-01-24 Fabio Santos , Igor Wiese , Bianca Trinkenreich , Igor Steinmacher , Anita Sarma , Marco Gerosa

Large Language Models (LLMs) are becoming key in automating and assisting various software development tasks, including text-based tasks in requirements engineering but also in coding. Typically, these models are used to automate small…

软件工程 · 计算机科学 2024-05-08 Robert Feldt , Riccardo Coppola

With the advent and proliferation of online developer forums as informal documentation, developers often share their opinions about the APIs they use. Thus, opinions of others often shape the developer's perception and decisions related to…

软件工程 · 计算机科学 2021-02-18 Gias Uddin , Olga Baysal , Latifa Guerrouj , Foutse Khomh

API-driven chatbot systems are increasingly integral to software engineering applications, yet their effectiveness hinges on accurately generating and executing API calls. This is particularly challenging in scenarios requiring multi-step…

Large language models (LLMs) have achieved exceptional performance in code generation. However, the performance remains unsatisfactory in generating library-oriented code, especially for the libraries not present in the training data of…

软件工程 · 计算机科学 2024-03-01 Zexiong Ma , Shengnan An , Bing Xie , Zeqi Lin

There is a growing need for Large Language Models (LLMs) to effectively use tools and external Application Programming Interfaces (APIs) to plan and complete tasks. As such, there is tremendous interest in methods that can acquire…

APIs have intricate relations that can be described in text and represented as knowledge graphs to aid software engineering tasks. Existing relation extraction methods have limitations, such as limited API text corpus and affected by the…

软件工程 · 计算机科学 2023-11-03 Qing Huang , Yanbang Sun , Zhenchang Xing , Yuanlong Cao , Jieshan Chen , Xiwei Xu , Huan Jin , Jiaxing Lu

The proliferation of Large Language Models like ChatGPT has significantly advanced language understanding and generation, impacting a broad spectrum of applications. However, these models predominantly excel in text-based tasks, overlooking…

计算与语言 · 计算机科学 2023-11-23 Xiao Liu , Jianfeng Lin , Jiawei Zhang