English
Related papers

Related papers: TRACE: Evaluating Execution Efficiency of LLM-Base…

200 papers

Large Language Models (LLMs) and pre-trained Language Models (LMs) have achieved impressive success on many software engineering tasks (e.g., code completion and code generation). By leveraging huge existing code corpora (e.g., GitHub),…

Software Engineering · Computer Science 2025-01-16 Xin Yin , Chao Ni , Xiaodan Xu , Xinrui Li , Xiaohu Yang

Pre-trained models of source code have gained widespread popularity in many code intelligence tasks. Recently, with the scaling of the model and corpus size, large language models have shown the ability of in-context learning (ICL). ICL…

Software Engineering · Computer Science 2024-01-11 Shuzheng Gao , Xin-Cheng Wen , Cuiyun Gao , Wenxuan Wang , Hongyu Zhang , Michael R. Lyu

Code Sensitivity refers to the ability of Code LLMs to recognize and respond to details changes in problem descriptions. While current code benchmarks and instruction data focus on difficulty and diversity, sensitivity is overlooked. We…

Computation and Language · Computer Science 2025-05-21 Xianzhen Luo , Qingfu Zhu , Zhiming Zhang , Mingzheng Xu , Tianhao Cheng , Yixuan Wang , Zheng Chu , Shijie Xuyang , Zhiyuan Ma , YuanTao Fan , Wanxiang Che

Thinking Large Language Models (LLMs) generate explicit intermediate reasoning traces before final answers, potentially improving transparency, interpretability, and solution accuracy for code generation. However, the quality of these…

Artificial Intelligence · Computer Science 2025-11-11 Haoran Xue , Gias Uddin , Song Wang

Large Language Models (LLMs) are increasingly used to automate software development, yet most prior evaluations focus on functional correctness or high-level languages such as Python. As one of the first systematic explorations of…

Software Engineering · Computer Science 2025-09-04 Atieh Barati Nia , Mohammad Dindoost , David A. Bader

Large language models (LLMs) achieve impressive performance on complex mathematical benchmarks yet sometimes fail on basic math reasoning while generating unnecessarily verbose responses. In this paper, we present LLMThinkBench, a…

Computation and Language · Computer Science 2026-04-24 Gaurav Srivastava , Aafiya Hussain , Sriram Srinivasan , Xuan Wang

Large language models (LLMs) are increasingly proposed for crisis preparedness and response, particularly for multilingual communication. However, their suitability for high-stakes crisis contexts remains insufficiently evaluated. This work…

Computation and Language · Computer Science 2026-02-17 Belu Ticona , Antonis Anastasopoulos

Online programming platforms such as Codeforces and LeetCode attract millions of users seeking to learn to program or refine their skills for industry interviews. A major challenge for these users is the Time Limit Exceeded (TLE) error,…

Software Engineering · Computer Science 2025-10-17 Jialu Zhang , Jialiang Gu , Wangmeiyu Zhang , José Pablo Cambronero , John Kolesar , Ruzica Piskac , Daming Li , Hanyuan Shi

As software projects progress, quality of code assumes paramount importance as it affects reliability, maintainability and security of software. For this reason, static analysis tools are used in developer workflows to flag code quality…

Large Language Models (LLMs) have become extremely potent instruments with exceptional capacities for comprehending and producing human-like text in a wide range of applications. However, the increasing size and complexity of LLMs present…

Machine Learning · Computer Science 2024-06-18 Yingbing Huang , Lily Jiaxin Wan , Hanchen Ye , Manvi Jha , Jinghua Wang , Yuhong Li , Xiaofan Zhang , Deming Chen

This paper introduces a novel framework that leverages large language models (LLMs) for machine translation (MT). We start with one conjecture: an ideal translation should contain complete and accurate information for a strong enough LLM to…

Computation and Language · Computer Science 2024-11-06 Jianqiao Wangni

Large Language Models (LLMs) have significantly advanced Machine Translation (MT), applying them to linguistically complex domains-such as Social Network Services, literature etc. In these scenarios, translations often require handling…

Computation and Language · Computer Science 2026-04-17 Yanzhi Tian , Cunxiang Wang , Zeming Liu , Heyan Huang , Wenbo Yu , Dawei Song , Jie Tang , Yuhang Guo

Large Language Models (LLMs) have recently demonstrated strong capabilities in code-related tasks, but their robustness in code reasoning under perturbations remains underexplored. We introduce CodeCrash, a stress-testing framework with…

Artificial Intelligence · Computer Science 2025-10-14 Man Ho Lam , Chaozheng Wang , Jen-tse Huang , Michael R. Lyu

Large language models (LLMs) are increasingly integral as productivity assistants, but existing benchmarks fall short in rigorously evaluating their real-world instruction-following capabilities. Current benchmarks often (i) lack sufficient…

Computation and Language · Computer Science 2025-09-30 Jiho Park , Jongyoon Song , Minjin Choi , Kyuho Heo , Taehun Huh , Ji Won Kim

In industrial and open-source software engineering tasks, developers often perform project-wise code editing tasks, including feature enhancement, refactoring, and bug fixing, where the leading AI models are expected to support the…

Software Engineering · Computer Science 2026-04-15 Chenyan Liu , Yun Lin , Yuhuan Huang , Jiaxin Chang , Binhang Qi , Bo Jiang , Zhiyong Huang , Jin Song Dong

Large language models (LLMs) has experienced exponential growth, they demonstrate remarkable performance across various tasks. Notwithstanding, contemporary research primarily centers on enhancing the size and quality of pretraining data,…

Programming Languages · Computer Science 2024-04-16 Mengnan Qi , Yufan Huang , Yongqiang Yao , Maoquan Wang , Bin Gu , Neel Sundaresan

The performance of modern software systems is critically dependent on their complex configuration options. Building accurate performance models to navigate this vast space requires effective sampling strategies, yet existing methods often…

Software Engineering · Computer Science 2026-01-09 Xin Wang , Zhenhao Li , Zishuo Ding

The rapid growth of Large Language Models (LLMs) has been a driving force in transforming various domains, reshaping the artificial general intelligence landscape. However, the increasing computational and memory demands of these models…

Computation and Language · Computer Science 2024-04-22 Tianyu Ding , Tianyi Chen , Haidong Zhu , Jiachen Jiang , Yiqi Zhong , Jinxin Zhou , Guangzhi Wang , Zhihui Zhu , Ilya Zharkov , Luming Liang

Test-Time Scaling (TTS) has proven effective in improving the performance of Large Language Models (LLMs) during inference. However, existing research has overlooked the efficiency of TTS from a latency-sensitive perspective. Through a…

Computation and Language · Computer Science 2025-09-15 Zili Wang , Tianyu Zhang , Haoli Bai , Lu Hou , Xianzhi Yu , Wulong Liu , Shiming Xiang , Lei Zhu

Large language models (LLMs) have demonstrated multilingual capabilities, yet they are mostly English-centric due to the imbalanced training corpora. While prior works have leveraged this bias to enhance multilingual performance through…

Computation and Language · Computer Science 2025-04-22 Chaoqun Liu , Wenxuan Zhang , Yiran Zhao , Anh Tuan Luu , Lidong Bing