English
Related papers

Related papers: GSO: Challenging Software Optimization Tasks for E…

200 papers

One of the fundamental problems in digital agents is their lack of understanding of their environment. For instance, a web browsing agent may get lost in unfamiliar websites, uncertain what pages must be visited to achieve its goals. To…

Computation and Language · Computer Science 2026-03-04 Apurva Gandhi , Graham Neubig

Sequential transfer optimization (STO), which aims to improve the optimization performance on a task of interest by exploiting the knowledge captured from several previously-solved optimization tasks stored in a database, has been gaining…

Neural and Evolutionary Computing · Computer Science 2023-10-20 Xiaoming Xue , Cuie Yang , Liang Feng , Kai Zhang , Linqi Song , Kay Chen Tan

In this paper, we present NEMO, a system that translates Natural-language descriptions of decision problems into formal Executable Mathematical Optimization implementations, operating collaboratively with users or autonomously. Existing…

Artificial Intelligence · Computer Science 2026-01-30 Yang Song , Anoushka Vyas , Zirui Wei , Sina Khoshfetrat Pakazad , Henrik Ohlsson , Graham Neubig

Large language models (LLMs) have shown strong reasoning and coding capabilities, yet they struggle to generalize to real-world software engineering (SWE) problems that are long-horizon and out of distribution. Existing systems often rely…

Machine Learning · Computer Science 2026-01-05 Iris Xu , Guangtao Zeng , Zexue He , Charles Jin , Aldo Pareja , Dan Gutfreund , Chuang Gan , Zhang-Wei Hong

Agent skills, structured procedural knowledge packages injected at inference time, are increasingly used to augment LLM agents on software engineering tasks. However, their real utility in end-to-end development settings remains unclear. We…

Software Engineering · Computer Science 2026-03-17 Tingxu Han , Yi Zhang , Wei Song , Chunrong Fang , Zhenyu Chen , Youcheng Sun , Lijie Hu

Benchmarks for large language models (LLMs) have predominantly assessed short-horizon, localized reasoning. Existing long-horizon suites (e.g. SWE-bench) rely on manually curated issues, so expanding or tuning difficulty demands expensive…

Machine Learning · Computer Science 2025-06-03 Kaivalya Hariharan , Uzay Girit , Atticus Wang , Jacob Andreas

Traditional optimization methods excel in well-defined search spaces but struggle with design problems where transformations and design parameters are difficult to define. Large language models (LLMs) offer a promising alternative by…

Machine Learning · Computer Science 2025-12-01 Anthony Carreon , Vansh Sharma , Venkat Raman

Large language models (LLMs) have been widely adopted across diverse domains of software engineering, such as code generation, program repair, and vulnerability detection. These applications require understanding beyond surface-level code…

Software Engineering · Computer Science 2026-01-21 Danning Xie , Mingwei Zheng , Xuwei Liu , Jiannan Wang , Chengpeng Wang , Lin Tan , Xiangyu Zhang

Computer-Using Agents (CUAs) are rapidly extending large language models (LLMs) beyond text-based reasoning toward action execution in more complex environments, such as web browsers and graphical user interfaces (GUIs). However, existing…

Progress in software-engineering agents is increasingly constrained by the scarcity of executable, scalable, and realistic data for training and evaluation. This scarcity stems from three fundamental challenges in existing pipelines:…

Artificial Intelligence · Computer Science 2026-03-03 Yucheng Zeng , Shupeng Li , Daxiang Dong , Ruijie Xu , Zimo Chen , Liwei Zheng , Yuxuan Li , Zhe Zhou , Haotian Zhao , Lun Tian , Heng Xiao , Tianshu Zhu , Longkun Hao , Jianmin Wu

Large language models (LLMs) have been widely adopted in mathematical optimization in scientific scenarios for their extensive knowledge and advanced reasoning capabilities. Existing methods mainly focus on utilizing LLMs to solve…

Optimization and Control · Mathematics 2025-03-18 Qitan Lv , Tianyu Liu , Hong Wang

Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in…

Developing modern systems software is a complex task that combines business logic programming and Software Performance Engineering (SPE). The later is an experimental and labor-intensive activity focused on optimizing the system for a given…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-05 Carlo Curino , Neha Godwal , Brian Kroth , Sergiy Kuryata , Greg Lapinski , Siqi Liu , Slava Oks , Olga Poppe , Adam Smiechowski , Ed Thayer , Markus Weimer , Yiwen Zhu

Large Language Models (LLMs) have demonstrated remarkable capabilities in code understanding and generation. However, their effectiveness on non-code Software Engineering (SE) tasks remains underexplored. We present 'Software Engineering…

Software Engineering · Computer Science 2026-02-12 Fabian C. Peña , Steffen Herbold

Automating the adaptation of software engineering (SE) research artifacts across datasets is essential for scalability and reproducibility, yet it remains largely unstudied. Recent advances in large language model (LLM)-based multi-agent…

Software Engineering · Computer Science 2025-11-27 Jingyi Chen , Xiaoyan Guo , Songqiang Chen , Shing-Chi Cheung , Jiasi Shen

Coding agents are increasingly deployed in real software development, where a single version iteration requires months of coordinated work across many files. However, most existing benchmarks focus predominantly on single-issue bug fixes…

Large language models (LLMs) have recently been used for sequential decision making in interactive environments. However, leveraging environment reward signals for continual LLM actor improvement is not straightforward. We propose Skill Set…

Machine Learning · Computer Science 2024-06-25 Kolby Nottingham , Bodhisattwa Prasad Majumder , Bhavana Dalvi Mishra , Sameer Singh , Peter Clark , Roy Fox

Despite rapid progress on coding agents, progress on their multimodal counterparts has lagged behind. A key challenge is the scarcity of evaluation testbeds that combine the complexity of software development with the need for deep…

Standard Operating Procedures (SOPs) are critical for enterprise operations, yet existing language models struggle with SOP understanding and cross-domain generalization. Current methods fail because joint training cannot differentiate…

Computation and Language · Computer Science 2026-02-11 Siyuan Huang , Ziyu Wang , Chao Pan , Han Zhao

Large Language Model (LLM) code agents increasingly resolve repository-level issues by iteratively editing code, invoking tools, and validating candidate patches. In these workflows, agents often write tests on the fly, but the value of…

Software Engineering · Computer Science 2026-04-10 Zhi Chen , Zhensu Sun , Yuling Shi , Chao Peng , Xiaodong Gu , David Lo , Lingxiao Jiang